00000001:02000400:3.0F:1788890826.036319:0:3303:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788890834.880378:0:3505:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1788890835.822619:0:3565:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1271 MB/s 00000001:01000000:0.0:1788890836.072727:0:3565:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1547 MB/s 00000001:01000000:0.0:1788890836.322555:0:3565:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 9903 MB/s 00000020:02000000:2.0F:1788890836.552249:0:3596:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_103_ga91bf53 00000400:02000000:1.0F:1788890836.862441:0:3611:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.126@tcp [8/256/0/180] 00008000:02000000:0.0:1788890839.114302:0:3761:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788890859.985301:0:5725:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788890864.499987:0:6473:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788890864.499992:0:6473:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788890864.499994:0:6473:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788890864.500146:0:6473:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000fd706315 00000080:02000400:2.0:1788890864.500156:0:6473:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788890864.502377:0:6473:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788890864.502383:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788890864.502403:0:6473:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000003699e730) 00000020:00000080:2.0:1788890864.502419:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788890864.518059:0:6473:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788890864.518101:0:6473:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1788890864.528671:0:6473:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788890864.528849:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788890864.528856:0:6473:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788890864.528866:0:6473:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd527da 00000020:01000004:2.0:1788890864.528872:0:6473:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788890864.528877:0:6473:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788890864.528880:0:6473:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000fd706315 from MGS 00000020:01000004:2.0:1788890864.528885:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788890864.528894:0:6473:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000009d91a4c0) 00000020:00000080:2.0:1788890864.528902:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788890864.528973:0:6473:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fd706315 from MGS, refs=2 00080000:01000000:2.0:1788890864.528978:0:6473:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788890864.528982:0:6473:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd527e8 00000100:00100000:2.0:1788890864.529068:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788890864.529180:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788890864.529186:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788890864.529516:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788890864.529543:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788890864.529975:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788890864.530134:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788890864.530137:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788890864.530415:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788890864.530420:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788890864.530944:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788890864.530951:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788890864.531312:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890864.531315:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890864.531318:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890864.531449:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890864.531452:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890864.531453:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890864.531755:0:6473:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788890864.534697:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788890864.781608:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 7027 MB/s 00000001:01000000:0.0:1788890865.031642:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 8167 MB/s 00000001:01000000:0.0:1788890865.282165:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1543 MB/s 00000001:01000000:0.0:1788890865.531554:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1895 MB/s 00080000:10000000:0.0:1788890865.534686:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1788890865.539895:0:6473:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788890865.540302:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788890865.540319:0:6473:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788890865.540353:0:6473:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788890865.540555:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788890865.540586:0:6473:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788890865.541050:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788890865.541244:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788890865.541251:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788890865.541651:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788890865.541658:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788890865.541841:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788890865.541848:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1788890865.542201:0:6492:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1788890865.542219:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788890865.542241:0:6473:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.126@tcp' 00000020:01000004:1.0:1788890865.542243:0:6473:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788890865.542286:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.126@tcp (typ=mgc) 00000020:00000080:1.0:1788890865.542307:0:6473:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.126@tcp (000000004f190e39) 00000020:00000080:1.0:1788890865.542321:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788890865.542464:0:6473:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000aefc8b4@MGC192.168.204.126@tcp: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1788890865.542744:0:6473:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.126@tcp-0 is initialized 00000040:01000000:1.0:1788890865.542752:0:6473:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788890865.543540:0:6493:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788890865.543570:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.126@tcp (uuid 0dc9e9f5-fe04-4428-a993-651ed6fecbec) 00000020:00000080:1.0:1788890865.543584:0:6473:0:(genops.c:1385:class_connect()) connect: client 0dc9e9f5-fe04-4428-a993-651ed6fecbec, cookie 0xa66601b03fd527f6 00000100:00080000:1.0:1788890865.543593:0:6473:0:(import.c:510:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788890865.543599:0:6473:0:(import.c:624:import_select_connection()) MGC192.168.204.126@tcp: import 000000000aefc8b4 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788890865.543646:0:6473:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000038139ea3 x1875787997249664/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788890865.543668:0:6473:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0dc9e9f5-fe04-4428-a993-651ed6fecbec->MGS 00000020:01000004:1.0:1788890865.543688:0:6473:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788890865.543693:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788890865.543703:0:6473:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000006c95305d) 00000020:00000080:1.0:1788890865.543713:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788890865.543792:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038139ea3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3626:1875787997249664:0@lo:250: 00000100:00100000:0.0:1788890865.543865:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890865.543905:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997249664 00000100:00100000:3.0:1788890865.543915:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997249664 00000100:00100000:3.0:1788890865.543962:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788890865.543970:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005eabe31c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3626:x1875787997249664:12345-0@lo:250: 00010000:00080000:3.0:1788890865.543994:0:6488:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 0dc9e9f5-fe04-4428-a993-651ed6fecbec@0@lo t0 exp 0000000000000000 cur 87 last 0 00000020:00000080:3.0:1788890865.544028:0:6488:0:(genops.c:1385:class_connect()) connect: client 0dc9e9f5-fe04-4428-a993-651ed6fecbec, cookie 0xa66601b03fd52804 00000100:00080000:3.0:1788890865.544164:0:6488:0:(import.c:65:import_set_state_nolock()) 00000000cd0fa661 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788890865.544246:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005eabe31c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+5:3626:x1875787997249664:12345-0@lo:250: Request processed in 275us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890865.544255:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788890865.544274:0:3626:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788890865.544284:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) MGC192.168.204.126@tcp: connect to target with instance 0 00000100:00080000:0.0:1788890865.544290:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) MGC192.168.204.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788890865.544300:0:3626:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788890865.544303:0:3626:0:(import.c:65:import_set_state_nolock()) 000000000aefc8b4 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788890865.544306:0:3626:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788890865.544315:0:3626:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788890865.544321:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038139ea3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3626:1875787997249664:0@lo:250: 00000100:00100000:1.0:1788890865.550061:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788890865.550204:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788890865.550216:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788890865.550779:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788890865.550785:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788890865.551319:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788890865.551324:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788890865.551966:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788890865.552099:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788890865.552102:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788890865.552444:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788890865.552451:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788890865.572282:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788890865.572500:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788890865.572506:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788890865.573275:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788890865.573284:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788890865.573885:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788890865.573971:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788890865.573974:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788890865.574365:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788890865.574371:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788890865.574800:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788890865.574891:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788890865.574894:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788890865.575179:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788890865.575186:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788890865.575676:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788890865.575784:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788890865.575790:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788890865.576060:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788890865.576065:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788890865.586372:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788890865.586617:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788890865.586624:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788890865.587455:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788890865.587464:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788890865.588043:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788890865.588050:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788890865.588652:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788890865.588671:0:6473:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788890865.588675:0:6473:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788890865.588751:0:6473:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788890865.588777:0:6473:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.126@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788890865.588781:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788890865.588782:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788890865.588788:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788890865.588789:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788890865.588790:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788890865.588791:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788890865.588792:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788890865.588793:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788890865.588795:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788890865.588796:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788890865.588797:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788890865.588799:0:6473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788890865.588801:0:6473:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788890865.588803:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788890865.588804:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788890865.588805:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788890865.588806:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788890865.588807:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788890865.588807:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788890865.588808:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788890865.588809:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788890865.588810:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788890865.588811:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788890865.588812:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788890865.588812:0:6473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788890865.588847:0:6473:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788890865.588862:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997249792:0@lo:253: 00000100:00100000:0.0:1788890865.588922:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890865.588983:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997249792 00000100:00100000:0.0:1788890865.588984:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 000000004012807c going to sleep for 11 seconds 00000100:00100000:1.0:1788890865.588992:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997249792 00000100:00100000:1.0:1788890865.589045:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788890865.589054:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f58dcb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+5:6473:x1875787997249792:12345-0@lo:253: 20000000:01000000:1.0:1788890865.589097:0:6491:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788890865.589100:0:6491:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788890865.589316:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788890865.589335:0:6491:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788890865.589609:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788890865.590344:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788890865.590426:0:6491:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788890865.590429:0:6491:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788890865.590434:0:6491:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788890865.590437:0:6491:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788890865.590448:0:6491:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788890865.590554:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788890865.590692:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788890865.590702:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788890865.590712:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788890865.590721:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788890865.590734:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788890865.590762:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788890865.590766:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788890865.590772:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788890865.590775:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788890865.590781:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788890865.590783:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788890865.590789:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788890865.590797:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788890865.590810:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788890865.590812:0:6491:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788890865.590816:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788890865.590928:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788890865.590938:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788890865.590953:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788890865.590967:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788890865.590983:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788890865.590990:0:6491:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788890865.591012:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788890865.591031:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788890865.591045:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788890865.591061:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788890865.591077:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788890865.591085:0:6491:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788890865.591117:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788890865.591124:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788890865.591135:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788890865.591148:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788890865.591195:0:6491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788890865.591216:0:6491:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788890865.591221:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788890865.591465:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788890865.591589:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788890865.591605:0:6491:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.126@tcp for mdt 20000000:01000000:0.0:1788890865.591606:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788890865.591618:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788890865.591623:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788890865.591634:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788890865.591640:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:0.0:1788890865.591662:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788890865.591668:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788890865.591680:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788890865.591694:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788890865.591720:0:6491:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788890865.591722:0:6491:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788890865.591725:0:6491:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788890865.591758:0:6491:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788890865.591760:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788890865.591934:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788890865.592007:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788890865.592039:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788890865.592054:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1788890865.592063:0:6491:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788890865.592065:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788890865.592237:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788890865.592307:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788890865.592328:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788890865.592343:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1788890865.592353:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788890865.592356:0:6491:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788890865.592359:0:6491:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788890865.592361:0:6491:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788890865.592365:0:6491:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788890865.592370:0:6491:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788890865.592585:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788890865.592645:0:6491:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00010000:00010000:3.0:1788890865.595637:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788890865.596751:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788890865.596769:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788890865.596777:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788890865.596788:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788890865.596805:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001836ccba/0xa66601b03fd5280b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.596818:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001836ccba/0xa66601b03fd5280b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.596827:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001836ccba/0xa66601b03fd5280b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.596834:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001836ccba/0xa66601b03fd5280b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.596840:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001836ccba/0xa66601b03fd5280b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.596846:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001836ccba/0xa66601b03fd5280b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.596852:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001836ccba already unused, calling callback (0000000070d43ab9) 00010000:00010000:1.0:1788890865.596856:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001836ccba/0xa66601b03fd5280b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.596877:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001836ccba/0xa66601b03fd5280b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.596891:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001836ccba/0xa66601b03fd5280b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.596899:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001836ccba/0xa66601b03fd5280b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.596903:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001836ccba/0xa66601b03fd5280b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788890865.596915:0:6491:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788890865.600452:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f58dcb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+5:6473:x1875787997249792:12345-0@lo:253: Request processed in 11396us (11527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890865.600463:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788890865.600480:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997249792:0@lo:253: 10000000:01000000:0.0:1788890865.600494:0:6473:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788890865.600496:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788890865.600498:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788890865.600499:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788890865.600500:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788890865.600501:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788890865.600502:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788890865.600503:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788890865.600504:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788890865.600505:0:6473:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788890865.600510:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788890865.600512:0:6473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788890865.600550:0:6473:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000fd706315 from lustre-MDT0000 10000000:01000000:0.0:1788890865.600572:0:6473:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788890865.600574:0:6473:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788890865.600577:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff925091ac8000 10000000:01000000:0.0:1788890865.600580:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788890865.600585:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff925091ac8000 from 1 10000000:01000000:0.0:1788890865.600587:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788890865.600615:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.600622:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.600628:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890865.600640:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997249920:0@lo:101: 00000100:00100000:0.0:1788890865.600671:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.600713:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 0000000021725c1b going to sleep for 11 seconds 00000100:00100000:3.0:1788890865.600718:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997249920 00000100:00100000:3.0:1788890865.600724:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997249920 00000100:00100000:3.0:1788890865.600759:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788890865.600765:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4aa4b3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+5:6473:x1875787997249920:12345-0@lo:101: 00010000:00010000:3.0:1788890865.600779:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890865.600788:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000072089ddc/0xa66601b03fd52819 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52812 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.600804:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000072089ddc/0xa66601b03fd52819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52812 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.600810:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000072089ddc/0xa66601b03fd52819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52812 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.600815:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000072089ddc, rc 0) 00000100:00100000:3.0:1788890865.600840:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4aa4b3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+6:6473:x1875787997249920:12345-0@lo:101: Request processed in 76us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890865.600852:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788890865.600854:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997249920:0@lo:101: 00010000:00010000:0.0:1788890865.600867:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52812 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52819 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.600874:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52812 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52819 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890865.600905:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997250048:0@lo:501: 00000100:00100000:0.0:1788890865.600930:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.600954:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 0000000021725c1b going to sleep for 11 seconds 00000100:00100000:1.0:1788890865.600963:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997250048 00000100:00100000:1.0:1788890865.600967:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997250048 00000100:00100000:1.0:1788890865.600990:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788890865.600994:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d7917f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+6:6473:x1875787997250048:12345-0@lo:501: 00000100:00100000:1.0:1788890865.601062:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d7917f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+6:6473:x1875787997250048:12345-0@lo:501: Request processed in 67us (132us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788890865.601067:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788890865.601094:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997250048:0@lo:501: 10000000:01000000:0.0:1788890865.601118:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788890865.601130:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52812 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52819 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.601137:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52819 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890865.601145:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92509099a000 10000000:01000000:0.0:1788890865.601148:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788890865.601151:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff92509099a000 10000000:01000000:0.0:1788890865.601153:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788890865.601155:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff92509099a000 from 1 10000000:01000000:0.0:1788890865.601157:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788890865.601166:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 00000000b5b3f7e3/0xa66601b03fd52820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.601171:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 00000000b5b3f7e3/0xa66601b03fd52820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.601175:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 00000000b5b3f7e3/0xa66601b03fd52820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890865.601181:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997250176:0@lo:101: 00000100:00100000:0.0:1788890865.601202:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.601219:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 0000000021725c1b going to sleep for 11 seconds 00000100:00100000:3.0:1788890865.601228:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997250176 00000100:00100000:3.0:1788890865.601232:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997250176 00000100:00100000:3.0:1788890865.601248:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788890865.601251:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa4263d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+6:6473:x1875787997250176:12345-0@lo:101: 00010000:00010000:3.0:1788890865.601255:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890865.601261:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000db4af717/0xa66601b03fd52827 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52820 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.601269:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db4af717/0xa66601b03fd52827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52820 expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.601273:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000db4af717/0xa66601b03fd52827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52820 expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.601277:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000db4af717, rc 0) 00000100:00100000:3.0:1788890865.601299:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa4263d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+7:6473:x1875787997250176:12345-0@lo:101: Request processed in 47us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890865.601304:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788890865.601311:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997250176:0@lo:101: 00010000:00010000:0.0:1788890865.601320:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 00000000b5b3f7e3/0xa66601b03fd52820 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52827 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.601331:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 00000000b5b3f7e3/0xa66601b03fd52820 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52827 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890865.601341:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788890865.601351:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 00000000b5b3f7e3/0xa66601b03fd52820 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52827 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.601357:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 00000000b5b3f7e3/0xa66601b03fd52820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52827 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890865.601363:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788890865.601367:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788890865.601371:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff92509099a000 10000000:01000000:0.0:1788890865.601374:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788890865.601376:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788890865.601385:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788890865.601396:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd5282e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.601402:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd5282e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.601407:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd5282e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890865.601417:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997250304:0@lo:101: 00000100:00100000:0.0:1788890865.601441:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.601456:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 0000000021725c1b going to sleep for 11 seconds 00000100:00100000:1.0:1788890865.601470:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997250304 00000100:00100000:1.0:1788890865.601473:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997250304 00000100:00100000:1.0:1788890865.601490:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788890865.601493:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa951dd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+7:6473:x1875787997250304:12345-0@lo:101: 00010000:00010000:1.0:1788890865.601498:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890865.601507:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006c577d0d/0xa66601b03fd52835 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd5282e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.601516:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006c577d0d/0xa66601b03fd52835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd5282e expref: 8 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.601535:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006c577d0d/0xa66601b03fd52835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd5282e expref: 8 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.601540:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006c577d0d, rc 0) 00000100:00100000:1.0:1788890865.601561:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa951dd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+8:6473:x1875787997250304:12345-0@lo:101: Request processed in 67us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890865.601565:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788890865.601581:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997250304:0@lo:101: 00010000:00010000:0.0:1788890865.601591:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd5282e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52835 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.601598:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd5282e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52835 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890865.601637:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997250432:0@lo:501: 00000100:00100000:0.0:1788890865.601663:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.601687:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 0000000021725c1b going to sleep for 11 seconds 00000100:00100000:3.0:1788890865.601696:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997250432 00000100:00100000:3.0:1788890865.601700:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997250432 00000100:00100000:3.0:1788890865.601715:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788890865.601719:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3426895 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+8:6473:x1875787997250432:12345-0@lo:501: 00000100:00100000:3.0:1788890865.601781:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3426895 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+9:6473:x1875787997250432:12345-0@lo:501: Request processed in 62us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890865.601784:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788890865.601809:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997250432:0@lo:501: 00000100:00100000:0.0:1788890865.601832:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997250560:0@lo:503: 00000100:00100000:0.0:1788890865.601871:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.601888:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 0000000021725c1b going to sleep for 11 seconds 00000100:00100000:1.0:1788890865.601898:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997250560 00000100:00100000:1.0:1788890865.601903:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997250560 00000100:00100000:1.0:1788890865.601929:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788890865.601934:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0de4b75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+9:6473:x1875787997250560:12345-0@lo:503: 00000100:00100000:1.0:1788890865.602051:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0de4b75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+9:6473:x1875787997250560:12345-0@lo:503: Request processed in 116us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890865.602057:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788890865.602077:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997250560:0@lo:503: 00000100:00100000:0.0:1788890865.602328:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6517:1875787997250688:0@lo:502: 00000100:00100000:0.0:1788890865.602359:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.602375:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cad48310 going to sleep for 11 seconds 00000100:00100000:3.0:1788890865.602402:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997250688 00000100:00100000:3.0:1788890865.602407:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997250688 00000100:00100000:3.0:1788890865.602436:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788890865.602442:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c5dd12d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+9:6517:x1875787997250688:12345-0@lo:502: 00000100:00100000:3.0:1788890865.602518:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c5dd12d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+9:6517:x1875787997250688:12345-0@lo:502: Request processed in 75us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890865.602544:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788890865.602548:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6517:1875787997250688:0@lo:502: 00000020:01000000:0.0:1788890865.602573:0:6517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788890865.602591:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890865.602594:0:6517:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788890865.602599:0:6517:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788890865.602602:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788890865.602620:0:6517:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000069bd7906) 00000020:00000080:0.0:1788890865.602635:0:6517:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788890865.602644:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788890865.602727:0:6517:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788890865.602734:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd52843 00000020:00000080:0.0:1788890865.602938:0:6517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788890865.602942:0:6517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788890865.602946:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890865.602947:0:6517:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788890865.602949:0:6517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788890865.602952:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890865.602953:0:6517:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788890865.602956:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788890865.602962:0:6517:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000555d10f2) 00000020:00000080:0.0:1788890865.602971:0:6517:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788890865.602974:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788890865.602975:0:6517:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788890865.602977:0:6517:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788890865.602982:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788890865.603039:0:6517:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fd706315 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788890865.603060:0:6517:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000019c6864b) 00000020:00000080:0.0:1788890865.603067:0:6517:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788890865.603151:0:6517:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788890865.603156:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd52858 00000020:00000080:0.0:1788890865.603266:0:6517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788890865.603272:0:6517:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788890865.603276:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa66601b03fd5285f 00080000:01000000:0.0:1788890865.603282:0:6517:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788890865.603284:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd52866 00080000:10000000:0.0:1788890865.603667:0:6517:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1788890865.603805:0:6517:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788890865.606930:0:6517:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1788890865.643881:0:6517:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1788890865.644117:0:6517:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1788890865.645935:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788890865.646164:0:6517:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788890865.647708:0:6517:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000007bc3ca8e) 00000020:00000080:0.0:1788890865.647737:0:6517:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788890865.647832:0:6517:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788890865.647839:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd52874 00000020:00000080:1.0:1788890865.648197:0:6517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788890865.649042:0:6517:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1788890865.650219:0:6517:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1788890865.651208:0:6517:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1788890865.652470:0:6517:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1788890865.653665:0:6517:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1788890865.654623:0:6517:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1788890865.655489:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa66601b03fd5287b 00000020:00000080:1.0:1788890865.655741:0:6517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788890865.655757:0:6517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890865.655762:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890865.655764:0:6517:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788890865.655766:0:6517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890865.655770:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890865.655771:0:6517:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788890865.655774:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788890865.655776:0:6517:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788890865.655778:0:6517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890865.655780:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890865.655781:0:6517:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788890865.655783:0:6517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890865.655788:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890865.655789:0:6517:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788890865.655792:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788890865.655824:0:6517:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788890865.655885:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000085ac0d2c pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6517:1875787997250816:0@lo:502: 00000100:00100000:1.0:1788890865.655972:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.656042:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997250816 00000100:00100000:1.0:1788890865.656044:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cf97352d going to sleep for 11 seconds 00000100:00100000:0.0:1788890865.656052:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997250816 00000100:00100000:0.0:1788890865.656099:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788890865.656109:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093962f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+9:6517:x1875787997250816:12345-0@lo:502: 00000100:00100000:0.0:1788890865.656219:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093962f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+9:6517:x1875787997250816:12345-0@lo:502: Request processed in 112us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890865.656228:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788890865.656259:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000085ac0d2c pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6517:1875787997250816:0@lo:502: 00000020:01000000:1.0:1788890865.656286:0:6517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890865.656290:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890865.656292:0:6517:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788890865.656295:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788890865.656349:0:6473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788890865.656375:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788890865.656393:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd5282e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52835 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.656405:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd5282e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52835 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890865.656414:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92509099a000 from 1 10000000:01000000:0.0:1788890865.656417:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788890865.656442:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 00000000b1794c23/0xa66601b03fd52882 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.656449:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 00000000b1794c23/0xa66601b03fd52882 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.656458:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 00000000b1794c23/0xa66601b03fd52882 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890865.656481:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997250944:0@lo:101: 00000100:00100000:0.0:1788890865.656507:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.656552:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c46b9023 going to sleep for 11 seconds 00000100:00100000:3.0:1788890865.656702:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997250944 00000100:00100000:3.0:1788890865.656707:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997250944 00000100:00100000:3.0:1788890865.656742:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788890865.656748:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef654311 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+9:6473:x1875787997250944:12345-0@lo:101: 00010000:00010000:3.0:1788890865.656756:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890865.656767:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002514ddb5/0xa66601b03fd52889 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52882 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.656787:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002514ddb5/0xa66601b03fd52889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52882 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.656796:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002514ddb5/0xa66601b03fd52889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52882 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.656804:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002514ddb5, rc 0) 00000100:00100000:3.0:1788890865.656835:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef654311 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+10:6473:x1875787997250944:12345-0@lo:101: Request processed in 88us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890865.656840:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788890865.656872:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997250944:0@lo:101: 00010000:00010000:0.0:1788890865.656884:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 00000000b1794c23/0xa66601b03fd52882 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52889 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.656892:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 00000000b1794c23/0xa66601b03fd52882 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52889 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890865.657977:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997251072:0@lo:256: 00000100:00100000:0.0:1788890865.658031:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.658058:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c46b9023 going to sleep for 11 seconds 00000100:00100000:1.0:1788890865.658064:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997251072 00000100:00100000:1.0:1788890865.658070:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997251072 00000100:00100000:1.0:1788890865.658100:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788890865.658111:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052f832b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+10:6473:x1875787997251072:12345-0@lo:256: 20000000:01000000:1.0:1788890865.658125:0:6491:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788890865.658130:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788890865.658203:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052f832b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+10:6473:x1875787997251072:12345-0@lo:256: Request processed in 95us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890865.658216:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788890865.658222:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997251072:0@lo:256: 10000000:01000000:0.0:1788890865.658784:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788890865.658798:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 00000000b1794c23/0xa66601b03fd52882 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52889 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.658806:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 00000000b1794c23/0xa66601b03fd52882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52889 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890865.658813:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92509099a000 from 1 10000000:01000000:0.0:1788890865.658816:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788890865.658835:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 0000000079a8404b/0xa66601b03fd52890 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.658842:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 0000000079a8404b/0xa66601b03fd52890 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.658855:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 0000000079a8404b/0xa66601b03fd52890 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890865.658866:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997251200:0@lo:101: 00000100:00100000:0.0:1788890865.658890:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.658911:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c46b9023 going to sleep for 11 seconds 00000100:00100000:3.0:1788890865.658925:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997251200 00000100:00100000:3.0:1788890865.658931:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997251200 00000100:00100000:3.0:1788890865.658957:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788890865.658963:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fa264bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+10:6473:x1875787997251200:12345-0@lo:101: 00010000:00010000:3.0:1788890865.658972:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890865.658991:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000084af974a/0xa66601b03fd52897 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52890 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.659007:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000084af974a/0xa66601b03fd52897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52890 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.659027:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000084af974a/0xa66601b03fd52897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52890 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.659035:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000084af974a, rc 0) 00000100:00100000:3.0:1788890865.659066:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fa264bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+11:6473:x1875787997251200:12345-0@lo:101: Request processed in 104us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890865.659072:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788890865.659096:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997251200:0@lo:101: 00010000:00010000:0.0:1788890865.659108:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 0000000079a8404b/0xa66601b03fd52890 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52897 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.659115:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 0000000079a8404b/0xa66601b03fd52890 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52897 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890865.659156:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997251328:0@lo:501: 00000100:00100000:0.0:1788890865.659178:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.659193:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c46b9023 going to sleep for 11 seconds 00000100:00100000:1.0:1788890865.659214:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997251328 00000100:00100000:1.0:1788890865.659219:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997251328 00000100:00100000:1.0:1788890865.659244:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788890865.659250:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b11df75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+11:6473:x1875787997251328:12345-0@lo:501: 00000100:00100000:1.0:1788890865.659403:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b11df75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+11:6473:x1875787997251328:12345-0@lo:501: Request processed in 153us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890865.659410:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788890865.659432:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997251328:0@lo:501: 00000100:00100000:0.0:1788890865.659457:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997251456:0@lo:503: 00000100:00100000:0.0:1788890865.659490:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.659505:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c46b9023 going to sleep for 11 seconds 00000100:00100000:3.0:1788890865.659539:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997251456 00000100:00100000:3.0:1788890865.659543:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997251456 00000100:00100000:3.0:1788890865.659563:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788890865.659567:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001885f11f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+11:6473:x1875787997251456:12345-0@lo:503: 00000040:00080000:3.0:1788890865.659591:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788890865.659639:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001885f11f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+11:6473:x1875787997251456:12345-0@lo:503: Request processed in 72us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890865.659643:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788890865.659668:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997251456:0@lo:503: 00000040:00080000:1.0:1788890865.660441:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788890865.660509:0:6473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788890865.660554:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788890865.660566:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 0000000079a8404b/0xa66601b03fd52890 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52897 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.660585:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 0000000079a8404b/0xa66601b03fd52890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52897 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890865.660631:0:6473:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788890865.660634:0:6473:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92509099a000 10000000:01000000:0.0:1788890865.660637:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92509099a000 10000000:01000000:0.0:1788890865.660641:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788890865.660646:0:6473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92509099a000 from 1 10000000:01000000:0.0:1788890865.660648:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788890865.660662:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 00000000e7c87a7f/0xa66601b03fd5289e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.660669:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 00000000e7c87a7f/0xa66601b03fd5289e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.660676:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 00000000e7c87a7f/0xa66601b03fd5289e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890865.660687:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997251584:0@lo:101: 00000100:00100000:0.0:1788890865.660713:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.660736:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c46b9023 going to sleep for 11 seconds 00000100:00100000:1.0:1788890865.660759:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997251584 00000100:00100000:1.0:1788890865.660764:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997251584 00000100:00100000:1.0:1788890865.660791:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788890865.660799:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003daa878a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+11:6473:x1875787997251584:12345-0@lo:101: 00010000:00010000:1.0:1788890865.660807:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890865.660815:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000075255a7f/0xa66601b03fd528a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd5289e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.660829:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000075255a7f/0xa66601b03fd528a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd5289e expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.660837:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000075255a7f/0xa66601b03fd528a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd5289e expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.660844:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000075255a7f, rc 0) 00000100:00100000:1.0:1788890865.660878:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003daa878a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6473:x1875787997251584:12345-0@lo:101: Request processed in 80us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890865.660885:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788890865.660894:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997251584:0@lo:101: 00010000:00010000:0.0:1788890865.660906:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 00000000e7c87a7f/0xa66601b03fd5289e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd528a5 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.660913:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 00000000e7c87a7f/0xa66601b03fd5289e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd528a5 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890865.660958:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997251712:0@lo:501: 00000100:00100000:0.0:1788890865.660981:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.660999:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c46b9023 going to sleep for 11 seconds 00000100:00100000:3.0:1788890865.661027:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997251712 00000100:00100000:3.0:1788890865.661031:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997251712 00000100:00100000:3.0:1788890865.661051:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788890865.661056:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057245116 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6473:x1875787997251712:12345-0@lo:501: 00000100:00100000:3.0:1788890865.661115:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057245116 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6473:x1875787997251712:12345-0@lo:501: Request processed in 60us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890865.661123:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788890865.661133:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997251712:0@lo:501: 00000100:00100000:0.0:1788890865.661160:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997251840:0@lo:503: 00000100:00100000:0.0:1788890865.661189:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.661203:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c46b9023 going to sleep for 11 seconds 00000100:00100000:1.0:1788890865.661223:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997251840 00000100:00100000:1.0:1788890865.661233:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997251840 00000100:00100000:1.0:1788890865.661257:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788890865.661263:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee7f6b04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6473:x1875787997251840:12345-0@lo:503: 00000100:00100000:1.0:1788890865.661331:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee7f6b04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6473:x1875787997251840:12345-0@lo:503: Request processed in 67us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890865.661338:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788890865.661348:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997251840:0@lo:503: 00000100:00100000:0.0:1788890865.661588:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6522:1875787997251968:0@lo:502: 00000100:00100000:0.0:1788890865.661619:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.661643:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ff50734a going to sleep for 11 seconds 00000100:00100000:3.0:1788890865.661652:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997251968 00000100:00100000:3.0:1788890865.661660:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997251968 00000100:00100000:3.0:1788890865.661678:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788890865.661682:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3120a9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6522:x1875787997251968:12345-0@lo:502: 00000100:00100000:3.0:1788890865.661749:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3120a9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6522:x1875787997251968:12345-0@lo:502: Request processed in 66us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890865.661756:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788890865.661766:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6522:1875787997251968:0@lo:502: 00000020:01000004:0.0:1788890865.661817:0:6522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788890865.661837:0:6522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000af4d95b8) 00000020:00000080:0.0:1788890865.661852:0:6522:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788890865.661932:0:6522:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fd706315 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788890865.661936:0:6522:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000fd706315 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788890865.661938:0:6522:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000fd706315 4 00010000:00080000:0.0:1788890865.661964:0:6522:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000bf497511@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:0.0:1788890865.663469:0:6522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788890865.663662:0:6522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788890865.663687:0:6522:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788890865.663696:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa66601b03fd528b3 00000100:00080000:0.0:1788890865.663703:0:6522:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788890865.663708:0:6522:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000bf497511 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788890865.663737:0:6522:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fa8318d8 x1875787997252096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788890865.663760:0:6522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788890865.663802:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875787997252096:0@lo:38: 00000100:00100000:3.0:1788890865.663855:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890865.663906:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997252096 00000100:00100000:1.0:1788890865.663912:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997252096 00000100:00100000:1.0:1788890865.663940:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788890865.663947:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b174df5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1875787997252096:12345-0@lo:38: 00000100:00100000:1.0:1788890865.664005:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b174df5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1875787997252096:12345-0@lo:38: Request processed in 57us (149us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788890865.664025:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788890865.664051:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788890865.664058:0:3626:0:(import.c:65:import_set_state_nolock()) 00000000bf497511 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788890865.664063:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788890865.664067:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa8318d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875787997252096:0@lo:38: 00000100:00100000:3.0:1788890865.664180:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000da8cea54 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6522:1875787997252224:0@lo:502: 00000100:00100000:3.0:1788890865.664216:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890865.664236:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dba6da5e going to sleep for 11 seconds 00000100:00100000:1.0:1788890865.664258:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997252224 00000100:00100000:1.0:1788890865.664262:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997252224 00000100:00100000:1.0:1788890865.664298:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788890865.664308:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f9486cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6522:x1875787997252224:12345-0@lo:502: 00000100:00100000:1.0:1788890865.664394:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f9486cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6522:x1875787997252224:12345-0@lo:502: Request processed in 90us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890865.664399:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788890865.664421:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000da8cea54 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6522:1875787997252224:0@lo:502: 00000040:00080000:3.0:1788890865.664443:0:6522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788890865.664485:0:6473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788890865.664516:0:6473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788890865.664562:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 00000000e7c87a7f/0xa66601b03fd5289e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd528a5 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.664571:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 00000000e7c87a7f/0xa66601b03fd5289e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd528a5 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788890865.664618:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788890865.664627:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788890865.664628:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788890865.664630:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788890865.664631:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788890865.664633:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788890865.664634:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788890865.664635:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788890865.664636:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788890865.664637:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788890865.664638:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788890865.664639:0:6473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788890865.664642:0:6473:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788890865.664644:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788890865.664645:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788890865.664646:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788890865.664647:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788890865.664648:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788890865.664649:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788890865.664650:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788890865.664650:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788890865.664651:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788890865.664652:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788890865.664653:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788890865.664654:0:6473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788890865.664671:0:6473:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788890865.664680:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000085ac0d2c pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997252352:0@lo:253: 00000100:00100000:1.0:1788890865.664717:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890865.664743:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac23fd26 going to sleep for 11 seconds 00000100:00100000:3.0:1788890865.664757:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997252352 00000100:00100000:3.0:1788890865.664761:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997252352 00000100:00100000:3.0:1788890865.664791:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788890865.664798:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c3ca766 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6473:x1875787997252352:12345-0@lo:253: 20000000:01000000:3.0:1788890865.664818:0:6488:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788890865.664832:0:6488:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788890865.667346:0:6488:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788890865.667363:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788890865.667390:0:6511:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788890865.667396:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788890865.667414:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004a04e700/0xa66601b03fd528ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.667428:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002514ddb5/0xa66601b03fd52889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52882 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.667436:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004a04e700/0xa66601b03fd528ba lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.667468:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002514ddb5/0xa66601b03fd52889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52882 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.667484:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002514ddb5/0xa66601b03fd52889 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52882 expref: 12 pid: 6488 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890865.667495:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ce33c31f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6511:1875787997252480:0@lo:104: 00000100:00100000:1.0:1788890865.667562:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890865.667601:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997252480 00000100:00100000:1.0:1788890865.667606:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 000000001f63fbc7 going to sleep for 11 seconds 00000100:00100000:2.0:1788890865.667610:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997252480 00000100:00100000:3.0:1788890865.667616:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c3ca766 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6473:x1875787997252352:12345-0@lo:253: Request processed in 2817us (2894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890865.667627:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788890865.667662:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000085ac0d2c pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6473:1875787997252352:0@lo:253: 00000100:00100000:2.0:1788890865.667680:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 10000000:01000000:1.0:1788890865.667683:0:6473:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788890865.667688:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788890865.667691:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000100:00100000:2.0:1788890865.667692:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f26b12b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:6511:x1875787997252480:12345-0@lo:104: 00000020:01000004:1.0:1788890865.667695:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788890865.667701:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788890865.667704:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788890865.667706:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788890865.667709:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00010000:00010000:2.0:1788890865.667712:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: 00000000b1794c23/0xa66601b03fd52882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52889 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788890865.667713:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788890865.667721:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788890865.667727:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788890865.667731:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788890865.667733:0:6473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788890865.667747:0:6473:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788890865.667812:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788890865.667818:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f26b12b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:6511:x1875787997252480:12345-0@lo:104: Request processed in 130us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890865.667823:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ce33c31f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6511:1875787997252480:0@lo:104: 00000100:00100000:2.0:1788890865.667831:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788890865.667846:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004a04e700/0xa66601b03fd528ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.667859:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788890865.667865:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: 00000000b1794c23/0xa66601b03fd52882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52889 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.667873:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b1794c23 already unused, calling callback (00000000ac895f00) 10000000:00010000:2.0:1788890865.667876:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: 00000000b1794c23/0xa66601b03fd52882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52889 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.667881:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: 00000000b1794c23/0xa66601b03fd52882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52889 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890865.667886:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: 00000000b1794c23/0xa66601b03fd52882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52889 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890865.667890:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890865.667928:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: 00000000b1794c23/0xa66601b03fd52882 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52889 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.667933:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890865.667958:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: 00000000b1794c23/0xa66601b03fd52882 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52889 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.667963:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: 00000000b1794c23/0xa66601b03fd52882 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52889 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.667983:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890865.667984:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890865.667985:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890865.668142:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4b6c5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997252608:0@lo:103: 00000100:00100000:3.0:1788890865.668177:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890865.668235:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997252608 00000100:00100000:2.0:1788890865.668242:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997252608 00010000:00010000:2.0:1788890865.668266:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002514ddb5/0xa66601b03fd52889 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52882 expref: 12 pid: 6488 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890865.668293:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788890865.668304:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da8cea54 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:3628:x1875787997252608:12345-0@lo:103: 00010000:00010000:2.0:1788890865.668317:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890865.668324:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002514ddb5/0xa66601b03fd52889 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52882 expref: 12 pid: 6488 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.668338:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002514ddb5/0xa66601b03fd52889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52882 expref: 12 pid: 6488 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.668356:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002514ddb5/0xa66601b03fd52889 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52882 expref: 12 pid: 6488 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.668374:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004a04e700/0xa66601b03fd528ba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.668382:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a04e700/0xa66601b03fd528ba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788890865.668407:0:6481:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001011091s 00010000:00010000:2.0:1788890865.668410:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004a04e700/0xa66601b03fd528ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.668416:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004a04e700/0xa66601b03fd528ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.668421:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004a04e700/0xa66601b03fd528ba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.668425:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004a04e700/0xa66601b03fd528ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.668429:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004a04e700 already unused, calling callback (0000000070d43ab9) 00010000:00010000:2.0:1788890865.668432:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004a04e700/0xa66601b03fd528ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.668435:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004a04e700/0xa66601b03fd528ba lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.668451:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004a04e700/0xa66601b03fd528ba lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.668460:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788890865.668488:0:6511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004a04e700/0xa66601b03fd528ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.668499:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004a04e700/0xa66601b03fd528ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890865.668500:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da8cea54 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+11:3628:x1875787997252608:12345-0@lo:103: Request processed in 200us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890865.668513:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788890865.668514:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004a04e700/0xa66601b03fd528ba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890865.668595:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4b6c5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997252608:0@lo:103: 00080000:10000000:1.0:1788890865.670859:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1788890865.670993:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788890865.671191:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1788890865.671314:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788890865.671472:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1788890865.671684:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788890865.672181:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1788890865.672319:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788890865.672441:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1788890865.672641:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788890865.672821:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1788890865.672924:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1788890865.674210:0:6473:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788890865.678263:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788890865.678264:0:6527:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788890865.678271:0:6527:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788890865.678460:0:6528:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:00080000:1.0:1788890865.679563:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788890865.679733:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788890865.680133:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788890865.680451:0:6473:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788890865.680457:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788890865.680550:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788890865.685366:0:6473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788890865.688711:0:6473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788890865.688778:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788890865.688967:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788890865.689175:0:6473:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:1.0:1788890865.689501:0:6528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788890865.689569:0:6528:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788890865.689572:0:6528:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1788890865.689767:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788890865.689860:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788890865.689954:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788890865.690046:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788890865.690126:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788890865.690218:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788890865.690306:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788890865.690384:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788890865.690461:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788890865.690565:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788890865.690658:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788890865.690766:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788890865.690856:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788890865.690957:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788890865.691068:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788890865.691177:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788890865.691382:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788890865.691476:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788890865.691619:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788890865.691734:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788890865.691874:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788890865.692033:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788890865.692167:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788890865.692299:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788890865.692418:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788890865.692570:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788890865.692708:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788890865.692824:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788890865.692968:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788890865.693122:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788890865.693252:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788890865.693398:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788890865.693639:0:6473:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788890865.695261:0:6473:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788890865.695282:0:6473:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbbfc41c87988 00100000:10000000:2.0:1788890865.695287:0:6473:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788890865.695636:0:6473:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788890865.695651:0:6473:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788890865.695667:0:6473:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788890865.695682:0:6473:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788890865.696498:0:6473:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788890865.696705:0:6473:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788890866.619654:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788890866.965939:0:6773:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1788890867.323497:0:6825:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788890867.323928:0:6825:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788890867.644745:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890868.667608:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788890869.033400:0:6926:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788890869.033737:0:6926:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788890869.691678:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890870.715636:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788890870.912491:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788890870.912503:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788890870.912507:0:467:0:(import.c:65:import_set_state_nolock()) 00000000bf497511 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788890870.912536:0:467:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000bf497511 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788890870.912566:0:467:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d38f84a4 x1875787997252864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788890870.912604:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788890870.912609:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d38f84a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875787997252864:0@lo:38: 00000100:00100000:3.0:1788890870.912617:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4b6c5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997252736:0@lo:400: 00000100:00100000:2.0:1788890870.914389:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890870.914497:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997252864 00000100:00100000:1.0:1788890870.914506:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997252864 00000100:00100000:1.0:1788890870.914571:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788890870.914580:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b17a900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875787997252864:12345-0@lo:38: 00010000:00080000:1.0:1788890870.914611:0:6497:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 93 last 0 00000020:00000080:1.0:1788890870.914646:0:6497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa66601b03fd528c1 00000004:00100000:1.0:1788890870.914688:0:6497:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788890870.914800:0:6497:0:(import.c:65:import_set_state_nolock()) 00000000819f53a4 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788890870.914859:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b17a900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875787997252864:12345-0@lo:38: Request processed in 278us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890870.914866:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788890870.914994:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d38f84a4 x1875787997252864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788890880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788890870.915010:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788890870.915017:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788890870.915021:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788890870.915023:0:3626:0:(import.c:65:import_set_state_nolock()) 00000000bf497511 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788890870.915029:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d38f84a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875787997252864:0@lo:38: 00000100:00100000:3.0:1788890870.915963:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890870.915998:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997252736 00000100:00100000:1.0:1788890870.916003:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997252736 00000100:00100000:1.0:1788890870.916098:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788890870.916103:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086c91bdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+11:3630:x1875787997252736:12345-0@lo:400: 00000100:00100000:1.0:1788890870.916152:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086c91bdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+11:3630:x1875787997252736:12345-0@lo:400: Request processed in 50us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890870.916158:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788890870.916235:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4b6c5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997252736:0@lo:400: 10000000:01000000:3.0:1788890871.420240:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788890871.420248:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92509099a000 from 3 10000000:01000000:3.0:1788890871.420253:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788890871.420306:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 0000000098c09ad8/0xa66601b03fd528c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890871.420320:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 0000000098c09ad8/0xa66601b03fd528c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890871.420332:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 0000000098c09ad8/0xa66601b03fd528c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890871.420372:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025133915 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997252992:0@lo:101: 00000100:00100000:3.0:1788890871.420447:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890871.420548:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000003dbe80b3 going to sleep for 11 seconds 00000100:00100000:1.0:1788890871.420635:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997252992 00000100:00100000:1.0:1788890871.420645:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997252992 00000100:00100000:1.0:1788890871.420697:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788890871.420707:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004508992d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+11:6493:x1875787997252992:12345-0@lo:101: 00010000:00010000:1.0:1788890871.420727:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890871.420741:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004a04e700/0xa66601b03fd528cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd528c8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890871.420767:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a04e700/0xa66601b03fd528cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd528c8 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890871.420779:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004a04e700/0xa66601b03fd528cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd528c8 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890871.420789:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004a04e700, rc 0) 00000100:00100000:1.0:1788890871.420958:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004508992d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6493:x1875787997252992:12345-0@lo:101: Request processed in 253us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890871.420967:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788890871.421038:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025133915 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997252992:0@lo:101: 00010000:00010000:3.0:1788890871.421053:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 0000000098c09ad8/0xa66601b03fd528c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd528cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890871.421062:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 0000000098c09ad8/0xa66601b03fd528c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd528cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890871.421107:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025133915 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997253120:0@lo:256: 00000100:00100000:3.0:1788890871.421137:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890871.421200:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000003dbe80b3 going to sleep for 11 seconds 00000100:00100000:1.0:1788890871.421236:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997253120 00000100:00100000:1.0:1788890871.421240:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997253120 00000100:00100000:1.0:1788890871.421272:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788890871.421279:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2e28e57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6493:x1875787997253120:12345-0@lo:256: 20000000:01000000:1.0:1788890871.421292:0:6491:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788890871.421307:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788890871.421310:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788890871.421408:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2e28e57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6493:x1875787997253120:12345-0@lo:256: Request processed in 129us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890871.421417:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788890871.421426:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025133915 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997253120:0@lo:256: 10000000:01000000:3.0:1788890871.421459:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788890871.421463:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 0000000098c09ad8/0xa66601b03fd528c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd528cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890871.421468:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 0000000098c09ad8/0xa66601b03fd528c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd528cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890871.740615:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890872.764655:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890873.787691:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788890874.117209:0:7424:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788890874.117215:0:7424:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788890874.117217:0:7424:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788890874.117369:0:7424:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006ea6cf1e 00000020:01000004:1.0:1788890874.117390:0:7424:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1788890874.117404:0:7424:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788890874.117424:0:7424:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000b414b473) 00000020:00000080:1.0:1788890874.117441:0:7424:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788890874.171490:0:7424:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1788890874.171580:0:7424:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1788890874.185429:0:7424:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788890874.185832:0:7424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1788890874.185843:0:7424:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788890874.185867:0:7424:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa66601b03fd528dd 00000020:01000004:1.0:1788890874.185874:0:7424:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788890874.185898:0:7424:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788890874.185901:0:7424:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788890874.185908:0:7424:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1788890874.185937:0:7424:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1788890874.185941:0:7424:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788890874.203001:0:7424:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788890874.203110:0:7424:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.126@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1788890874.203115:0:7424:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788890874.203117:0:7424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788890874.203118:0:7424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788890874.203119:0:7424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788890874.203121:0:7424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788890874.203122:0:7424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788890874.203124:0:7424:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788890874.203125:0:7424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788890874.203127:0:7424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788890874.203128:0:7424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788890874.203129:0:7424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788890874.203132:0:7424:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1788890874.203135:0:7424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788890874.203136:0:7424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788890874.203137:0:7424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788890874.203138:0:7424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788890874.203139:0:7424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788890874.203140:0:7424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788890874.203141:0:7424:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788890874.203142:0:7424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788890874.203147:0:7424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788890874.203148:0:7424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788890874.203149:0:7424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788890874.203174:0:7424:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788890874.203190:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000085ac0d2c pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997253248:0@lo:253: 00000100:00100000:1.0:1788890874.203258:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890874.203364:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3c7207b going to sleep for 11 seconds 00000100:00100000:3.0:1788890874.203409:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997253248 00000100:00100000:3.0:1788890874.203416:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997253248 00000100:00100000:3.0:1788890874.203461:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788890874.203468:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067c5b456 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:7424:x1875787997253248:12345-0@lo:253: 20000000:01000000:3.0:1788890874.203739:0:6488:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788890874.203744:0:6488:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1788890874.203749:0:6488:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1788890874.203752:0:6488:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1788890874.203782:0:6488:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1788890874.203961:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788890874.206354:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788890874.206379:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788890874.206405:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788890874.206421:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788890874.206434:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788890874.206618:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1788890874.206628:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1788890874.206640:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1788890874.206647:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1788890874.206659:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1788890874.206663:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1788890874.206674:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788890874.206685:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788890874.206794:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1788890874.206803:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:3.0:1788890874.206815:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1788890874.206820:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788890874.206841:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1788890874.206860:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:3.0:1788890874.206874:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1788890874.206880:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788890874.206892:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788890874.206907:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788890874.206918:0:6488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788890874.207002:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1788890874.207011:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1788890874.207096:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788890874.207114:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788890874.207127:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1788890874.207132:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1788890874.207142:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788890874.207158:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788890874.207163:0:6488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1788890874.207181:0:6488:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788890874.207188:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1788890874.207709:0:7430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788890874.207937:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788890874.207957:0:6488:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.126@tcp for mdt 20000000:01000000:3.0:1788890874.207959:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:3.0:1788890874.207973:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788890874.207979:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788890874.207990:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788890874.207996:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:3.0:1788890874.208012:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788890874.208085:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1788890874.208105:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1788890874.208124:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1788890874.208163:0:6488:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1788890874.208171:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1788890874.208430:0:7431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1788890874.208884:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788890874.208898:0:6488:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.204.126@tcp for mdt 20000000:01000000:3.0:1788890874.208900:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:3.0:1788890874.208913:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788890874.208918:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788890874.208930:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788890874.208945:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:3.0:1788890874.208961:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788890874.208968:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1788890874.208982:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788890874.208997:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1788890874.209015:0:6488:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788890874.209081:0:6488:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788890874.209085:0:6488:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788890874.209140:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788890874.209142:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788890874.209383:0:7432:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788890874.209400:0:7432:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788890874.209412:0:7432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788890874.209682:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1788890874.209699:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1788890874.209711:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1788890874.209718:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788890874.209720:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788890874.210012:0:7433:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788890874.210098:0:7433:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788890874.210114:0:7433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1788890874.210250:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788890874.210266:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788890874.210279:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1788890874.210286:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788890874.210288:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788890874.210649:0:7434:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788890874.210665:0:7434:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788890874.210676:0:7434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788890874.210799:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788890874.210819:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788890874.210840:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788890874.210882:0:6488:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788890874.210885:0:6488:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788890874.210889:0:6488:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788890874.210895:0:6488:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788890874.211248:0:7435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1788890874.211345:0:6488:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788890874.218332:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788890874.218363:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000016d09a5d/0xa66601b03fd528e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.218388:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000072089ddc/0xa66601b03fd52819 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52812 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.218396:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006c577d0d/0xa66601b03fd52835 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd5282e expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.218402:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000075255a7f/0xa66601b03fd528a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd5289e expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.218409:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000016d09a5d/0xa66601b03fd528e4 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.218447:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000075255a7f/0xa66601b03fd528a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd5289e expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.218461:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000075255a7f/0xa66601b03fd528a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd5289e expref: 12 pid: 6491 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890874.218475:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025133915 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875787997253376:0@lo:104: 00000100:00100000:3.0:1788890874.218768:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788890874.218831:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006c577d0d/0xa66601b03fd52835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd5282e expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.218841:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006c577d0d/0xa66601b03fd52835 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd5282e expref: 12 pid: 6491 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890874.218864:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000039254a0c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875787997253504:0@lo:104: 00000100:00100000:3.0:1788890874.218890:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788890874.218931:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000072089ddc/0xa66601b03fd52819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52812 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.218949:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000072089ddc/0xa66601b03fd52819 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52812 expref: 12 pid: 6488 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890874.218959:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000866a947f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875787997253632:0@lo:104: 00000100:00100000:3.0:1788890874.218985:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890874.218998:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a040b056 going to sleep for 11 seconds 00000100:00100000:2.0:1788890874.219110:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997253376 00000100:00100000:2.0:1788890874.219118:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997253376 00000100:00100000:0.0:1788890874.219150:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997253504 00000100:00100000:2.0:1788890874.219157:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997253632 00000100:00100000:0.0:1788890874.219159:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997253504 00000100:00100000:2.0:1788890874.219168:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997253632 00000100:00100000:2.0:1788890874.219198:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788890874.219207:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000babd5ce8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+5:6488:x1875787997253376:12345-0@lo:104: 00010000:00010000:2.0:1788890874.219430:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: 00000000e7c87a7f/0xa66601b03fd5289e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd528a5 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.219501:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788890874.219506:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000babd5ce8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+5:6488:x1875787997253376:12345-0@lo:104: Request processed in 301us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890874.219513:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788890874.219636:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788890874.219643:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: 00000000e7c87a7f/0xa66601b03fd5289e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd528a5 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.219652:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e7c87a7f already unused, calling callback (00000000ac895f00) 10000000:00010000:1.0:1788890874.219656:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: 00000000e7c87a7f/0xa66601b03fd5289e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd528a5 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.219664:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: 00000000e7c87a7f/0xa66601b03fd5289e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd528a5 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788890874.219671:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: 00000000e7c87a7f/0xa66601b03fd5289e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd528a5 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890874.219677:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788890874.219709:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: 00000000e7c87a7f/0xa66601b03fd5289e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd528a5 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.219716:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788890874.219734:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: 00000000e7c87a7f/0xa66601b03fd5289e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd528a5 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.219740:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: 00000000e7c87a7f/0xa66601b03fd5289e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd528a5 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.219768:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890874.219770:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890874.219773:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890874.220403:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788890874.220410:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af2c4492 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997253760:0@lo:103: 00000100:00100000:2.0:1788890874.220414:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ab3c1f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:6488:x1875787997253504:12345-0@lo:104: 00010000:00010000:2.0:1788890874.220425:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd5282e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52835 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890874.220457:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788890874.220493:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788890874.220500:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ab3c1f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:6488:x1875787997253504:12345-0@lo:104: Request processed in 90us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890874.220506:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788890874.220538:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788890874.220544:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000040570c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:6488:x1875787997253632:12345-0@lo:104: 00010000:00010000:2.0:1788890874.220550:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52819 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.220583:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788890874.220587:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000040570c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:6488:x1875787997253632:12345-0@lo:104: Request processed in 46us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890874.220593:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788890874.220595:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788890874.220601:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd5282e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52835 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.220609:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a85a8e8f already unused, calling callback (00000000ac895f00) 00000100:00100000:0.0:1788890874.220611:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997253760 10000000:00010000:1.0:1788890874.220612:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd5282e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52835 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890874.220617:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997253760 00010000:00010000:1.0:1788890874.220623:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd5282e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52835 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788890874.220630:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd5282e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52835 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890874.220635:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788890874.220639:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000075255a7f/0xa66601b03fd528a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd5289e expref: 13 pid: 6491 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.220658:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd5282e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52835 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.220666:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788890874.220676:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788890874.220684:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd5282e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52835 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890874.220684:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086ea71b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:3630:x1875787997253760:12345-0@lo:103: 00010000:00010000:1.0:1788890874.220696:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd5282e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52835 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.220701:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890874.220707:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000075255a7f/0xa66601b03fd528a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd5289e expref: 13 pid: 6491 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.220708:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788890874.220719:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52819 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.220719:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000075255a7f/0xa66601b03fd528a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd5289e expref: 13 pid: 6491 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.220735:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000b97836f already unused, calling callback (00000000ac895f00) 10000000:00010000:1.0:1788890874.220738:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52819 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.220745:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52819 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.220745:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:1.0:1788890874.220753:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52819 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890874.220758:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788890874.220774:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52812 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52819 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890874.220774:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086ea71b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:3630:x1875787997253760:12345-0@lo:103: Request processed in 92us (318us total) trans 0 rc 0/0 00010000:00010000:1.0:1788890874.220787:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788890874.220788:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788890874.220794:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52812 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52819 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.220802:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52812 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52819 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.220816:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890874.220817:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890874.220819:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890874.220834:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000877441c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997253888:0@lo:103: 00010000:00010000:2.0:1788890874.220935:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000075255a7f/0xa66601b03fd528a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd5289e expref: 12 pid: 6491 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890874.220949:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025133915 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875787997253376:0@lo:104: 00000100:00100000:2.0:1788890874.220964:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000039254a0c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875787997253504:0@lo:104: 00000100:00100000:1.0:1788890874.220965:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890874.220979:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000866a947f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875787997253632:0@lo:104: 00000100:00100000:1.0:1788890874.221000:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1788890874.221009:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000016d09a5d/0xa66601b03fd528e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890874.221009:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025c3f3f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997254016:0@lo:103: 00000100:00100000:1.0:1788890874.221056:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890874.221091:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997253888 00000100:00100000:1.0:1788890874.221094:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997253888 00010000:00010000:1.0:1788890874.221107:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006c577d0d/0xa66601b03fd52835 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd5282e expref: 12 pid: 6491 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890874.221121:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997254016 00000100:00100000:1.0:1788890874.221123:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997254016 00010000:00010000:1.0:1788890874.221132:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000072089ddc/0xa66601b03fd52819 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52812 expref: 13 pid: 6488 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890874.221145:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788890874.221151:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee0207ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:3627:x1875787997253888:12345-0@lo:103: 00000100:00100000:0.0:1788890874.221154:0:6481:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788890874.221158:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788890874.221163:0:6481:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788890874.221164:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006c577d0d/0xa66601b03fd52835 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd5282e expref: 13 pid: 6491 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.221175:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006c577d0d/0xa66601b03fd52835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd5282e expref: 13 pid: 6491 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.221185:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006c577d0d/0xa66601b03fd52835 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd5282e expref: 13 pid: 6491 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.221195:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890874.221220:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee0207ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:3627:x1875787997253888:12345-0@lo:103: Request processed in 70us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890874.221227:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788890874.221257:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788890874.221266:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000303b2961 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+11:3627:x1875787997254016:12345-0@lo:103: 00010000:00010000:2.0:1788890874.221273:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890874.221276:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000072089ddc/0xa66601b03fd52819 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52812 expref: 11 pid: 6488 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.221284:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000072089ddc/0xa66601b03fd52819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52812 expref: 11 pid: 6488 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.221293:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000072089ddc/0xa66601b03fd52819 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52812 expref: 11 pid: 6488 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.221302:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000016d09a5d/0xa66601b03fd528e4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.221309:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000016d09a5d/0xa66601b03fd528e4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.221318:0:6482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000016d09a5d/0xa66601b03fd528e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890874.221323:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af2c4492 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997253760:0@lo:103: 00010000:00010000:2.0:1788890874.221338:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000016d09a5d/0xa66601b03fd528e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.221340:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890874.221344:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000016d09a5d/0xa66601b03fd528e4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.221350:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000016d09a5d/0xa66601b03fd528e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.221355:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000016d09a5d already unused, calling callback (0000000070d43ab9) 00010000:00010000:2.0:1788890874.221358:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000016d09a5d/0xa66601b03fd528e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.221364:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000016d09a5d/0xa66601b03fd528e4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890874.221367:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000877441c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997253888:0@lo:103: 00010000:00010000:2.0:1788890874.221389:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000016d09a5d/0xa66601b03fd528e4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.221399:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788890874.221423:0:6488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000016d09a5d/0xa66601b03fd528e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.221431:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000016d09a5d/0xa66601b03fd528e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890874.221433:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000303b2961 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+10:3627:x1875787997254016:12345-0@lo:103: Request processed in 168us (376us total) trans 0 rc 0/0 00010000:00010000:3.0:1788890874.221446:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000016d09a5d/0xa66601b03fd528e4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890874.221449:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 20000000:01000000:3.0:1788890874.221468:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788890874.223037:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025c3f3f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997254016:0@lo:103: 00000100:00100000:3.0:1788890874.225353:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067c5b456 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+9:7424:x1875787997253248:12345-0@lo:253: Request processed in 21878us (22088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890874.225367:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788890874.226454:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000085ac0d2c pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997253248:0@lo:253: 10000000:01000000:1.0:1788890874.226474:0:7424:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788890874.226508:0:7424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788890874.226510:0:7424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788890874.226511:0:7424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788890874.226513:0:7424:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1788890874.226514:0:7424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788890874.226515:0:7424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788890874.226516:0:7424:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788890874.226518:0:7424:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788890874.226519:0:7424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788890874.226534:0:7424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788890874.226566:0:7424:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006ea6cf1e from lustre-MDT0001 10000000:01000000:1.0:1788890874.226599:0:7424:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788890874.226601:0:7424:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788890874.226608:0:7424:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff925091ac8000 local copy 10000000:01000000:1.0:1788890874.226612:0:7424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788890874.226645:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 000000006c577d0d/0xa66601b03fd528eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.226656:0:7424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.126@tcp lock: 000000006c577d0d/0xa66601b03fd528eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.226665:0:7424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 000000006c577d0d/0xa66601b03fd528eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890874.226682:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000085ac0d2c pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997254144:0@lo:101: 00000100:00100000:1.0:1788890874.226727:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890874.226810:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3c7207b going to sleep for 11 seconds 00000100:00100000:0.0:1788890874.226816:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997254144 00000100:00100000:0.0:1788890874.226823:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997254144 00000100:00100000:0.0:1788890874.230214:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788890874.230235:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006277c0d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+9:7424:x1875787997254144:12345-0@lo:101: 00010000:00010000:0.0:1788890874.230254:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890874.230280:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000b97836f/0xa66601b03fd528f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd528eb expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.230306:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000b97836f/0xa66601b03fd528f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd528eb expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.230331:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000b97836f/0xa66601b03fd528f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd528eb expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.230340:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000b97836f, rc 0) 00000100:00100000:0.0:1788890874.230427:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006277c0d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+10:7424:x1875787997254144:12345-0@lo:101: Request processed in 203us (3700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890874.230434:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788890874.230761:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000085ac0d2c pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997254144:0@lo:101: 00010000:00010000:2.0:1788890874.230780:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 000000006c577d0d/0xa66601b03fd528eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa66601b03fd528f2 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.230790:0:7424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 000000006c577d0d/0xa66601b03fd528eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa66601b03fd528f2 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890874.230924:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d38f84a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997254272:0@lo:501: 00000100:00100000:2.0:1788890874.230958:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890874.230998:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ab3e832f going to sleep for 11 seconds 00000100:00100000:1.0:1788890874.231124:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997254272 00000100:00100000:1.0:1788890874.231131:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997254272 00000100:00100000:1.0:1788890874.231168:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788890874.231175:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df012a66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+10:7424:x1875787997254272:12345-0@lo:501: 00000100:00100000:1.0:1788890874.231244:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df012a66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+10:7424:x1875787997254272:12345-0@lo:501: Request processed in 71us (286us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788890874.231260:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788890874.231347:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d38f84a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997254272:0@lo:501: 10000000:01000000:3.0:1788890874.231360:0:7424:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788890874.231376:0:7424:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788890874.231380:0:7424:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 000000006c577d0d/0xa66601b03fd528eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa66601b03fd528f2 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.231392:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 000000006c577d0d/0xa66601b03fd528eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa66601b03fd528f2 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.231400:0:7424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: 000000006c577d0d/0xa66601b03fd528eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa66601b03fd528f2 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.231422:0:7424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788890874.231448:0:7424:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92508475e000 10000000:01000000:3.0:1788890874.231453:0:7424:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788890874.231457:0:7424:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff925091ac8000 10000000:01000000:3.0:1788890874.231459:0:7424:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788890874.231462:0:7424:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff925091ac8000 from 1 10000000:01000000:3.0:1788890874.231464:0:7424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788890874.231485:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 0000000016d09a5d/0xa66601b03fd528f9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.231492:0:7424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 0000000016d09a5d/0xa66601b03fd528f9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.231863:0:7424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 0000000016d09a5d/0xa66601b03fd528f9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890874.231878:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003cd8ed17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997254400:0@lo:101: 00000100:00100000:3.0:1788890874.231912:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890874.231939:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a34bf602 going to sleep for 11 seconds 00010000:00010000:1.0:1788890874.232031:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788890874.232037:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: 000000006c577d0d/0xa66601b03fd528eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa66601b03fd528f2 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.232045:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006c577d0d already unused, calling callback (00000000ac895f00) 10000000:00010000:1.0:1788890874.232048:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: 000000006c577d0d/0xa66601b03fd528eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa66601b03fd528f2 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.232056:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: 000000006c577d0d/0xa66601b03fd528eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xa66601b03fd528f2 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788890874.232062:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: 000000006c577d0d/0xa66601b03fd528eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xa66601b03fd528f2 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890874.232068:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788890874.232085:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: 000000006c577d0d/0xa66601b03fd528eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa66601b03fd528f2 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.232092:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788890874.232127:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1acbaf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997254528:0@lo:103: 00000100:00100000:0.0:1788890874.232156:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788890874.232197:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: 000000006c577d0d/0xa66601b03fd528eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa66601b03fd528f2 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.232204:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: 000000006c577d0d/0xa66601b03fd528eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa66601b03fd528f2 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.232220:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890874.232222:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890874.232223:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890874.232233:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997254400 00000100:00100000:1.0:1788890874.232242:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997254400 00000100:00100000:1.0:1788890874.232268:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788890874.232274:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5fb936e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+10:7424:x1875787997254400:12345-0@lo:101: 00010000:00010000:1.0:1788890874.232283:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890874.232294:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006979d03c/0xa66601b03fd52900 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd528f9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.232310:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006979d03c/0xa66601b03fd52900 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd528f9 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.232319:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006979d03c/0xa66601b03fd52900 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd528f9 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.232327:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006979d03c, rc 0) 00000100:00100000:1.0:1788890874.232356:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5fb936e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+11:7424:x1875787997254400:12345-0@lo:101: Request processed in 82us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890874.232363:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788890874.232485:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003cd8ed17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997254400:0@lo:101: 00010000:00010000:3.0:1788890874.232506:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 0000000016d09a5d/0xa66601b03fd528f9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52900 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.232545:0:7424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 0000000016d09a5d/0xa66601b03fd528f9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52900 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890874.232562:0:7424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788890874.232617:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 0000000016d09a5d/0xa66601b03fd528f9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52900 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.232625:0:7424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 0000000016d09a5d/0xa66601b03fd528f9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52900 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890874.232634:0:7424:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff92508475e000 10000000:01000000:3.0:1788890874.232638:0:7424:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788890874.232642:0:7424:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff92508475e000 from 1 10000000:01000000:3.0:1788890874.232644:0:7424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788890874.232656:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 00000000e0db4a5d/0xa66601b03fd52907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.232663:0:7424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 00000000e0db4a5d/0xa66601b03fd52907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.232669:0:7424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 00000000e0db4a5d/0xa66601b03fd52907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890874.232679:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003cd8ed17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997254656:0@lo:101: 00000100:00100000:3.0:1788890874.232702:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890874.232722:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a34bf602 going to sleep for 11 seconds 00000100:00100000:0.0:1788890874.232803:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997254528 00000100:00100000:0.0:1788890874.232808:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997254528 00000100:00100000:0.0:1788890874.232842:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788890874.232864:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa8318d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+11:3629:x1875787997254528:12345-0@lo:103: 00000100:00100000:1.0:1788890874.232866:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997254656 00000100:00100000:1.0:1788890874.232873:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997254656 00010000:00010000:0.0:1788890874.232877:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890874.232891:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000b97836f/0xa66601b03fd528f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd528eb expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890874.232900:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788890874.232903:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890874.232907:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f189b0a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+11:7424:x1875787997254656:12345-0@lo:101: 00010000:00010000:1.0:1788890874.232916:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890874.232924:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c3ccb76e/0xa66601b03fd5290e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52907 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890874.232936:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa8318d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:3629:x1875787997254528:12345-0@lo:103: Request processed in 73us (779us total) trans 0 rc 0/0 00010000:00010000:1.0:1788890874.232940:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c3ccb76e/0xa66601b03fd5290e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52907 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890874.232947:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788890874.232955:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c3ccb76e/0xa66601b03fd5290e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52907 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.232972:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c3ccb76e, rc 0) 00000100:00100000:0.0:1788890874.232974:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1acbaf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997254528:0@lo:103: 00000100:00100000:1.0:1788890874.233005:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f189b0a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+11:7424:x1875787997254656:12345-0@lo:101: Request processed in 99us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890874.233014:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788890874.233014:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003cd8ed17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997254656:0@lo:101: 00010000:00010000:0.0:1788890874.233028:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 00000000e0db4a5d/0xa66601b03fd52907 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5290e expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.233059:0:7424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 00000000e0db4a5d/0xa66601b03fd52907 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd5290e expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890874.233070:0:7424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788890874.233252:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 00000000e0db4a5d/0xa66601b03fd52907 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5290e expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.233260:0:7424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 00000000e0db4a5d/0xa66601b03fd52907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5290e expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890874.233266:0:7424:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788890874.233269:0:7424:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788890874.233274:0:7424:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff92508475e000 10000000:01000000:0.0:1788890874.233276:0:7424:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788890874.233279:0:7424:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788890874.233280:0:7424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788890874.233294:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd52915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.233300:0:7424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd52915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.233306:0:7424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd52915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890874.233316:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005bd0c09a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997254784:0@lo:101: 00000100:00100000:0.0:1788890874.233340:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890874.233363:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086ada949 going to sleep for 11 seconds 00000100:00100000:3.0:1788890874.233388:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997254784 00000100:00100000:3.0:1788890874.233393:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997254784 00000100:00100000:3.0:1788890874.233428:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788890874.233434:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4523a9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+11:7424:x1875787997254784:12345-0@lo:101: 00010000:00010000:3.0:1788890874.233440:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890874.233446:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004bd01453/0xa66601b03fd5291c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52915 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.233458:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004bd01453/0xa66601b03fd5291c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52915 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.233466:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004bd01453/0xa66601b03fd5291c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52915 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.236665:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004bd01453, rc 0) 00000100:00100000:3.0:1788890874.236753:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4523a9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:7424:x1875787997254784:12345-0@lo:101: Request processed in 3316us (3409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890874.236761:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788890874.237084:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005bd0c09a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997254784:0@lo:101: 00010000:00010000:0.0:1788890874.237106:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd52915 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5291c expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.237117:0:7424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd52915 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd5291c expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890874.237251:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005bd0c09a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997254912:0@lo:501: 00000100:00100000:0.0:1788890874.237282:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890874.237319:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086ada949 going to sleep for 11 seconds 00000100:00100000:3.0:1788890874.237734:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997254912 00000100:00100000:3.0:1788890874.237741:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997254912 00000100:00100000:3.0:1788890874.237782:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788890874.237790:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c3a43b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:7424:x1875787997254912:12345-0@lo:501: 00000100:00100000:3.0:1788890874.237910:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c3a43b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:7424:x1875787997254912:12345-0@lo:501: Request processed in 120us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890874.237917:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788890874.238057:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005bd0c09a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997254912:0@lo:501: 00000100:00100000:0.0:1788890874.238083:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005bd0c09a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997255040:0@lo:503: 00000100:00100000:0.0:1788890874.238117:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890874.238143:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086ada949 going to sleep for 11 seconds 00000100:00100000:3.0:1788890874.238187:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997255040 00000100:00100000:3.0:1788890874.238190:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997255040 00000100:00100000:3.0:1788890874.238245:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788890874.238251:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8501ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:7424:x1875787997255040:12345-0@lo:503: 00000100:00100000:3.0:1788890874.238323:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8501ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:7424:x1875787997255040:12345-0@lo:503: Request processed in 72us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890874.238336:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788890874.238391:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005bd0c09a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997255040:0@lo:503: 00000040:00080000:0.0:1788890874.238696:0:7424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788890874.238954:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005bd0c09a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997255168:0@lo:502: 00000100:00100000:0.0:1788890874.238993:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890874.239141:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086ada949 going to sleep for 11 seconds 00000100:00100000:1.0:1788890874.239171:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997255168 00000100:00100000:1.0:1788890874.239177:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997255168 00000100:00100000:1.0:1788890874.239198:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788890874.239203:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb19c532 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:7424:x1875787997255168:12345-0@lo:502: 00000100:00100000:1.0:1788890874.239295:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb19c532 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:7424:x1875787997255168:12345-0@lo:502: Request processed in 91us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890874.239302:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788890874.239370:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005bd0c09a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997255168:0@lo:502: 00000040:00080000:0.0:1788890874.239622:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788890874.239648:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1788890874.239660:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1788890874.239671:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1788890874.239682:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1788890874.239693:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1788890874.239704:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1788890874.239722:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1788890874.239743:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1788890874.239755:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1788890874.239765:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1788890874.239775:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1788890874.239786:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1788890874.239797:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1788890874.239807:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1788890874.239818:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1788890874.239829:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1788890874.239839:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1788890874.239864:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1788890874.239877:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1788890874.239888:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1788890874.239902:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1788890874.239914:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1788890874.239934:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005bd0c09a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997255296:0@lo:502: 00000100:00100000:0.0:1788890874.240747:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890874.240779:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086ada949 going to sleep for 11 seconds 00000100:00100000:1.0:1788890874.240866:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997255296 00000100:00100000:1.0:1788890874.240872:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997255296 00000100:00100000:1.0:1788890874.240914:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788890874.240921:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008fca0348 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:7424:x1875787997255296:12345-0@lo:502: 00000100:00100000:1.0:1788890874.241012:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008fca0348 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:7424:x1875787997255296:12345-0@lo:502: Request processed in 91us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890874.241019:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788890874.241088:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005bd0c09a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997255296:0@lo:502: 00000040:00080000:0.0:1788890874.241132:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1788890874.241139:0:7424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1788890874.241516:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788890874.241567:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890874.241570:0:7437:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788890874.241575:0:7437:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788890874.241578:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788890874.241592:0:7437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000073eb45c5) 00000020:00000080:0.0:1788890874.241614:0:7437:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1788890874.241620:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788890874.241697:0:7437:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788890874.241706:0:7437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa66601b03fd5292a 00000020:00000080:0.0:1788890874.241909:0:7437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788890874.241913:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788890874.241916:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890874.241918:0:7437:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788890874.241920:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788890874.241923:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890874.241925:0:7437:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788890874.241928:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788890874.241933:0:7437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000eea250bb) 00000020:00000080:0.0:1788890874.241943:0:7437:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1788890874.241946:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788890874.241947:0:7437:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788890874.241950:0:7437:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788890874.241955:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788890874.242009:0:7437:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006ea6cf1e from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788890874.242019:0:7437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000005faceef6) 00000020:00000080:0.0:1788890874.242026:0:7437:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1788890874.242079:0:7437:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788890874.242083:0:7437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd5293f 00000020:00000080:0.0:1788890874.242166:0:7437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788890874.242173:0:7437:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788890874.242177:0:7437:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xa66601b03fd52946 00080000:01000000:0.0:1788890874.242183:0:7437:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788890874.242186:0:7437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa66601b03fd5294d 00080000:10000000:0.0:1788890874.242480:0:7437:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1788890874.242637:0:7437:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1788890874.314726:0:7437:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1788890874.314968:0:7437:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1788890874.318410:0:7437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788890874.319021:0:7437:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788890874.327345:0:7437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788890874.327377:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890874.327385:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890874.327429:0:7437:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788890874.327436:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890874.327443:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890874.327444:0:7437:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788890874.327452:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788890874.327458:0:7437:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:00000080:1.0:1788890874.327497:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788890874.327513:0:7437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000007900eb56) 00000020:00000080:1.0:1788890874.327562:0:7437:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788890874.327568:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788890874.327645:0:7437:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788890874.327650:0:7437:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788890874.327656:0:7437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa66601b03fd5295b 00010000:00080000:1.0:1788890874.327686:0:7437:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005f8c433a@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1788890874.329996:0:7437:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1788890874.331470:0:7437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788890874.331485:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788890874.331630:0:7437:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788890874.331654:0:7437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd52962 00000100:00080000:1.0:1788890874.331665:0:7437:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788890874.331672:0:7437:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000005f8c433a using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788890874.331716:0:7437:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000092b06f68 x1875787997255424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788890874.331741:0:7437:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788890874.331788:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000092b06f68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997255424:0@lo:38: 00000020:01000000:1.0:1788890874.331870:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890874.331874:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890874.331876:0:7437:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788890874.331877:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788890874.331879:0:7437:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788890874.331881:0:7437:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788890874.331883:0:7437:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788890874.331884:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788890874.331886:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890874.331888:0:7437:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788890874.331890:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890874.331901:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890874.331903:0:7437:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788890874.331906:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788890874.331915:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:01000000:1.0:1788890874.331939:0:7437:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788890874.331961:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890874.331964:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890874.331966:0:7437:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788890874.331968:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890874.331970:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890874.331972:0:7437:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788890874.331975:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788890874.331977:0:7437:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788890874.332011:0:7437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890874.332014:0:7437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890874.332015:0:7437:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788890874.332017:0:7437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:1.0:1788890874.332165:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997255424 00000100:00100000:1.0:1788890874.332174:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997255424 00000020:01000000:2.0:1788890874.332182:0:7424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 00000100:00100000:1.0:1788890874.332215:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 10000000:01000000:2.0:1788890874.332225:0:7424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00000100:00100000:1.0:1788890874.332226:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d234130d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1875787997255424:12345-0@lo:38: 00010000:00010000:2.0:1788890874.332247:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd52915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5291c expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788890874.332257:0:6500:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 96 last 0 00010000:00010000:2.0:1788890874.332268:0:7424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 00000000a85a8e8f/0xa66601b03fd52915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5291c expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890874.332280:0:7424:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92508475e000 from 1 10000000:01000000:2.0:1788890874.332283:0:7424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000080:1.0:1788890874.332297:0:6500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd52969 00000004:00100000:1.0:1788890874.332317:0:6500:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00010000:2.0:1788890874.332318:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 00000000898d1c22/0xa66601b03fd52970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.332327:0:7424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 00000000898d1c22/0xa66601b03fd52970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788890874.332336:0:6500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1788890874.332341:0:7424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 00000000898d1c22/0xa66601b03fd52970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890874.332426:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd7bc831 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997255552:0@lo:101: 00000100:00100000:2.0:1788890874.332461:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890874.332484:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f662d808 going to sleep for 11 seconds 00000100:00100000:1.0:1788890874.332570:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997255552 00000100:00100000:1.0:1788890874.332576:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997255552 00000100:00100000:1.0:1788890874.332616:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788890874.332624:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000797d208 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:7424:x1875787997255552:12345-0@lo:101: 00010000:00010000:1.0:1788890874.332638:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890874.332656:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006c577d0d/0xa66601b03fd52977 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52970 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.332693:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006c577d0d/0xa66601b03fd52977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52970 expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.332705:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006c577d0d/0xa66601b03fd52977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52970 expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.332714:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006c577d0d, rc 0) 00000100:00100000:0.0:1788890874.332742:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005bd0c09a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997255680:0@lo:400: 00000100:00100000:1.0:1788890874.332913:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000797d208 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:7424:x1875787997255552:12345-0@lo:101: Request processed in 290us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890874.332918:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd7bc831 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997255552:0@lo:101: 00000100:00100000:1.0:1788890874.332941:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788890874.332946:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788890874.332954:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 00000000898d1c22/0xa66601b03fd52970 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52977 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.332968:0:7424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 00000000898d1c22/0xa66601b03fd52970 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52977 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890874.333036:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997255680 00000100:00100000:0.0:1788890874.333051:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997255680 00000100:00100000:0.0:1788890874.333083:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788890874.333089:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000198736f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997255680:12345-0@lo:400: 00000100:00100000:0.0:1788890874.333148:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000198736f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997255680:12345-0@lo:400: Request processed in 59us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890874.333167:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788890874.333243:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005bd0c09a x1875787997255680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890874.333283:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005bd0c09a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997255680:0@lo:400: 00000100:00100000:2.0:1788890874.334704:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd7bc831 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997255808:0@lo:256: 00000100:00100000:2.0:1788890874.334763:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890874.334807:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f662d808 going to sleep for 11 seconds 00000100:00100000:0.0:1788890874.335439:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997255808 00000100:00100000:0.0:1788890874.335446:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997255808 00000100:00100000:0.0:1788890874.335486:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788890874.335495:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0e91728 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:7424:x1875787997255808:12345-0@lo:256: 20000000:01000000:0.0:1788890874.338900:0:6491:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788890874.338925:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788890874.338929:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788890874.339873:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0e91728 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:7424:x1875787997255808:12345-0@lo:256: Request processed in 4375us (5105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890874.339886:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788890874.339955:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd7bc831 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997255808:0@lo:256: 10000000:01000000:0.0:1788890874.341324:0:7424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788890874.341343:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 00000000898d1c22/0xa66601b03fd52970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52977 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.341366:0:7424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 00000000898d1c22/0xa66601b03fd52970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52977 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890874.341386:0:7424:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92508475e000 from 1 10000000:01000000:0.0:1788890874.341389:0:7424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788890874.341418:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd5297e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.341426:0:7424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd5297e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.341434:0:7424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd5297e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890874.341452:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005bd0c09a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997255936:0@lo:101: 00000100:00100000:0.0:1788890874.341488:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890874.341660:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997255936 00000100:00100000:1.0:1788890874.341667:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997255936 00000100:00100000:1.0:1788890874.341708:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788890874.341715:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023d6f057 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:7424:x1875787997255936:12345-0@lo:101: 00010000:00010000:1.0:1788890874.341727:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890874.341737:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000067ed6363/0xa66601b03fd52985 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd5297e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.341757:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000067ed6363/0xa66601b03fd52985 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd5297e expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.341766:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000067ed6363/0xa66601b03fd52985 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd5297e expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.341774:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000067ed6363, rc 0) 00000100:00100000:1.0:1788890874.341798:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023d6f057 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:7424:x1875787997255936:12345-0@lo:101: Request processed in 84us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890874.341803:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788890874.342671:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 0000000051486a89 going to sleep for 11 seconds 00000100:00100000:0.0:1788890874.342688:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005bd0c09a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997255936:0@lo:101: 00010000:00010000:0.0:1788890874.342700:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd5297e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52985 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.342708:0:7424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd5297e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52985 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890874.342807:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005bd0c09a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997256064:0@lo:501: 00000100:00100000:0.0:1788890874.342833:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890874.342864:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 0000000051486a89 going to sleep for 11 seconds 00000100:00100000:3.0:1788890874.343169:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997256064 00000100:00100000:3.0:1788890874.343174:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997256064 00000100:00100000:3.0:1788890874.343214:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788890874.343220:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088b25cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:7424:x1875787997256064:12345-0@lo:501: 00000100:00100000:3.0:1788890874.343307:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088b25cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:7424:x1875787997256064:12345-0@lo:501: Request processed in 87us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890874.343313:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788890874.343611:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005bd0c09a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997256064:0@lo:501: 00000100:00100000:0.0:1788890874.343638:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005bd0c09a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997256192:0@lo:503: 00000100:00100000:0.0:1788890874.343678:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890874.343707:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 0000000051486a89 going to sleep for 11 seconds 00000100:00100000:3.0:1788890874.343797:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997256192 00000100:00100000:3.0:1788890874.343801:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997256192 00000100:00100000:3.0:1788890874.343830:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788890874.343836:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1cb795c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:7424:x1875787997256192:12345-0@lo:503: 00000040:00080000:3.0:1788890874.343879:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788890874.343922:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1cb795c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:7424:x1875787997256192:12345-0@lo:503: Request processed in 87us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890874.343929:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788890874.344004:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005bd0c09a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997256192:0@lo:503: 00000040:00080000:1.0:1788890874.344245:0:7424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788890874.344285:0:7424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1788890874.344674:0:7424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788890874.345793:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000100:00080000:2.0:1788890874.346254:0:6500:0:(import.c:65:import_set_state_nolock()) 00000000e243d8a0 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788890874.346329:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d234130d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3626:x1875787997255424:12345-0@lo:38: Request processed in 14104us (14415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890874.346343:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788890874.346725:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788890874.346734:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788890874.346742:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788890874.346747:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788890874.346750:0:3626:0:(import.c:65:import_set_state_nolock()) 000000005f8c433a lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788890874.346769:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000092b06f68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997255424:0@lo:38: 00000100:00100000:1.0:1788890874.346872:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788890874.346880:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017e07564 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997256320:0@lo:41: 00000100:00100000:1.0:1788890874.346913:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890874.346950:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997256320 00000100:00100000:1.0:1788890874.346955:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997256320 00000100:00100000:1.0:1788890874.346983:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788890874.346990:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014ef276c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3628:x1875787997256320:12345-0@lo:41: 00000004:00000024:1.0:1788890874.347022:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788890874.347052:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014ef276c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3628:x1875787997256320:12345-0@lo:41: Request processed in 63us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890874.347068:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788890874.347096:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017e07564 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997256320:0@lo:41: 00000020:01000000:3.0:1788890874.347677:0:7424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788890874.347715:0:7424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788890874.347827:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd5297e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52985 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.347838:0:7424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd5297e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52985 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890874.347905:0:7424:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788890874.347908:0:7424:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92508475e000 10000000:01000000:3.0:1788890874.347911:0:7424:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92508475e000 10000000:01000000:3.0:1788890874.347914:0:7424:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788890874.347928:0:7424:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92508475e000 from 1 10000000:01000000:3.0:1788890874.347931:0:7424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788890874.347957:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 00000000c4f83e64/0xa66601b03fd5298c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.347965:0:7424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 00000000c4f83e64/0xa66601b03fd5298c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.347973:0:7424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 00000000c4f83e64/0xa66601b03fd5298c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890874.347987:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001d13fbc5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997256448:0@lo:101: 00000100:00100000:3.0:1788890874.348033:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890874.348070:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d8242749 going to sleep for 11 seconds 00000100:00100000:1.0:1788890874.348209:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997256448 00000100:00100000:1.0:1788890874.348214:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997256448 00000100:00100000:1.0:1788890874.348247:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788890874.348254:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f11f42c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:7424:x1875787997256448:12345-0@lo:101: 00010000:00010000:1.0:1788890874.348264:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890874.348275:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000da6f0d15/0xa66601b03fd52993 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd5298c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.348294:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000da6f0d15/0xa66601b03fd52993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd5298c expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.348314:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000da6f0d15/0xa66601b03fd52993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd5298c expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890874.348322:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000da6f0d15, rc 0) 00000100:00100000:1.0:1788890874.348367:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f11f42c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:7424:x1875787997256448:12345-0@lo:101: Request processed in 114us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890874.348373:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788890874.348551:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001d13fbc5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997256448:0@lo:101: 00010000:00010000:2.0:1788890874.348566:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 00000000c4f83e64/0xa66601b03fd5298c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52993 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.348574:0:7424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 00000000c4f83e64/0xa66601b03fd5298c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52993 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890874.348679:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fbec0de pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997256576:0@lo:501: 00000100:00100000:2.0:1788890874.348710:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890874.348734:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f662d808 going to sleep for 11 seconds 00000100:00100000:1.0:1788890874.348885:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997256576 00000100:00100000:1.0:1788890874.348891:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997256576 00000100:00100000:1.0:1788890874.348929:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788890874.348936:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008094096c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:7424:x1875787997256576:12345-0@lo:501: 00000100:00100000:1.0:1788890874.349045:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008094096c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:7424:x1875787997256576:12345-0@lo:501: Request processed in 109us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890874.349051:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788890874.349240:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fbec0de pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997256576:0@lo:501: 00000100:00100000:2.0:1788890874.349264:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fbec0de pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997256704:0@lo:503: 00000100:00100000:2.0:1788890874.349298:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890874.349326:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f662d808 going to sleep for 11 seconds 00000100:00100000:3.0:1788890874.349449:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997256704 00000100:00100000:3.0:1788890874.349453:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997256704 00000100:00100000:3.0:1788890874.349484:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788890874.349490:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f540e3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:7424:x1875787997256704:12345-0@lo:503: 00000100:00100000:3.0:1788890874.349595:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f540e3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:7424:x1875787997256704:12345-0@lo:503: Request processed in 106us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890874.349602:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788890874.349637:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fbec0de pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997256704:0@lo:503: 00000040:00080000:3.0:1788890874.349960:0:7424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788890874.350140:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035a09397 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997256832:0@lo:502: 00000100:00100000:3.0:1788890874.350174:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890874.350189:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cad48310 going to sleep for 11 seconds 00000100:00100000:3.0:1788890874.350202:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997256832 00000100:00100000:3.0:1788890874.350205:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997256832 00000100:00100000:3.0:1788890874.350220:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788890874.350231:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088c21bef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:7424:x1875787997256832:12345-0@lo:502: 00000100:00100000:3.0:1788890874.350296:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088c21bef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:7424:x1875787997256832:12345-0@lo:502: Request processed in 65us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890874.350303:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788890874.350339:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035a09397 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997256832:0@lo:502: 00000040:00080000:3.0:1788890874.350747:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788890874.350769:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788890874.350781:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788890874.350794:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788890874.350807:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788890874.350821:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788890874.350833:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788890874.350860:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788890874.350874:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788890874.350886:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788890874.350897:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788890874.350907:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788890874.350917:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788890874.350928:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788890874.350938:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788890874.350948:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788890874.350959:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788890874.350970:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788890874.350983:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788890874.350997:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788890874.351011:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788890874.351209:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788890874.351223:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788890874.351234:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788890874.351245:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788890874.351256:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788890874.351275:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788890874.351286:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1788890874.351303:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035a09397 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997256960:0@lo:502: 00000100:00100000:3.0:1788890874.351342:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890874.351589:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cad48310 going to sleep for 11 seconds 00000100:00100000:2.0:1788890874.351752:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997256960 00000100:00100000:2.0:1788890874.351758:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997256960 00000100:00100000:2.0:1788890874.351819:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788890874.351826:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ce00fd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:7424:x1875787997256960:12345-0@lo:502: 00000100:00100000:2.0:1788890874.351952:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ce00fd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:7424:x1875787997256960:12345-0@lo:502: Request processed in 126us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890874.351959:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788890874.352133:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035a09397 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997256960:0@lo:502: 00000040:00080000:3.0:1788890874.352178:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788890874.352186:0:7424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788890874.352803:0:7443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788890874.352827:0:7443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000333779ab) 00000020:00000080:1.0:1788890874.352861:0:7443:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788890874.352938:0:7443:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006ea6cf1e from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788890874.352942:0:7443:0:(tgt_mount.c:187:server_put_mount()) put mount 000000006ea6cf1e from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788890874.352944:0:7443:0:(obd_mount.c:710:lustre_put_lsi()) put 000000006ea6cf1e 3 00010000:00080000:1.0:1788890874.352973:0:7443:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000222fc8c8@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1788890874.356119:0:7443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1788890874.356438:0:7443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788890874.356478:0:7443:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788890874.356490:0:7443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xa66601b03fd529a1 00000100:00080000:1.0:1788890874.356500:0:7443:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788890874.356505:0:7443:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000222fc8c8 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788890874.356584:0:7443:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000017e07564 x1875787997257088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788890874.356606:0:7443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788890874.356975:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017e07564 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875787997257088:0@lo:38: 00000100:00100000:3.0:1788890874.357033:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890874.357190:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997257088 00000100:00100000:1.0:1788890874.357197:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997257088 00000100:00100000:1.0:1788890874.357233:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788890874.357240:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035a09397 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3626:x1875787997257088:12345-0@lo:38: 00010000:00080000:1.0:1788890874.357262:0:6496:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 96 last 0 00000020:00000080:1.0:1788890874.357289:0:6496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa66601b03fd529a8 00000004:00100000:1.0:1788890874.357300:0:6496:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788890874.357322:0:6496:0:(import.c:65:import_set_state_nolock()) 000000007b78d1f6 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788890874.357373:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035a09397 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875787997257088:12345-0@lo:38: Request processed in 134us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890874.357380:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1788890874.357572:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:3.0:1788890874.357773:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000017e07564 x1875787997257088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788890884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890874.357784:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788890874.357791:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788890874.357796:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788890874.357800:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788890874.357802:0:3626:0:(import.c:65:import_set_state_nolock()) 00000000222fc8c8 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788890874.357806:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017e07564 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875787997257088:0@lo:38: 00000020:01000000:3.0:1788890874.357830:0:7424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788890874.357871:0:7424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788890874.357891:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 00000000c4f83e64/0xa66601b03fd5298c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52993 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.357901:0:7424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 00000000c4f83e64/0xa66601b03fd5298c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52993 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788890874.357951:0:7424:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788890874.357956:0:7424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788890874.357957:0:7424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788890874.357959:0:7424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788890874.357960:0:7424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788890874.357961:0:7424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788890874.357962:0:7424:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788890874.357964:0:7424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788890874.357965:0:7424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788890874.357966:0:7424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788890874.357968:0:7424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788890874.357971:0:7424:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1788890874.357973:0:7424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788890874.357975:0:7424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788890874.357976:0:7424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788890874.357977:0:7424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788890874.357978:0:7424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788890874.357979:0:7424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788890874.357979:0:7424:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788890874.357980:0:7424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788890874.357981:0:7424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788890874.357982:0:7424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788890874.357983:0:7424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788890874.357997:0:7424:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788890874.358006:0:7424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009af078e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997257216:0@lo:253: 00000100:00100000:3.0:1788890874.358040:0:7424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890874.358129:0:7424:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cad48310 going to sleep for 11 seconds 00000100:00100000:3.0:1788890874.358158:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997257216 00000100:00100000:3.0:1788890874.358162:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997257216 00000100:00100000:3.0:1788890874.358191:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788890874.358196:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d7d6cc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:7424:x1875787997257216:12345-0@lo:253: 20000000:01000000:3.0:1788890874.358215:0:6490:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788890874.358225:0:6490:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:1.0:1788890874.358760:0:7444:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000001:00100000:2.0:1788890874.364545:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788890874.365687:0:6490:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788890874.365704:0:6490:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788890874.366435:0:6511:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788890874.366441:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788890874.366459:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e7c87a7f/0xa66601b03fd529af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.366477:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004a04e700/0xa66601b03fd528cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd528c8 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.366484:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006c577d0d/0xa66601b03fd52977 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52970 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.366492:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e7c87a7f/0xa66601b03fd529af lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.366557:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006c577d0d/0xa66601b03fd52977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52970 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.366572:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006c577d0d/0xa66601b03fd52977 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52970 expref: 15 pid: 6490 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890874.366586:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009efdd943 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6511:1875787997257344:0@lo:104: 00000100:00100000:0.0:1788890874.366644:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788890874.366687:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004a04e700/0xa66601b03fd528cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd528c8 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.366695:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004a04e700/0xa66601b03fd528cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd528c8 expref: 15 pid: 6488 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890874.366714:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008493e640 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6511:1875787997257472:0@lo:104: 00000100:00100000:0.0:1788890874.366739:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890874.366757:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 0000000051486a89 going to sleep for 11 seconds 00000100:00100000:3.0:1788890874.366780:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997257344 00000100:00100000:0.0:1788890874.366781:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997257472 00000100:00100000:0.0:1788890874.366787:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997257472 00000100:00100000:3.0:1788890874.366788:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997257344 00000100:00100000:0.0:1788890874.366829:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788890874.367131:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afd7d81f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:6511:x1875787997257472:12345-0@lo:104: 00010000:00010000:0.0:1788890874.367145:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: 0000000098c09ad8/0xa66601b03fd528c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd528cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.367202:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788890874.367207:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afd7d81f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:6511:x1875787997257472:12345-0@lo:104: Request processed in 371us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890874.367214:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788890874.367228:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788890874.367233:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000723c790e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:6511:x1875787997257344:12345-0@lo:104: 00010000:00010000:0.0:1788890874.367240:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: 00000000898d1c22/0xa66601b03fd52970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52977 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.367267:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788890874.367270:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000723c790e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:6511:x1875787997257344:12345-0@lo:104: Request processed in 38us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890874.367276:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788890874.367290:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788890874.367294:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: 0000000098c09ad8/0xa66601b03fd528c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd528cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.367318:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000098c09ad8 already unused, calling callback (00000000ac895f00) 10000000:00010000:0.0:1788890874.367321:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: 0000000098c09ad8/0xa66601b03fd528c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd528cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.367329:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: 0000000098c09ad8/0xa66601b03fd528c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd528cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890874.367336:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: 0000000098c09ad8/0xa66601b03fd528c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd528cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890874.367342:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788890874.367376:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: 0000000098c09ad8/0xa66601b03fd528c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd528cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.367383:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890874.367403:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: 0000000098c09ad8/0xa66601b03fd528c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd528cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.367409:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: 0000000098c09ad8/0xa66601b03fd528c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd528cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890874.367413:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d44be526 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997257600:0@lo:103: 00010000:00010000:0.0:1788890874.367425:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788890874.367428:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: 00000000898d1c22/0xa66601b03fd52970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52977 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.367435:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000898d1c22 already unused, calling callback (00000000ac895f00) 10000000:00010000:0.0:1788890874.367438:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: 00000000898d1c22/0xa66601b03fd52970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52977 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890874.367445:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788890874.367458:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: 00000000898d1c22/0xa66601b03fd52970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52977 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890874.367464:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: 00000000898d1c22/0xa66601b03fd52970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52977 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890874.367469:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1788890874.367481:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997257600 00010000:00010000:0.0:1788890874.367484:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: 00000000898d1c22/0xa66601b03fd52970 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52977 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890874.367485:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997257600 00010000:00010000:0.0:1788890874.367493:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890874.367500:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004a04e700/0xa66601b03fd528cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd528c8 expref: 16 pid: 6488 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890874.367517:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788890874.367539:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e049215b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:3628:x1875787997257600:12345-0@lo:103: 00010000:00010000:2.0:1788890874.367547:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890874.367555:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004a04e700/0xa66601b03fd528cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd528c8 expref: 16 pid: 6488 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.367561:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004a04e700/0xa66601b03fd528cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd528c8 expref: 16 pid: 6488 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.367572:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890874.367591:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e049215b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:3628:x1875787997257600:12345-0@lo:103: Request processed in 70us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890874.367596:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788890874.367619:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d44be526 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997257600:0@lo:103: 00010000:00010000:0.0:1788890874.367658:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: 00000000898d1c22/0xa66601b03fd52970 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52977 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.367666:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: 00000000898d1c22/0xa66601b03fd52970 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52977 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890874.367677:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890874.367678:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890874.367679:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890874.367686:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890874.367697:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f3c43eb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997257728:0@lo:103: 00000100:00100000:0.0:1788890874.367725:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890874.367773:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997257728 00000100:00100000:2.0:1788890874.367778:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997257728 00010000:00010000:2.0:1788890874.367791:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006c577d0d/0xa66601b03fd52977 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52970 expref: 16 pid: 6490 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890874.367819:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788890874.367824:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f62ffac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:3629:x1875787997257728:12345-0@lo:103: 00010000:00010000:2.0:1788890874.367831:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890874.367834:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006c577d0d/0xa66601b03fd52977 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52970 expref: 16 pid: 6490 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.367860:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006c577d0d/0xa66601b03fd52977 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52970 expref: 16 pid: 6490 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.367872:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e7c87a7f/0xa66601b03fd529af lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.367879:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e7c87a7f/0xa66601b03fd529af lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788890874.367899:0:6481:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001459752s 00010000:00010000:2.0:1788890874.367903:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e7c87a7f/0xa66601b03fd529af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.367909:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e7c87a7f/0xa66601b03fd529af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.367915:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e7c87a7f/0xa66601b03fd529af lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.367921:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e7c87a7f/0xa66601b03fd529af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.367927:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e7c87a7f already unused, calling callback (0000000070d43ab9) 00010000:00010000:2.0:1788890874.367930:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e7c87a7f/0xa66601b03fd529af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.367936:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e7c87a7f/0xa66601b03fd529af lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.367947:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e7c87a7f/0xa66601b03fd529af lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890874.367956:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890874.367992:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f62ffac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:3629:x1875787997257728:12345-0@lo:103: Request processed in 167us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890874.368003:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788890874.368052:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f3c43eb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997257728:0@lo:103: 00010000:00010000:3.0:1788890874.368191:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006c577d0d/0xa66601b03fd52977 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52970 expref: 15 pid: 6490 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890874.368202:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009efdd943 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6511:1875787997257344:0@lo:104: 00010000:00010000:3.0:1788890874.368210:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004a04e700/0xa66601b03fd528cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd528c8 expref: 14 pid: 6488 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890874.368217:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008493e640 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6511:1875787997257472:0@lo:104: 00010000:00010000:3.0:1788890874.368228:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e7c87a7f/0xa66601b03fd529af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.368236:0:6511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e7c87a7f/0xa66601b03fd529af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.368241:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e7c87a7f/0xa66601b03fd529af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890874.368246:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e7c87a7f/0xa66601b03fd529af lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890874.368310:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d7d6cc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:7424:x1875787997257216:12345-0@lo:253: Request processed in 10114us (10270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890874.368317:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788890874.369638:0:7424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009af078e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7424:1875787997257216:0@lo:253: 10000000:01000000:2.0:1788890874.369651:0:7424:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788890874.369660:0:7424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788890874.369662:0:7424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788890874.369663:0:7424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788890874.369664:0:7424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788890874.369666:0:7424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788890874.369667:0:7424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788890874.369668:0:7424:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788890874.369670:0:7424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788890874.369671:0:7424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788890874.369673:0:7424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788890874.369674:0:7424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788890874.369684:0:7424:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788890874.378650:0:7424:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1788890874.378826:0:7424:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788890874.379780:0:7424:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788890874.380009:0:7424:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788890874.380884:0:7424:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788890874.381199:0:7424:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788890874.382317:0:7424:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788890874.382979:0:7424:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788890874.383320:0:7424:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1788890874.383697:0:7424:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788890874.384160:0:7424:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1788890874.384323:0:7424:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1788890874.386029:0:7424:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1788890874.386515:0:7449:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1788890874.386607:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f3c43eb4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7449:1875787997257856:0@lo:700: 00000100:00100000:0.0:1788890874.386679:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890874.386721:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997257856 00000100:00100000:0.0:1788890874.386731:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997257856 00000100:00100000:0.0:1788890874.386772:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788890874.386779:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c62a2e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7449:x1875787997257856:12345-0@lo:700: 00000100:00100000:0.0:1788890874.386905:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086ada949 going to sleep for 11 seconds 00000040:01000000:2.0:1788890874.387193:0:7424:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788890874.388096:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e049215b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1875787997257984:0@lo:1000: 00000100:00100000:2.0:1788890874.388155:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890874.388202:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 0000000098770dff going to sleep for 11 seconds 00000020:00080000:1.0:1788890874.388266:0:7448:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788890874.388271:0:7448:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788890874.388470:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997257984 00000100:00100000:3.0:1788890874.388477:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997257984 00000100:00100000:3.0:1788890874.388553:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788890874.388562:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e73e7c31 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7450:x1875787997257984:12345-0@lo:1000: 00000100:00100000:3.0:1788890874.388651:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e73e7c31 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7450:x1875787997257984:12345-0@lo:1000: Request processed in 90us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890874.388658:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788890874.388838:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e049215b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1875787997257984:0@lo:1000: 00000040:01000000:1.0:1788890874.388883:0:7450:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1788890874.388908:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f18da712 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1875787997258112:0@lo:700: 00000100:00100000:1.0:1788890874.388934:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890874.388958:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069d4792b going to sleep for 11 seconds 00000100:00100000:2.0:1788890874.389468:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997258112 00000100:00100000:2.0:1788890874.389473:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997258112 00000100:00100000:2.0:1788890874.389517:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788890874.389549:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a30097d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7450:x1875787997258112:12345-0@lo:700: 00000100:00100000:2.0:1788890874.389600:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a30097d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7450:x1875787997258112:12345-0@lo:700: Request processed in 78us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890874.389607:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788890874.389736:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f18da712 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1875787997258112:0@lo:700: 00000100:00100000:3.0:1788890874.389780:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000123c07cd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7450:1875787997258240:0@lo:900: 00000100:00100000:3.0:1788890874.389809:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1788890874.390099:0:7424:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788890874.390211:0:7424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788890874.390931:0:7424:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788890874.390969:0:7424:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:3.0:1788890874.391168:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c3be1206 going to sleep for 11 seconds 00000040:00080000:0.0:1788890874.391319:0:7424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788890874.395002:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997258240 00000100:00100000:2.0:1788890874.395017:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997258240 00000100:00100000:2.0:1788890874.395068:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788890874.395085:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a2c9c1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7450:x1875787997258240:12345-0@lo:900: 00000100:00100000:2.0:1788890874.395180:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a2c9c1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7450:x1875787997258240:12345-0@lo:900: Request processed in 97us (5370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890874.395188:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788890874.395212:0:7450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000123c07cd x1875787997258240/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788890890 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890874.395227:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000123c07cd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7450:1875787997258240:0@lo:900: 00000100:00100000:3.0:1788890874.395342:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000123c07cd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1875787997258368:0@lo:1000: 00000100:00100000:3.0:1788890874.395401:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890874.395444:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 000000008647dbef going to sleep for 11 seconds 40000000:02000000:3.0:1788890874.396326:0:6502:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:2.0:1788890874.397557:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997258368 00000100:00100000:2.0:1788890874.397567:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997258368 00000100:00100000:2.0:1788890874.397617:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788890874.397626:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c51b81d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7450:x1875787997258368:12345-0@lo:1000: 00000100:00100000:2.0:1788890874.397742:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c51b81d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7450:x1875787997258368:12345-0@lo:1000: Request processed in 118us (2341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890874.397749:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788890874.397779:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000123c07cd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1875787997258368:0@lo:1000: 00000004:00080000:1.0:1788890874.397859:0:7450:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000c3be1206 with version 0 00000020:00100000:1.0:1788890874.397881:0:7450:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788890874.397887:0:7450:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000f7411bf4 x1875787997258624/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788890874.397923:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f7411bf4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1875787997258624:0@lo:1000: 00000100:00100000:1.0:1788890874.397963:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890874.397999:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 0000000010865651 going to sleep for 11 seconds 00000100:00100000:2.0:1788890874.398097:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997258624 00000100:00100000:2.0:1788890874.398102:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997258624 00000100:00100000:2.0:1788890874.398124:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788890874.398130:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c116860 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7450:x1875787997258624:12345-0@lo:1000: 00000040:00080000:0.0:1788890874.398541:0:7424:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788890874.400833:0:7424:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788890874.400923:0:7424:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788890874.402732:0:7424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788890874.402983:0:7424:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788890874.406755:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788890874.406977:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000100:00100000:3.0:1788890874.407823:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c62a2e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7449:x1875787997257856:12345-0@lo:700: Request processed in 21038us (21137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890874.407855:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:0.0:1788890874.408098:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788890874.408298:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00010000:00080000:2.0:1788890874.408303:0:7449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f3c43eb4 x1875787997257856/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788890890 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890874.408321:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f3c43eb4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7449:1875787997257856:0@lo:700: 40000000:02000000:2.0:1788890874.408335:0:7449:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:0.0:1788890874.408470:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788890874.408824:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788890874.408951:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788890874.409244:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788890874.409451:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788890874.409638:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788890874.409788:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788890874.409936:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00000001:00080000:3.0:1788890874.410291:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1788890874.410443:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c116860 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7450:x1875787997258624:12345-0@lo:1000: Request processed in 12310us (12477us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788890874.410456:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1788890874.410595:0:7450:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788890874.410608:0:7450:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788890874.410629:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f7411bf4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1875787997258624:0@lo:1000: 00000100:00100000:3.0:1788890874.410728:0:7450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061467f63 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1875787997258752:0@lo:1000: 00000100:00100000:3.0:1788890874.410770:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890874.410804:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997258752 00000100:00100000:3.0:1788890874.410811:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997258752 00000100:00100000:3.0:1788890874.410867:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788890874.410876:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002896f61a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7450:x1875787997258752:12345-0@lo:1000: 00000100:00100000:3.0:1788890874.410932:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002896f61a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7450:x1875787997258752:12345-0@lo:1000: Request processed in 58us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890874.410938:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788890874.410974:0:7450:0:(client.c:2715:ptlrpc_set_wait()) set 000000000bc1ec0a going to sleep for 11 seconds 00000100:00100000:3.0:1788890874.410986:0:7450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061467f63 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7450:1875787997258752:0@lo:1000: 00000040:00080000:3.0:1788890874.411001:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788890874.411026:0:7450:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000037e71a01 with version 1 00000004:00080000:3.0:1788890874.411042:0:7440:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000808d40f0 version 1 rpc_version 1 00000020:00100000:3.0:1788890874.411055:0:7440:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788890874.411140:0:7440:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000061467f63 x1875787997259008/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788890874.411154:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061467f63 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7440:1875787997259008:0@lo:1000: 00000100:00100000:3.0:1788890874.411178:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890874.411193:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 000000008bcb4a5c going to sleep for 11 seconds 00000100:00100000:3.0:1788890874.411205:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997259008 00000100:00100000:3.0:1788890874.411208:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997259008 00000100:00100000:3.0:1788890874.411229:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788890874.411234:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000123c07cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7440:x1875787997259008:12345-0@lo:1000: 00100000:10000000:0.0:1788890874.412320:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788890874.412679:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788890874.412874:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788890874.414246:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788890874.416294:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000040:00080000:3.0:1788890874.417020:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00100000:10000000:1.0:1788890874.417614:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788890874.417769:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788890874.417986:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00000004:00080000:3.0:1788890874.418489:0:7450:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:1.0:1788890874.419733:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788890874.419915:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788890874.420203:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788890874.420707:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788890874.420824:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788890874.420955:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788890874.421103:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788890874.421239:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788890874.421788:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788890874.421937:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788890874.422491:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788890874.425419:0:7424:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788890874.427651:0:7424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1788890874.429895:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1788890874.430222:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000123c07cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7440:x1875787997259008:12345-0@lo:1000: Request processed in 18984us (19039us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788890874.430235:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1788890874.430323:0:7440:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788890874.430328:0:7440:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788890874.430344:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061467f63 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7440:1875787997259008:0@lo:1000: 00000001:00080000:1.0:1788890874.440558:0:7424:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788890874.440610:0:7424:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbbfc4189f988 00100000:10000000:1.0:1788890874.440618:0:7424:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:2.0:1788890874.440629:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:01000004:0.0:1788890874.441331:0:7424:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788890874.441367:0:7424:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788890874.441384:0:7424:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788890874.441409:0:7424:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788890874.444310:0:7424:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788890874.444927:0:7424:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:2.0:1788890874.463102:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788890874.463190:0:7449:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788890874.463196:0:7449:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1788890874.811748:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890875.836607:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890876.861897:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890877.883674:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788890878.061051:0:7694:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1788890878.335506:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788890878.335514:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92508475e000 from 4 10000000:01000000:1.0:1788890878.335519:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788890878.335590:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 000000005aa767dc/0xa66601b03fd529b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890878.335602:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 000000005aa767dc/0xa66601b03fd529b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890878.335613:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 000000005aa767dc/0xa66601b03fd529b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890878.335636:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea9526d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997259136:0@lo:101: 00000100:00100000:1.0:1788890878.335702:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890878.335745:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997259136 00000100:00100000:3.0:1788890878.335754:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997259136 00000100:00100000:1.0:1788890878.335754:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000876bc5a4 going to sleep for 11 seconds 00000100:00100000:3.0:1788890878.335823:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788890878.335833:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009352efd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:6493:x1875787997259136:12345-0@lo:101: 00010000:00010000:3.0:1788890878.335846:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890878.335858:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000098c09ad8/0xa66601b03fd529bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd529b6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890878.335880:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098c09ad8/0xa66601b03fd529bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd529b6 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890878.335889:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000098c09ad8/0xa66601b03fd529bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd529b6 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890878.335898:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000098c09ad8, rc 0) 00000100:00100000:3.0:1788890878.335958:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009352efd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:6493:x1875787997259136:12345-0@lo:101: Request processed in 127us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890878.335964:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788890878.336133:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea9526d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997259136:0@lo:101: 00010000:00010000:0.0:1788890878.336148:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 000000005aa767dc/0xa66601b03fd529b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd529bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890878.336157:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 000000005aa767dc/0xa66601b03fd529b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd529bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890878.336214:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d9a7556 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997259264:0@lo:256: 00000100:00100000:0.0:1788890878.336271:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890878.336299:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000007abbdb83 going to sleep for 11 seconds 00000100:00100000:3.0:1788890878.336316:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997259264 00000100:00100000:3.0:1788890878.336321:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997259264 00000100:00100000:3.0:1788890878.336354:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788890878.336360:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d3d3347 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:6493:x1875787997259264:12345-0@lo:256: 20000000:01000000:3.0:1788890878.336372:0:6490:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788890878.336387:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788890878.336390:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788890878.336478:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d3d3347 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:6493:x1875787997259264:12345-0@lo:256: Request processed in 119us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890878.336488:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788890878.336576:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d9a7556 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997259264:0@lo:256: 10000000:01000000:1.0:1788890878.336637:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788890878.336643:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 000000005aa767dc/0xa66601b03fd529b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd529bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890878.336651:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 000000005aa767dc/0xa66601b03fd529b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd529bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890878.336668:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788890878.336670:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92509099a000 from 21 10000000:01000000:1.0:1788890878.336673:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788890878.336689:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 000000005373b54c/0xa66601b03fd529c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890878.336704:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 000000005373b54c/0xa66601b03fd529c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890878.336710:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 000000005373b54c/0xa66601b03fd529c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890878.336721:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea9526d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997259392:0@lo:101: 00000100:00100000:1.0:1788890878.336747:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890878.336792:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c2c836b going to sleep for 11 seconds 00000100:00100000:3.0:1788890878.336968:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997259392 00000100:00100000:3.0:1788890878.336973:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997259392 00000100:00100000:3.0:1788890878.337004:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788890878.337010:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0385343 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:6493:x1875787997259392:12345-0@lo:101: 00010000:00010000:3.0:1788890878.337141:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890878.337151:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000072089ddc/0xa66601b03fd529cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd529c4 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890878.337167:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000072089ddc/0xa66601b03fd529cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd529c4 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890878.337175:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000072089ddc/0xa66601b03fd529cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd529c4 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890878.337182:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000072089ddc, rc 0) 00000100:00100000:3.0:1788890878.337220:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0385343 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:6493:x1875787997259392:12345-0@lo:101: Request processed in 210us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890878.337226:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788890878.337305:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea9526d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997259392:0@lo:101: 00010000:00010000:1.0:1788890878.337314:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 000000005373b54c/0xa66601b03fd529c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd529cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890878.337322:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 000000005373b54c/0xa66601b03fd529c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd529cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890878.337371:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea9526d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997259520:0@lo:501: 00000100:00100000:1.0:1788890878.337396:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890878.337420:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c2c836b going to sleep for 11 seconds 00000100:00100000:0.0:1788890878.337663:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997259520 00000100:00100000:0.0:1788890878.337668:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997259520 00000100:00100000:0.0:1788890878.337705:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788890878.337712:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf2cba3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:6493:x1875787997259520:12345-0@lo:501: 00000100:00100000:0.0:1788890878.337914:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf2cba3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:6493:x1875787997259520:12345-0@lo:501: Request processed in 202us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890878.337932:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788890878.338038:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea9526d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997259520:0@lo:501: 00000100:00100000:1.0:1788890878.338066:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea9526d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997259648:0@lo:503: 00000100:00100000:1.0:1788890878.338104:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890878.338146:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c2c836b going to sleep for 11 seconds 00000100:00100000:3.0:1788890878.338343:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997259648 00000100:00100000:3.0:1788890878.338348:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997259648 00000100:00100000:3.0:1788890878.338378:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788890878.338385:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4418bd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:6493:x1875787997259648:12345-0@lo:503: 00000100:00100000:3.0:1788890878.338472:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4418bd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:6493:x1875787997259648:12345-0@lo:503: Request processed in 88us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890878.338478:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788890878.338653:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea9526d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997259648:0@lo:503: 00000100:00100000:0.0:1788890878.344481:0:7716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fa61fd1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7716:1875787997259776:0@lo:502: 00000100:00100000:0.0:1788890878.344595:0:7716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890878.344647:0:7716:0:(client.c:2715:ptlrpc_set_wait()) set 000000007abbdb83 going to sleep for 11 seconds 00000100:00100000:1.0:1788890878.344818:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997259776 00000100:00100000:1.0:1788890878.344825:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997259776 00000100:00100000:1.0:1788890878.344875:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788890878.344891:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000220ec75d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:7716:x1875787997259776:12345-0@lo:502: 00000100:00100000:1.0:1788890878.345029:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000220ec75d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:7716:x1875787997259776:12345-0@lo:502: Request processed in 128us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890878.345037:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788890878.345473:0:7716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fa61fd1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7716:1875787997259776:0@lo:502: 00000100:00100000:0.0:1788890878.345549:0:7716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fa61fd1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7716:1875787997259904:0@lo:502: 00000100:00100000:0.0:1788890878.345585:0:7716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890878.345737:0:7716:0:(client.c:2715:ptlrpc_set_wait()) set 000000007abbdb83 going to sleep for 11 seconds 00000100:00100000:2.0:1788890878.346247:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997259904 00000100:00100000:2.0:1788890878.346254:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997259904 00000100:00100000:2.0:1788890878.346301:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788890878.346308:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a203db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:7716:x1875787997259904:12345-0@lo:502: 00000100:00100000:2.0:1788890878.346402:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a203db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:7716:x1875787997259904:12345-0@lo:502: Request processed in 95us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890878.346410:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788890878.347064:0:7716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fa61fd1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7716:1875787997259904:0@lo:502: 00000040:00080000:0.0:1788890878.347092:0:7716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788890878.347451:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788890878.347473:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788890878.347481:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 000000005373b54c/0xa66601b03fd529c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd529cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890878.347492:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 000000005373b54c/0xa66601b03fd529c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd529cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890878.347501:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788890878.347504:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92509099a000 from 4 10000000:01000000:2.0:1788890878.347506:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788890878.348033:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 0000000081f603eb/0xa66601b03fd529d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890878.348043:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 0000000081f603eb/0xa66601b03fd529d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890878.348051:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 0000000081f603eb/0xa66601b03fd529d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890878.348068:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001cb09ed6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997260032:0@lo:101: 00000100:00100000:2.0:1788890878.348115:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890878.348362:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c5a26617 going to sleep for 11 seconds 00000100:00100000:0.0:1788890878.349330:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997260032 00000100:00100000:0.0:1788890878.349338:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997260032 00000100:00100000:0.0:1788890878.349459:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788890878.349469:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7d878d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:6493:x1875787997260032:12345-0@lo:101: 00010000:00010000:0.0:1788890878.349482:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890878.349497:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b1794c23/0xa66601b03fd529d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd529d2 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890878.349541:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b1794c23/0xa66601b03fd529d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd529d2 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890878.349552:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b1794c23/0xa66601b03fd529d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd529d2 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890878.349561:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b1794c23, rc 0) 00000100:00100000:0.0:1788890878.349639:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7d878d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997260032:12345-0@lo:101: Request processed in 172us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890878.349648:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788890878.349680:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001cb09ed6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997260032:0@lo:101: 00010000:00010000:2.0:1788890878.349706:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 0000000081f603eb/0xa66601b03fd529d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd529d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890878.349715:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 0000000081f603eb/0xa66601b03fd529d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd529d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890878.349775:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001cb09ed6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997260160:0@lo:256: 00000100:00100000:2.0:1788890878.349812:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890878.349844:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c5a26617 going to sleep for 11 seconds 00000100:00100000:0.0:1788890878.350223:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997260160 00000100:00100000:0.0:1788890878.350228:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997260160 00000100:00100000:0.0:1788890878.350262:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788890878.350268:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b7f8971 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997260160:12345-0@lo:256: 20000000:01000000:0.0:1788890878.350283:0:6490:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788890878.350299:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788890878.350301:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788890878.350462:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b7f8971 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997260160:12345-0@lo:256: Request processed in 193us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890878.350470:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788890878.350645:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001cb09ed6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997260160:0@lo:256: 10000000:01000000:3.0:1788890878.350758:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788890878.350775:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 0000000081f603eb/0xa66601b03fd529d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd529d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890878.350785:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 0000000081f603eb/0xa66601b03fd529d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd529d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890878.350794:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788890878.350796:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788890878.350799:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788890878.350819:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 000000002514ddb5/0xa66601b03fd529e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890878.350826:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 000000002514ddb5/0xa66601b03fd529e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890878.350834:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 000000002514ddb5/0xa66601b03fd529e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890878.350848:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009af078e5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997260288:0@lo:101: 00000100:00100000:3.0:1788890878.350877:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890878.350956:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000009fddffdb going to sleep for 11 seconds 00000100:00100000:2.0:1788890878.355062:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997260288 00000100:00100000:2.0:1788890878.355077:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997260288 00000100:00100000:2.0:1788890878.355149:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788890878.355160:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a67f2dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997260288:12345-0@lo:101: 00010000:00010000:2.0:1788890878.355176:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890878.355192:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e6f82fab/0xa66601b03fd529e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd529e0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890878.355219:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e6f82fab/0xa66601b03fd529e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd529e0 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890878.355230:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e6f82fab/0xa66601b03fd529e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd529e0 expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890878.355239:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e6f82fab, rc 0) 00000100:00100000:2.0:1788890878.355320:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a67f2dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997260288:12345-0@lo:101: Request processed in 163us (4443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890878.355327:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788890878.355385:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009af078e5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997260288:0@lo:101: 00010000:00010000:0.0:1788890878.355404:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 000000002514ddb5/0xa66601b03fd529e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd529e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890878.355413:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 000000002514ddb5/0xa66601b03fd529e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd529e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890878.355483:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fa61fd1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997260416:0@lo:501: 00000100:00100000:0.0:1788890878.355515:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890878.355566:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074527716 going to sleep for 11 seconds 00000100:00100000:2.0:1788890878.356773:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997260416 00000100:00100000:2.0:1788890878.356781:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997260416 00000100:00100000:2.0:1788890878.356836:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788890878.356843:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064480a85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997260416:12345-0@lo:501: 00000100:00100000:2.0:1788890878.356980:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064480a85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997260416:12345-0@lo:501: Request processed in 138us (1464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890878.356987:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788890878.357043:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fa61fd1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997260416:0@lo:501: 00000100:00100000:0.0:1788890878.357078:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fa61fd1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997260544:0@lo:503: 00000100:00100000:0.0:1788890878.357124:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890878.357156:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074527716 going to sleep for 11 seconds 00000100:00100000:2.0:1788890878.357249:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997260544 00000100:00100000:2.0:1788890878.357253:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997260544 00000100:00100000:2.0:1788890878.357286:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788890878.357293:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000432a19f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997260544:12345-0@lo:503: 00000100:00100000:2.0:1788890878.357376:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000432a19f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997260544:12345-0@lo:503: Request processed in 85us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890878.357383:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788890878.357453:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fa61fd1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997260544:0@lo:503: 00000100:00100000:0.0:1788890878.358824:0:7717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fa61fd1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7717:1875787997260672:0@lo:502: 00000100:00100000:0.0:1788890878.358885:0:7717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890878.358924:0:7717:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3f3b43b going to sleep for 11 seconds 00000100:00100000:2.0:1788890878.359016:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997260672 00000100:00100000:2.0:1788890878.359022:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997260672 00000100:00100000:2.0:1788890878.359059:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788890878.359067:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f09f897 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:7717:x1875787997260672:12345-0@lo:502: 00000100:00100000:2.0:1788890878.359291:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f09f897 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:7717:x1875787997260672:12345-0@lo:502: Request processed in 225us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890878.359299:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788890878.359452:0:7717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fa61fd1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7717:1875787997260672:0@lo:502: 00000020:01000000:0.0:1788890878.359480:0:7717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788890878.359490:0:7717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890878.359493:0:7717:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788890878.359499:0:7717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788890878.359503:0:7717:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:00000080:0.0:1788890878.363113:0:7717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788890878.363149:0:7717:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000001cc6e538) 00000020:00000080:0.0:1788890878.363177:0:7717:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1788890878.363187:0:7717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788890878.363281:0:7717:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788890878.363287:0:7717:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788890878.363294:0:7717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd529f5 00010000:00080000:0.0:1788890878.363327:0:7717:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000b0505bc@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1788890878.369556:0:7717:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1788890878.371496:0:7717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788890878.371510:0:7717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788890878.371578:0:7717:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788890878.371609:0:7717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd529fc 00000100:00080000:3.0:1788890878.371620:0:7717:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788890878.371625:0:7717:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000000b0505bc using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1788890878.371845:0:7717:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000da8cea54 x1875787997260800/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788890878.371911:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000da8cea54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997260800:0@lo:38: 00000100:00100000:2.0:1788890878.371989:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788890878.372050:0:7717:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:3.0:1788890878.372084:0:7717:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:01000000:3.0:1788890878.372222:0:7717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788890878.372226:0:7717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890878.372228:0:7717:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788890878.372231:0:7717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788890878.372234:0:7717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890878.372235:0:7717:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788890878.372238:0:7717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788890878.372240:0:7717:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788890878.372261:0:7717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086ea71b0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7717:1875787997260928:0@lo:502: 00000100:00100000:3.0:1788890878.372301:0:7717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890878.372320:0:7717:0:(client.c:2715:ptlrpc_set_wait()) set 000000009fddffdb going to sleep for 11 seconds 00000100:00080000:3.0:1788890878.372369:0:7720:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000001d13fbc5 x1875787997261056/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890878.372378:0:7720:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b7b40ece going to sleep for 0 seconds 00000100:00100000:0.0:1788890878.372912:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997260800 00000100:00100000:0.0:1788890878.372920:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997260800 00000100:00100000:0.0:1788890878.372966:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788890878.372973:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c67b58d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3626:x1875787997260800:12345-0@lo:38: 00010000:00080000:0.0:1788890878.372998:0:6501:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 100 last 0 00000020:00000080:0.0:1788890878.373032:0:6501:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd52a03 00000004:00100000:0.0:1788890878.373046:0:6501:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788890878.373051:0:6501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788890878.373182:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788890878.373194:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fa61fd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997261184:0@lo:400: 00000100:00100000:0.0:1788890878.373262:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890878.373301:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f4aaa1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997261312:0@lo:400: 00000100:00100000:0.0:1788890878.373340:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890878.373353:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788890878.373358:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ce912266 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997261440:0@lo:400: 00000100:00100000:0.0:1788890878.373377:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890878.373404:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997261184 00000100:00100000:0.0:1788890878.373408:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997261184 00000100:00100000:0.0:1788890878.373438:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997261440 00000100:00100000:0.0:1788890878.373441:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997261440 00000100:00100000:0.0:1788890878.373455:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788890878.373461:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034a91a4f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997261184:12345-0@lo:400: 00000100:00100000:0.0:1788890878.373508:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034a91a4f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997261184:12345-0@lo:400: Request processed in 46us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890878.373514:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788890878.373553:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788890878.373559:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027cb1daa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997261440:12345-0@lo:400: 00000100:00100000:0.0:1788890878.373589:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027cb1daa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997261440:12345-0@lo:400: Request processed in 31us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890878.373594:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788890878.373625:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ce912266 x1875787997261440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890878.373638:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ce912266 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997261440:0@lo:400: 00010000:00080000:0.0:1788890878.373660:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009fa61fd1 x1875787997261184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890878.373668:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fa61fd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997261184:0@lo:400: 00000100:00100000:3.0:1788890878.374843:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788890878.374854:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788890878.374894:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997260928 00000100:00100000:3.0:1788890878.374900:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997260928 00000100:00100000:3.0:1788890878.374948:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788890878.374954:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7570b35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:7717:x1875787997260928:12345-0@lo:502: 00000100:00100000:3.0:1788890878.375090:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7570b35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:7717:x1875787997260928:12345-0@lo:502: Request processed in 136us (2788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890878.375098:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788890878.375165:0:7717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086ea71b0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:7717:1875787997260928:0@lo:502: 00000020:01000000:3.0:1788890878.375195:0:7717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788890878.375201:0:7717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890878.375208:0:7717:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788890878.375211:0:7717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788890878.375345:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788890878.375363:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788890878.375371:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 000000002514ddb5/0xa66601b03fd529e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd529e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890878.375381:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 000000002514ddb5/0xa66601b03fd529e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd529e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890878.375391:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788890878.375393:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff925091ac8000 from 1 10000000:01000000:3.0:1788890878.375396:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788890878.375420:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 00000000ce0163a4/0xa66601b03fd52a0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890878.375428:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 00000000ce0163a4/0xa66601b03fd52a0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890878.375436:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 00000000ce0163a4/0xa66601b03fd52a0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890878.375450:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086ea71b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997261568:0@lo:101: 00000100:00100000:3.0:1788890878.375482:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890878.375510:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000009fddffdb going to sleep for 11 seconds 00000100:00100000:3.0:1788890878.375548:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997261568 00000100:00100000:3.0:1788890878.375552:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997261568 00000100:00100000:3.0:1788890878.375576:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788890878.375581:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000881fef37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997261568:12345-0@lo:101: 00010000:00010000:3.0:1788890878.375589:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890878.375606:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fd33594b/0xa66601b03fd52a11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52a0a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890878.375626:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fd33594b/0xa66601b03fd52a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52a0a expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890878.375636:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fd33594b/0xa66601b03fd52a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52a0a expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890878.375645:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fd33594b, rc 0) 00000100:00100000:3.0:1788890878.376879:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000881fef37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997261568:12345-0@lo:101: Request processed in 1293us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890878.376888:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788890878.376976:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997261312 00000100:00100000:1.0:1788890878.376981:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997261312 00000100:00100000:0.0:1788890878.377035:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086ea71b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997261568:0@lo:101: 00010000:00010000:0.0:1788890878.377053:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 00000000ce0163a4/0xa66601b03fd52a0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52a11 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890878.377063:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 00000000ce0163a4/0xa66601b03fd52a0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52a11 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890878.377141:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fa61fd1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997261696:0@lo:501: 00000100:00100000:0.0:1788890878.377176:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890878.377216:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000036f466b9 going to sleep for 11 seconds 00000100:00100000:1.0:1788890878.377270:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997261696 00000100:00100000:1.0:1788890878.377275:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997261696 00000100:00100000:1.0:1788890878.377307:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788890878.377314:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025877669 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997261696:12345-0@lo:501: 00000100:00100000:3.0:1788890878.377679:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788890878.377687:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029f069d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997261312:12345-0@lo:400: 00000100:00100000:0.0:1788890878.377951:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fa61fd1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997261696:0@lo:501: 10000000:01000000:0.0:1788890878.377982:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788890878.377988:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 00000000ce0163a4/0xa66601b03fd52a0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52a11 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890878.377997:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 00000000ce0163a4/0xa66601b03fd52a0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52a11 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890878.378135:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025877669 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997261696:12345-0@lo:501: Request processed in 822us (959us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788890878.378142:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788890878.383228:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029f069d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997261312:12345-0@lo:400: Request processed in 5534us (9880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890878.383246:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788890878.383393:0:6501:0:(import.c:65:import_set_state_nolock()) 000000007a797b06 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788890878.383460:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f4aaa1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997261312:0@lo:400: 00000100:00100000:1.0:1788890878.383469:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c67b58d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1875787997260800:12345-0@lo:38: Request processed in 10495us (11479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890878.383478:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788890878.383556:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788890878.383563:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788890878.383571:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788890878.383577:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788890878.383579:0:3626:0:(import.c:65:import_set_state_nolock()) 000000000b0505bc lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788890878.383644:0:3626:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b7b40ece): req@000000001d13fbc5 x1875787997261056/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890878.383670:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000da8cea54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997260800:0@lo:38: 00000100:00100000:1.0:1788890878.384038:0:7720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890878.384084:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997261056 00000100:00100000:1.0:1788890878.384087:0:7720:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b7b40ece going to sleep for 11 seconds 00000100:00100000:3.0:1788890878.384091:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997261056 00000100:00100000:3.0:1788890878.384264:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788890878.384273:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7411bf4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7720:x1875787997261056:12345-0@lo:1000: 00000100:00100000:3.0:1788890878.384342:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7411bf4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7720:x1875787997261056:12345-0@lo:1000: Request processed in 72us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890878.384348:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788890878.384402:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f4aaa1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997261824:0@lo:41: 00000100:00100000:2.0:1788890878.384433:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890878.388106:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997261824 00000100:00100000:3.0:1788890878.388122:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997261824 00000100:00100000:3.0:1788890878.388188:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788890878.388198:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9851689 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3629:x1875787997261824:12345-0@lo:41: 00000004:00000024:3.0:1788890878.388234:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788890878.388351:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9851689 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3629:x1875787997261824:12345-0@lo:41: Request processed in 155us (3918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890878.388368:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788890878.388405:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f4aaa1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997261824:0@lo:41: 00000100:00100000:1.0:1788890878.388933:0:7720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001d13fbc5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7720:1875787997261056:0@lo:1000: 00000040:01000000:1.0:1788890878.388966:0:7720:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788890878.389006:0:7720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f18da712 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7720:1875787997261952:0@lo:1000: 00000100:00100000:1.0:1788890878.389052:0:7720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890878.389088:0:7720:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ab0157f8 going to sleep for 11 seconds 00000100:00100000:3.0:1788890878.389452:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997261952 00000100:00100000:3.0:1788890878.389459:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997261952 00000100:00100000:3.0:1788890878.389497:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788890878.389504:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee0207ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7720:x1875787997261952:12345-0@lo:1000: 00000100:00100000:3.0:1788890878.389663:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee0207ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7720:x1875787997261952:12345-0@lo:1000: Request processed in 160us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890878.389671:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788890878.389680:0:7720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f18da712 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7720:1875787997261952:0@lo:1000: 00000100:00100000:1.0:1788890878.389736:0:7720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f18da712 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7720:1875787997262080:0@lo:700: 00000100:00100000:1.0:1788890878.389799:0:7720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890878.389854:0:7720:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c2c836b going to sleep for 11 seconds 00000100:00100000:0.0:1788890878.389933:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997262080 00000100:00100000:0.0:1788890878.389939:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997262080 00000100:00100000:0.0:1788890878.390010:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788890878.390017:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000303b2961 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7720:x1875787997262080:12345-0@lo:700: 00000100:00100000:0.0:1788890878.390176:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000303b2961 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7720:x1875787997262080:12345-0@lo:700: Request processed in 160us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890878.390192:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788890878.395162:0:7720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f18da712 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7720:1875787997262080:0@lo:700: 00000100:00100000:3.0:1788890878.395386:0:7720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000da8cea54 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7720:1875787997262208:0@lo:1000: 00000100:00100000:3.0:1788890878.395449:0:7720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890878.395490:0:7720:0:(client.c:2715:ptlrpc_set_wait()) set 000000004daae07d going to sleep for 11 seconds 00000100:00100000:1.0:1788890878.396388:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997262208 00000100:00100000:1.0:1788890878.396397:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997262208 00000100:00100000:1.0:1788890878.396467:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788890878.396477:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cd8ed17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7720:x1875787997262208:12345-0@lo:1000: 00000100:00100000:1.0:1788890878.396610:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cd8ed17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7720:x1875787997262208:12345-0@lo:1000: Request processed in 134us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890878.396617:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788890878.396856:0:7720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000da8cea54 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7720:1875787997262208:0@lo:1000: 00000004:00080000:2.0:1788890878.396916:0:7720:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000009fddffdb with version 0 00000020:00100000:2.0:1788890878.396932:0:7720:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788890878.396959:0:7720:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000001745f117 x1875787997262464/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788890878.396975:0:7720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001745f117 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7720:1875787997262464:0@lo:1000: 00000100:00100000:2.0:1788890878.397007:0:7720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890878.397041:0:7720:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f4a901e going to sleep for 11 seconds 00000100:00100000:1.0:1788890878.397088:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997262464 00000100:00100000:1.0:1788890878.397094:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997262464 00000100:00100000:1.0:1788890878.397129:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788890878.397135:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002706e399 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7720:x1875787997262464:12345-0@lo:1000: 00000001:00080000:3.0:1788890878.399269:0:7425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1788890878.399282:0:7425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788890878.399720:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002706e399 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7720:x1875787997262464:12345-0@lo:1000: Request processed in 2576us (2704us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788890878.399733:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:2.0:1788890878.404844:0:7720:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788890878.404855:0:7720:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788890878.404873:0:7720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001745f117 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7720:1875787997262464:0@lo:1000: 00000100:00100000:2.0:1788890878.404972:0:7720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001745f117 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7720:1875787997262592:0@lo:1000: 00000100:00100000:2.0:1788890878.405032:0:7720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890878.405082:0:7720:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ce86b8f9 going to sleep for 11 seconds 00000100:00100000:3.0:1788890878.405089:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997262592 00000100:00100000:3.0:1788890878.405103:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997262592 00000100:00100000:3.0:1788890878.405156:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788890878.405164:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007200b77f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7720:x1875787997262592:12345-0@lo:1000: 00000100:00100000:3.0:1788890878.405305:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007200b77f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7720:x1875787997262592:12345-0@lo:1000: Request processed in 143us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890878.405313:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788890878.408850:0:7720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001745f117 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7720:1875787997262592:0@lo:1000: 00000040:00080000:0.0:1788890878.408893:0:7720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788890878.408940:0:7720:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000036f466b9 with version 1 00000004:00080000:1.0:1788890878.409656:0:7718:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000b9de1563 version 1 rpc_version 1 00000020:00100000:1.0:1788890878.409687:0:7718:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788890878.409693:0:7718:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000017e07564 x1875787997262848/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788890878.409712:0:7718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017e07564 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7718:1875787997262848:0@lo:1000: 00000100:00100000:1.0:1788890878.409802:0:7718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890878.409846:0:7718:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ab0157f8 going to sleep for 11 seconds 00000100:00100000:3.0:1788890878.410030:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997262848 00000100:00100000:3.0:1788890878.410037:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997262848 00000100:00100000:3.0:1788890878.410087:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788890878.410094:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092b06f68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7718:x1875787997262848:12345-0@lo:1000: 00000001:00080000:3.0:1788890878.411375:0:7425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1788890878.411549:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092b06f68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7718:x1875787997262848:12345-0@lo:1000: Request processed in 1426us (1718us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788890878.411560:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1788890878.411668:0:7718:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788890878.411673:0:7718:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788890878.411686:0:7718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017e07564 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7718:1875787997262848:0@lo:1000: 00000040:00080000:0.0:1788890878.414858:0:7720:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788890878.415015:0:7720:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788890878.415020:0:7720:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:3.0:1788890878.905381:0:7752:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788890878.906067:0:7752:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788890878.908627:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890879.611786:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1acbaf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997262976:0@lo:41: 00000100:00100000:0.0:1788890879.611884:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890879.612079:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997262976 00000100:00100000:1.0:1788890879.612105:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997262976 00000100:00100000:1.0:1788890879.612161:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788890879.612170:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f4aaa1f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997262976:12345-0@lo:41: 00000004:00000024:1.0:1788890879.612205:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788890879.612613:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f4aaa1f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997262976:12345-0@lo:41: Request processed in 444us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890879.612622:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788890879.612836:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1acbaf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997262976:0@lo:41: 00010000:00010000:0.0:1788890879.933966:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890880.955666:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788890881.401758:0:7854:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788890881.402133:0:7854:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788890881.980592:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788890882.362222:0:7902:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd68b13200 20000000:00000080:0.0:1788890882.362239:0:7902:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9250c10dc000 uarg=0000000000000000 20000000:01000000:0.0:1788890882.362279:0:7902:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788890882.362287:0:7902:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788890882.362292:0:7902:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788890882.362361:0:7902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788890882.362373:0:7902:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788890882.370641:0:7902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788890882.371010:0:7902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788890882.371039:0:7902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788890882.371113:0:7902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788890882.371131:0:7902:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788890882.371149:0:7902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005f97a1f3/0xa66601b03fd52a18 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.371177:0:7902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000084af974a/0xa66601b03fd52897 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52890 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.371184:0:7902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000067ed6363/0xa66601b03fd52985 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd5297e expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.371190:0:7902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005f97a1f3/0xa66601b03fd52a18 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.371229:0:7902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000067ed6363/0xa66601b03fd52985 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd5297e expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.371241:0:7902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000067ed6363/0xa66601b03fd52985 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd5297e expref: 17 pid: 6490 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890882.371257:0:7902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fa61fd1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7902:1875787997263104:0@lo:104: 00000100:00100000:0.0:1788890882.371389:0:7902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788890882.371516:0:7902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000084af974a/0xa66601b03fd52897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52890 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.371554:0:7902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000084af974a/0xa66601b03fd52897 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52890 expref: 17 pid: 6488 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890882.371562:0:7902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ce912266 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7902:1875787997263232:0@lo:104: 00000100:00100000:0.0:1788890882.371588:0:7902:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc7f6844 going to sleep for 11 seconds 00000100:00100000:2.0:1788890882.373602:0:6480:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788890882.373633:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890882.373663:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997263104 00000100:00100000:2.0:1788890882.373671:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997263104 00000100:00100000:2.0:1788890882.373721:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997263232 00000100:00100000:2.0:1788890882.373724:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997263232 00000100:00100000:2.0:1788890882.373739:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788890882.373745:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057c44996 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:7902:x1875787997263104:12345-0@lo:104: 00010000:00010000:2.0:1788890882.373760:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd5297e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52985 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890882.373819:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788890882.373823:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057c44996 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:7902:x1875787997263104:12345-0@lo:104: Request processed in 79us (2435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890882.373840:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788890882.373946:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788890882.373955:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0d6ab78 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:7902:x1875787997263232:12345-0@lo:104: 00010000:00010000:0.0:1788890882.373962:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: 0000000079a8404b/0xa66601b03fd52890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52897 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374001:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788890882.374005:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0d6ab78 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:7902:x1875787997263232:12345-0@lo:104: Request processed in 53us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890882.374011:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788890882.374025:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788890882.374030:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd5297e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52985 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374037:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000b97836f already unused, calling callback (00000000ac895f00) 10000000:00010000:0.0:1788890882.374040:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd5297e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52985 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374047:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd5297e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52985 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890882.374065:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd5297e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52985 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890882.374070:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788890882.374097:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd5297e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52985 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374103:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890882.374117:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd5297e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52985 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374122:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd5297e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52985 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374144:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788890882.374146:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: 0000000079a8404b/0xa66601b03fd52890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52897 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374151:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000079a8404b already unused, calling callback (00000000ac895f00) 10000000:00010000:0.0:1788890882.374153:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: 0000000079a8404b/0xa66601b03fd52890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52897 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374158:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: 0000000079a8404b/0xa66601b03fd52890 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52897 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890882.374163:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: 0000000079a8404b/0xa66601b03fd52890 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52897 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890882.374167:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788890882.374177:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: 0000000079a8404b/0xa66601b03fd52890 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52897 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374182:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890882.374186:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: 0000000079a8404b/0xa66601b03fd52890 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52897 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374191:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: 0000000079a8404b/0xa66601b03fd52890 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52897 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374204:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890882.374205:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890882.374206:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890882.374226:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000daf6a649 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997263360:0@lo:103: 00000100:00100000:0.0:1788890882.374263:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890882.374295:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788890882.374424:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d9a7556 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997263488:0@lo:103: 00000100:00100000:0.0:1788890882.374448:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890882.374480:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997263360 00000100:00100000:0.0:1788890882.374485:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997263360 00010000:00010000:0.0:1788890882.374504:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000067ed6363/0xa66601b03fd52985 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd5297e expref: 18 pid: 6490 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890882.374540:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997263488 00000100:00100000:0.0:1788890882.374543:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997263488 00010000:00010000:0.0:1788890882.374554:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000084af974a/0xa66601b03fd52897 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52890 expref: 19 pid: 6488 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890882.374571:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788890882.374577:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3c43eb4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:3627:x1875787997263360:12345-0@lo:103: 00010000:00010000:0.0:1788890882.374587:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890882.374592:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000067ed6363/0xa66601b03fd52985 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd5297e expref: 19 pid: 6490 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374602:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000067ed6363/0xa66601b03fd52985 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd5297e expref: 19 pid: 6490 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374621:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890882.374647:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3c43eb4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:3627:x1875787997263360:12345-0@lo:103: Request processed in 72us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890882.374653:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788890882.374667:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788890882.374673:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008493e640 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:3627:x1875787997263488:12345-0@lo:103: 00010000:00010000:0.0:1788890882.374699:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890882.374704:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000084af974a/0xa66601b03fd52897 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52890 expref: 18 pid: 6488 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374712:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000084af974a/0xa66601b03fd52897 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52890 expref: 18 pid: 6488 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374723:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005f97a1f3/0xa66601b03fd52a18 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374730:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005f97a1f3/0xa66601b03fd52a18 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374743:0:7436:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005f97a1f3/0xa66601b03fd52a18 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374749:0:7436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005f97a1f3/0xa66601b03fd52a18 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374753:0:7436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005f97a1f3/0xa66601b03fd52a18 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374758:0:7436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005f97a1f3/0xa66601b03fd52a18 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374762:0:7436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005f97a1f3 already unused, calling callback (0000000070d43ab9) 00010000:00010000:0.0:1788890882.374765:0:7436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005f97a1f3/0xa66601b03fd52a18 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374771:0:7436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005f97a1f3/0xa66601b03fd52a18 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374790:0:7436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005f97a1f3/0xa66601b03fd52a18 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.374798:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890882.374821:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008493e640 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:3627:x1875787997263488:12345-0@lo:103: Request processed in 149us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890882.374827:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788890882.374929:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d9a7556 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997263488:0@lo:103: 00000100:00100000:0.0:1788890882.374942:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000daf6a649 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997263360:0@lo:103: 00010000:00010000:0.0:1788890882.374976:0:7902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000067ed6363/0xa66601b03fd52985 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd5297e expref: 17 pid: 6490 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890882.374987:0:7902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fa61fd1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7902:1875787997263104:0@lo:104: 00010000:00010000:0.0:1788890882.374996:0:7902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000084af974a/0xa66601b03fd52897 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52890 expref: 16 pid: 6488 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890882.375004:0:7902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ce912266 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7902:1875787997263232:0@lo:104: 00010000:00010000:0.0:1788890882.375015:0:7902:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005f97a1f3/0xa66601b03fd52a18 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.375023:0:7902:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005f97a1f3/0xa66601b03fd52a18 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.375028:0:7902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005f97a1f3/0xa66601b03fd52a18 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.375033:0:7902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005f97a1f3/0xa66601b03fd52a18 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890882.375445:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890883.007948:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890883.709091:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000085ac0d2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997263616:0@lo:41: 00000100:00100000:1.0:1788890883.709164:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890883.709233:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997263616 00000100:00100000:1.0:1788890883.709240:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997263616 00000100:00100000:1.0:1788890883.709282:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788890883.709290:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025c3f3f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997263616:12345-0@lo:41: 00000004:00000024:1.0:1788890883.709327:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788890883.709370:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025c3f3f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997263616:12345-0@lo:41: Request processed in 82us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890883.709377:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788890883.709422:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000085ac0d2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997263616:0@lo:41: 00000100:00100000:2.0:1788890883.709580:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2fd01db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997263872:0@lo:400: 00000100:00100000:2.0:1788890883.709612:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890883.709634:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788890883.709639:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a63d201 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997264000:0@lo:400: 00000100:00100000:2.0:1788890883.709672:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890883.709705:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997263872 00000100:00100000:2.0:1788890883.709709:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997263872 00000100:00100000:2.0:1788890883.709738:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788890883.709744:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cb09ed6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997263872:12345-0@lo:400: 00000100:00100000:2.0:1788890883.709779:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cb09ed6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997263872:12345-0@lo:400: Request processed in 36us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890883.709786:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788890883.709804:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997264000 00000100:00100000:2.0:1788890883.709807:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997264000 00000100:00100000:2.0:1788890883.709826:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788890883.709843:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e049215b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997264000:12345-0@lo:400: 00000100:00100000:2.0:1788890883.709872:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e049215b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997264000:12345-0@lo:400: Request processed in 41us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890883.709877:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788890883.709902:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a63d201 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997264000:0@lo:400: 00010000:00080000:2.0:1788890883.709912:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e2fd01db x1875787997263872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890883.709921:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2fd01db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997263872:0@lo:400: 00000100:00100000:1.0:1788890883.710650:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a374bf8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997263744:0@lo:400: 00000100:00100000:1.0:1788890883.710869:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890883.710908:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788890883.710915:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001745f117 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997264128:0@lo:400: 00000100:00100000:1.0:1788890883.710942:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890883.710974:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997264128 00000100:00100000:1.0:1788890883.710979:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997264128 00000100:00100000:1.0:1788890883.711006:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788890883.711025:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085ac0d2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997264128:12345-0@lo:400: 00000100:00100000:1.0:1788890883.711063:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085ac0d2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997264128:12345-0@lo:400: Request processed in 39us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890883.711069:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788890883.711102:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000001745f117 x1875787997264128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890883.711111:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001745f117 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997264128:0@lo:400: 00000100:00100000:2.0:1788890883.711245:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997263744 00000100:00100000:2.0:1788890883.711255:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997263744 00000100:00100000:2.0:1788890883.711283:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788890883.711289:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7597c13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:3630:x1875787997263744:12345-0@lo:400: 00000100:00100000:2.0:1788890883.711321:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7597c13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:3630:x1875787997263744:12345-0@lo:400: Request processed in 33us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890883.711327:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788890883.711400:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a374bf8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997263744:0@lo:400: 00010000:00010000:3.0:1788890884.030136:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788890884.292732:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788890884.292738:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92508475e000 from 1 10000000:01000000:0.0:1788890884.292743:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788890884.292782:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52a1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890884.292794:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52a1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890884.292804:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52a1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890884.292825:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ce912266 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997264256:0@lo:101: 00000100:00100000:0.0:1788890884.292890:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890884.292937:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000078252b5d going to sleep for 11 seconds 00000100:00100000:1.0:1788890884.297698:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997264256 00000100:00100000:1.0:1788890884.297713:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997264256 00000100:00100000:1.0:1788890884.297845:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788890884.297854:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a06cb06a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997264256:12345-0@lo:101: 00010000:00010000:1.0:1788890884.297870:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890884.297887:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000075255a7f/0xa66601b03fd52a26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52a1f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890884.297910:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000075255a7f/0xa66601b03fd52a26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52a1f expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890884.297919:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000075255a7f/0xa66601b03fd52a26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52a1f expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890884.297928:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000075255a7f, rc 0) 00000100:00100000:1.0:1788890884.297999:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a06cb06a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997264256:12345-0@lo:101: Request processed in 147us (5109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890884.298005:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788890884.298076:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ce912266 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997264256:0@lo:101: 00010000:00010000:1.0:1788890884.298100:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52a1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52a26 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890884.298108:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 000000000b97836f/0xa66601b03fd52a1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52a26 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890884.298179:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000877441c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997264384:0@lo:501: 00000100:00100000:1.0:1788890884.298211:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890884.298237:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e527cd09 going to sleep for 11 seconds 00000100:00100000:1.0:1788890884.298251:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997264384 00000100:00100000:1.0:1788890884.298254:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997264384 00000100:00100000:1.0:1788890884.298274:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788890884.298279:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccde779f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997264384:12345-0@lo:501: 00000100:00100000:1.0:1788890884.298380:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccde779f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997264384:12345-0@lo:501: Request processed in 100us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890884.298387:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788890884.298416:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000877441c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997264384:0@lo:501: 00000100:00100000:1.0:1788890884.298439:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000877441c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997264512:0@lo:503: 00000100:00100000:1.0:1788890884.298475:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890884.298488:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e527cd09 going to sleep for 11 seconds 00000100:00100000:1.0:1788890884.298498:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997264512 00000100:00100000:1.0:1788890884.298500:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997264512 00000100:00100000:1.0:1788890884.298518:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788890884.298552:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005eabe31c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997264512:12345-0@lo:503: 00000100:00100000:1.0:1788890884.298631:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005eabe31c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997264512:12345-0@lo:503: Request processed in 108us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890884.298637:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788890884.300968:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000877441c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997264512:0@lo:503: 00000100:00100000:0.0:1788890884.307640:0:8014:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fa61fd1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8014:1875787997264640:0@lo:502: 00000100:00100000:0.0:1788890884.307730:0:8014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890884.308705:0:8014:0:(client.c:2715:ptlrpc_set_wait()) set 0000000078252b5d going to sleep for 11 seconds 00000100:00100000:1.0:1788890884.308831:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997264640 00000100:00100000:1.0:1788890884.308839:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997264640 00000100:00100000:1.0:1788890884.308923:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788890884.308931:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f58dcb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:8014:x1875787997264640:12345-0@lo:502: 00000100:00100000:1.0:1788890884.309054:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f58dcb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:8014:x1875787997264640:12345-0@lo:502: Request processed in 124us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890884.309062:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788890884.309214:0:8014:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fa61fd1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8014:1875787997264640:0@lo:502: 00000020:01000000:0.0:1788890884.309242:0:8014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788890884.309250:0:8014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890884.309252:0:8014:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788890884.309259:0:8014:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92508475e000 00000020:00000080:0.0:1788890884.309262:0:8014:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788890884.309301:0:8014:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4886680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8014:1875787997264768:0@lo:502: 00000100:00100000:0.0:1788890884.309338:0:8014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890884.309362:0:8014:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250901c2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890884.309399:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997264768 00000100:00100000:1.0:1788890884.309403:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997264768 00000100:00100000:1.0:1788890884.309434:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788890884.309441:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:8014:x1875787997264768:12345-0@lo:502: 00000100:00100000:1.0:1788890884.309499:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:8014:x1875787997264768:12345-0@lo:502: Request processed in 58us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890884.309505:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788890884.309592:0:8014:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4886680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8014:1875787997264768:0@lo:502: 00000020:01000000:0.0:1788890884.309614:0:8014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788890884.309618:0:8014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890884.309619:0:8014:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788890884.309623:0:8014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788890884.310662:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788890884.310686:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788890884.310697:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd52a1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52a26 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890884.310708:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd52a1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52a26 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890884.310717:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788890884.310720:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92509099a000 from 1 10000000:01000000:1.0:1788890884.310722:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788890884.310749:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250c214ae00/0xa66601b03fd52a2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890884.310767:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250c214ae00/0xa66601b03fd52a2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890884.310778:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250c214ae00/0xa66601b03fd52a2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890884.310793:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997264896:0@lo:101: 00000100:00100000:1.0:1788890884.310831:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890884.310864:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c14d5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788890884.311145:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997264896 00000100:00100000:2.0:1788890884.311150:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997264896 00000100:00100000:2.0:1788890884.311187:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788890884.311194:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997264896:12345-0@lo:101: 00010000:00010000:2.0:1788890884.311203:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890884.311213:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8ba00/0xa66601b03fd52a34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52a2d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890884.311232:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8ba00/0xa66601b03fd52a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52a2d expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890884.311240:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8ba00/0xa66601b03fd52a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52a2d expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890884.311249:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8ba00, rc 0) 00000100:00100000:2.0:1788890884.311279:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997264896:12345-0@lo:101: Request processed in 86us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890884.311285:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788890884.311462:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997264896:0@lo:101: 00010000:00010000:1.0:1788890884.311474:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250c214ae00/0xa66601b03fd52a2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52a34 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890884.311482:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250c214ae00/0xa66601b03fd52a2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52a34 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890884.311549:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997265024:0@lo:501: 00000100:00100000:1.0:1788890884.311571:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890884.311584:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c14d5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788890884.311595:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997265024 00000100:00100000:1.0:1788890884.311598:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997265024 00000100:00100000:1.0:1788890884.311619:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788890884.311626:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997265024:12345-0@lo:501: 00000100:00100000:1.0:1788890884.311724:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997265024:12345-0@lo:501: Request processed in 98us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890884.311731:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788890884.312132:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997265024:0@lo:501: 00000100:00100000:1.0:1788890884.312157:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997265152:0@lo:503: 00000100:00100000:1.0:1788890884.312192:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890884.312207:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c14d5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788890884.312218:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997265152 00000100:00100000:1.0:1788890884.312221:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997265152 00000100:00100000:1.0:1788890884.312243:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788890884.312249:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997265152:12345-0@lo:503: 00000100:00100000:1.0:1788890884.312317:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997265152:12345-0@lo:503: Request processed in 68us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890884.312325:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788890884.312358:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997265152:0@lo:503: 00000100:00100000:1.0:1788890884.312516:0:8015:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8015:1875787997265280:0@lo:502: 00000100:00100000:1.0:1788890884.312563:0:8015:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890884.312581:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997265280 00000100:00100000:1.0:1788890884.312584:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997265280 00000100:00100000:1.0:1788890884.312605:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788890884.312610:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:8015:x1875787997265280:12345-0@lo:502: 00000100:00100000:1.0:1788890884.312678:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:8015:x1875787997265280:12345-0@lo:502: Request processed in 67us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890884.312684:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788890884.312711:0:8015:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c14d53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890884.312722:0:8015:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8015:1875787997265280:0@lo:502: 00000020:01000000:1.0:1788890884.312739:0:8015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890884.312747:0:8015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890884.312749:0:8015:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788890884.312770:0:8015:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92509099a000 00000020:00000080:1.0:1788890884.312773:0:8015:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788890884.312792:0:8015:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8015:1875787997265408:0@lo:502: 00000100:00100000:1.0:1788890884.312822:0:8015:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890884.312837:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997265408 00000100:00100000:1.0:1788890884.312840:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997265408 00000100:00100000:1.0:1788890884.312857:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788890884.312862:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:8015:x1875787997265408:12345-0@lo:502: 00000100:00100000:1.0:1788890884.312909:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:8015:x1875787997265408:12345-0@lo:502: Request processed in 47us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890884.312915:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788890884.312938:0:8015:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c14d53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890884.312948:0:8015:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8015:1875787997265408:0@lo:502: 00000020:01000000:1.0:1788890884.312961:0:8015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890884.312965:0:8015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890884.312966:0:8015:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788890884.312969:0:8015:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788890884.313010:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788890884.313021:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788890884.313028:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250c214ae00/0xa66601b03fd52a2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52a34 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890884.313036:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250c214ae00/0xa66601b03fd52a2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52a34 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890884.731760:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997265536:0@lo:41: 00000100:00100000:2.0:1788890884.731828:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890884.731874:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997265536 00000100:00100000:1.0:1788890884.731882:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997265536 00000100:00100000:1.0:1788890884.731926:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788890884.731935:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997265536:12345-0@lo:41: 00000004:00000024:1.0:1788890884.731979:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788890884.732030:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997265536:12345-0@lo:41: Request processed in 96us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890884.732037:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788890884.732075:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997265536:0@lo:41: 00010000:00010000:2.0:1788890885.051909:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890886.075995:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890887.100833:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890888.123718:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890888.828781:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997265792:0@lo:400: 00000100:00100000:2.0:1788890888.828846:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890888.828899:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788890888.828905:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997265664:0@lo:400: 00000100:00100000:2.0:1788890888.828942:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890888.828966:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997266176:0@lo:400: 00000100:00100000:2.0:1788890888.828990:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890888.829015:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997265920:0@lo:400: 00000100:00100000:2.0:1788890888.829051:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890888.829071:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788890888.829076:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997266048:0@lo:400: 00000100:00100000:2.0:1788890888.829097:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890888.829127:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997265792 00000100:00100000:2.0:1788890888.829134:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997265792 00000100:00100000:2.0:1788890888.829173:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997266048 00000100:00100000:2.0:1788890888.829176:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997266048 00000100:00100000:2.0:1788890888.829191:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788890888.829199:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997265792:12345-0@lo:400: 00000100:00100000:2.0:1788890888.829244:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997265792:12345-0@lo:400: Request processed in 45us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890888.829251:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788890888.829268:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788890888.829273:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997266048:12345-0@lo:400: 00000100:00100000:2.0:1788890888.829302:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997266048:12345-0@lo:400: Request processed in 28us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890888.829314:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788890888.829331:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997265664 00000100:00100000:2.0:1788890888.829335:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997265664 00000100:00100000:2.0:1788890888.829359:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788890888.829365:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:3628:x1875787997265664:12345-0@lo:400: 00000100:00100000:2.0:1788890888.829394:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:3628:x1875787997265664:12345-0@lo:400: Request processed in 30us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890888.829400:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788890888.829425:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997266176 00000100:00100000:2.0:1788890888.829428:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997266176 00000100:00100000:2.0:1788890888.829623:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997265920 00000100:00100000:2.0:1788890888.829627:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997265920 00000100:00100000:2.0:1788890888.829643:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788890888.829648:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997266176:12345-0@lo:400: 00000100:00100000:2.0:1788890888.829681:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997266176:12345-0@lo:400: Request processed in 33us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890888.829686:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788890888.829697:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788890888.829702:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997265920:12345-0@lo:400: 00000100:00100000:2.0:1788890888.829725:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997265920:12345-0@lo:400: Request processed in 23us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890888.829730:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788890888.829777:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9250c12a4000 x1875787997266048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890888.829791:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997266048:0@lo:400: 00000100:00100000:2.0:1788890888.829802:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997265920:0@lo:400: 00000100:00100000:2.0:1788890888.829898:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997265664:0@lo:400: 00000100:00100000:2.0:1788890888.829908:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997266176:0@lo:400: 00010000:00080000:2.0:1788890888.829917:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9250c12a4700 x1875787997265792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890888.829926:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997265792:0@lo:400: 00000100:00100000:0.0:1788890888.833676:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788890888.833698:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1260e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997266304:0@lo:41: 00000100:00100000:0.0:1788890888.833758:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890888.833982:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997266304 00000100:00100000:3.0:1788890888.834271:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997266304 00000100:00100000:3.0:1788890888.834319:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788890888.834328:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997266304:12345-0@lo:41: 00000004:00000024:3.0:1788890888.834358:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788890888.834413:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997266304:12345-0@lo:41: Request processed in 86us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890888.834420:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788890888.834444:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1260e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997266304:0@lo:41: 00010000:00010000:2.0:1788890889.148893:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890889.855643:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997266432:0@lo:41: 00000100:00100000:2.0:1788890889.855731:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890889.855922:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997266432 00000100:00100000:1.0:1788890889.855930:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997266432 00000100:00100000:1.0:1788890889.855984:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788890889.855994:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997266432:12345-0@lo:41: 00000004:00000024:1.0:1788890889.856025:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788890889.856071:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997266432:12345-0@lo:41: Request processed in 79us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890889.856078:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788890889.856320:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997266432:0@lo:41: 00010000:00010000:2.0:1788890890.171750:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788890890.201768:0:8402:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788890890.201773:0:8402:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788890890.201775:0:8402:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788890890.201936:0:8402:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9250ba9ab800 00000020:01000004:0.0:1788890890.201955:0:8402:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788890890.201971:0:8402:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788890890.201988:0:8402:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9250baa6cd28) 00000020:00000080:0.0:1788890890.202005:0:8402:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788890890.248729:0:8402:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788890890.248793:0:8402:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1788890890.278948:0:8402:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788890890.279193:0:8402:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788890890.279209:0:8402:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788890890.279234:0:8402:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa66601b03fd52a42 00000020:01000004:1.0:1788890890.279244:0:8402:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788890890.279270:0:8402:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788890890.279275:0:8402:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788890890.279281:0:8402:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788890890.279287:0:8402:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788890890.279300:0:8402:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9250ba88cd28) 00000020:00000080:1.0:1788890890.279313:0:8402:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1788890890.280835:0:8402:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788890890.281055:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788890890.281062:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788890890.283961:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788890890.283978:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788890890.285843:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788890890.285853:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788890890.292943:0:8402:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788890890.293160:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788890890.293166:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788890890.296136:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788890890.296151:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788890890.314631:0:8402:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788890890.315159:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788890890.315170:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788890890.324610:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788890890.324629:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788890890.328662:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788890890.328679:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788890890.333363:0:8402:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788890890.333596:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788890890.333608:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788890890.341665:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788890890.341683:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788890890.424156:0:8402:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788890890.424361:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788890890.424367:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788890890.432202:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788890890.432216:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788890890.432678:0:8402:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788890890.432708:0:8402:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788890890.432719:0:8402:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788890890.456620:0:8402:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788890890.456665:0:8402:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.126@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788890890.456669:0:8402:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788890890.456671:0:8402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788890890.456673:0:8402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788890890.456674:0:8402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788890890.456675:0:8402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788890890.456676:0:8402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788890890.456678:0:8402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788890890.456679:0:8402:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788890890.456680:0:8402:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788890890.456682:0:8402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788890890.456683:0:8402:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788890890.456687:0:8402:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788890890.456689:0:8402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788890890.456690:0:8402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788890890.456691:0:8402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788890890.456692:0:8402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788890890.456693:0:8402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788890890.456694:0:8402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788890890.456695:0:8402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788890890.456696:0:8402:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788890890.456697:0:8402:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788890890.456698:0:8402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788890890.456699:0:8402:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788890890.456982:0:8402:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788890890.457001:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090312a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997266560:0@lo:253: 00000100:00100000:1.0:1788890890.457071:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890890.457214:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b6854c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890890.464627:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997266560 00000100:00100000:0.0:1788890890.464642:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997266560 00000100:00100000:0.0:1788890890.464797:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788890890.464809:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:8402:x1875787997266560:12345-0@lo:253: 20000000:01000000:0.0:1788890890.464854:0:6488:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788890890.464858:0:6488:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788890890.464864:0:6488:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788890890.464867:0:6488:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788890890.465191:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788890890.465346:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788890890.465360:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788890890.465377:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788890890.465383:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788890890.465396:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788890890.465412:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788890890.465494:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788890890.465510:0:6488:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.126@tcp 20000000:01000000:0.0:1788890890.465512:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788890890.465556:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788890890.465564:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788890890.465580:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788890890.465587:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:0.0:1788890890.465600:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788890890.465607:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788890890.465620:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788890890.465635:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788890890.465698:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1788890890.465708:0:6488:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.126@tcp 20000000:01000000:0.0:1788890890.465723:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788890890.465738:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1788890890.465744:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788890890.465767:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1788890890.465773:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:0.0:1788890890.465784:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1788890890.465789:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788890890.465801:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1788890890.465814:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1788890890.467302:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1788890890.467320:0:6488:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.126@tcp 20000000:01000000:0.0:1788890890.467322:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788890890.467337:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1788890890.467344:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788890890.467358:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1788890890.467363:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:0.0:1788890890.467375:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1788890890.467381:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788890890.467393:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1788890890.467406:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1788890890.467418:0:6488:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788890890.467421:0:6488:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788890890.467424:0:6488:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788890890.467463:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788890890.467465:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788890890.469059:0:8421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1788890890.469102:0:8421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1788890890.469120:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788890890.469315:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1788890890.469339:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1788890890.469354:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1788890890.469364:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788890890.469367:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788890890.475811:0:8422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1788890890.475862:0:8422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1788890890.475886:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1788890890.476170:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1788890890.476207:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1788890890.476225:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1788890890.476238:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788890890.476241:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788890890.478273:0:8423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1788890890.478306:0:8423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1788890890.478324:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788890890.478489:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788890890.478508:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788890890.478551:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788890890.478561:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788890890.478563:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788890890.478912:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788890890.479070:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788890890.479087:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788890890.479100:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:2.0:1788890890.479125:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788890890.479144:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff925091a8a800/0xa66601b03fd52a50 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.479162:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925081522800/0xa66601b03fd5291c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52915 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.479171:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250c214ba00/0xa66601b03fd52993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd5298c expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.479178:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925081523200/0xa66601b03fd529cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd529c4 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.479185:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925091a8a600/0xa66601b03fd529e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd529e0 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.479191:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250813ed600/0xa66601b03fd52a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52a0a expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.479198:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff925091a8a800/0xa66601b03fd52a50 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.479232:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250813ed600/0xa66601b03fd52a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52a0a expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.479246:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250813ed600/0xa66601b03fd52a11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52a0a expref: 18 pid: 6490 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890890.479259:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab52300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875787997266688:0@lo:104: 00000100:00100000:2.0:1788890890.479323:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788890890.479382:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925091a8a600/0xa66601b03fd529e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd529e0 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.479397:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925091a8a600/0xa66601b03fd529e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd529e0 expref: 18 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890890.479407:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab50e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875787997266816:0@lo:104: 00000100:00100000:2.0:1788890890.479430:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788890890.479463:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925081523200/0xa66601b03fd529cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd529c4 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.479472:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925081523200/0xa66601b03fd529cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd529c4 expref: 18 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890890.479481:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab50000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875787997266944:0@lo:104: 00000100:00100000:2.0:1788890890.479502:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788890890.479519:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250c214ba00/0xa66601b03fd52993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd5298c expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.479559:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250c214ba00/0xa66601b03fd52993 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd5298c expref: 18 pid: 6490 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890890.479568:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab50a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875787997267072:0@lo:104: 00000100:00100000:2.0:1788890890.479590:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788890890.479609:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925081522800/0xa66601b03fd5291c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52915 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.479617:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925081522800/0xa66601b03fd5291c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52915 expref: 18 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890890.479625:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab50700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875787997267200:0@lo:104: 00000100:00100000:2.0:1788890890.479663:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890890.479675:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509004a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788890890.479752:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997266688 00000100:00100000:0.0:1788890890.479759:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997266688 00000100:00100000:0.0:1788890890.479792:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997266816 00000100:00100000:0.0:1788890890.479802:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997266816 00000100:00100000:0.0:1788890890.479818:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997266944 00000100:00100000:0.0:1788890890.479820:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997266944 00000100:00100000:0.0:1788890890.479830:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997267072 00000100:00100000:0.0:1788890890.479832:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997267072 00000100:00100000:0.0:1788890890.479841:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997267200 00000100:00100000:0.0:1788890890.479843:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997267200 00000100:00100000:0.0:1788890890.479857:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788890890.479866:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+7:6488:x1875787997266688:12345-0@lo:104: 00010000:00010000:0.0:1788890890.479878:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250813ed800/0xa66601b03fd52a0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52a11 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890890.479950:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788890890.479956:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+7:6488:x1875787997266688:12345-0@lo:104: Request processed in 92us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890890.479964:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788890890.479982:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788890890.479990:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+6:6488:x1875787997266816:12345-0@lo:104: 00010000:00010000:0.0:1788890890.479998:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925081522200/0xa66601b03fd529e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd529e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890890.480027:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788890890.480031:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+6:6488:x1875787997266816:12345-0@lo:104: Request processed in 44us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890890.480037:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788890890.480049:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788890890.480054:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+5:6488:x1875787997266944:12345-0@lo:104: 00010000:00010000:0.0:1788890890.480061:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250c214be00/0xa66601b03fd529c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd529cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890890.480098:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788890890.480103:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+5:6488:x1875787997266944:12345-0@lo:104: Request processed in 50us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890890.480110:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788890890.480122:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788890890.480127:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:6488:x1875787997267072:12345-0@lo:104: 00010000:00010000:0.0:1788890890.480134:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd5298c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52993 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890890.480156:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788890890.480161:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:6488:x1875787997267072:12345-0@lo:104: Request processed in 35us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890890.480167:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788890890.480178:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788890890.480183:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:6488:x1875787997267200:12345-0@lo:104: 00010000:00010000:0.0:1788890890.480190:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd5291c expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890890.480214:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788890890.480219:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:6488:x1875787997267200:12345-0@lo:104: Request processed in 36us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890890.480225:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788890890.480430:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788890890.480436:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250813ed800/0xa66601b03fd52a0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52a11 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480445:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed800 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890890.480448:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250813ed800/0xa66601b03fd52a0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52a11 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480456:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250813ed800/0xa66601b03fd52a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52a11 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890890.480463:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250813ed800/0xa66601b03fd52a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52a11 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890890.480469:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890890.480504:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250813ed800/0xa66601b03fd52a0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52a11 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480511:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890890.480557:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250813ed800/0xa66601b03fd52a0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52a11 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480566:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250813ed800/0xa66601b03fd52a0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52a11 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480578:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788890890.480582:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925081522200/0xa66601b03fd529e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd529e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480597:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522200 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890890.480600:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925081522200/0xa66601b03fd529e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd529e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480606:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925081522200/0xa66601b03fd529e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd529e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890890.480611:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925081522200/0xa66601b03fd529e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd529e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890890.480617:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890890.480630:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925081522200/0xa66601b03fd529e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd529e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480635:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890890.480648:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925081522200/0xa66601b03fd529e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd529e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480653:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925081522200/0xa66601b03fd529e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd529e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480662:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788890890.480666:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250c214be00/0xa66601b03fd529c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd529cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480672:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250c214be00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890890.480675:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250c214be00/0xa66601b03fd529c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd529cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480688:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250c214be00/0xa66601b03fd529c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd529cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890890.480695:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250c214be00/0xa66601b03fd529c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd529cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890890.480701:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890890.480711:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250c214be00/0xa66601b03fd529c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd529cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480716:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890890.480721:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250c214be00/0xa66601b03fd529c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd529cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480727:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250c214be00/0xa66601b03fd529c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd529cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480734:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788890890.480737:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd5298c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52993 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480743:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522a00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890890.480746:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd5298c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52993 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480753:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd5298c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52993 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890890.480758:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd5298c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52993 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890890.480767:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890890.480777:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd5298c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52993 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480782:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890890.480786:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd5298c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52993 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480792:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd5298c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52993 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480800:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788890890.480802:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd5291c expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480807:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030800 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890890.480809:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd5291c expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480815:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52915 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd5291c expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890890.480821:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52915 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd5291c expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890890.480827:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890890.480835:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52915 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd5291c expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480840:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890890.480847:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52915 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd5291c expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480854:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52915 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd5291c expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.480865:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890890.480866:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890890.480868:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890890.480875:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890890.480884:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997267328:0@lo:103: 00000100:00100000:2.0:1788890890.481173:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890890.481241:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997267840:0@lo:103: 00000100:00100000:2.0:1788890890.481261:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890890.485737:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997267456:0@lo:103: 00000100:00100000:3.0:1788890890.485807:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997267712:0@lo:103: 00000100:00100000:3.0:1788890890.485881:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab52300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875787997266688:0@lo:104: 00000100:00100000:3.0:1788890890.485905:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab50e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875787997266816:0@lo:104: 00000100:00100000:3.0:1788890890.485914:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab50000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875787997266944:0@lo:104: 00000100:00100000:3.0:1788890890.485922:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab50a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875787997267072:0@lo:104: 00000100:00100000:3.0:1788890890.485929:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab50700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875787997267200:0@lo:104: 00010000:00010000:3.0:1788890890.485958:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff925091a8a800/0xa66601b03fd52a50 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890890.487605:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997267584:0@lo:103: 00000100:00100000:2.0:1788890890.491664:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890890.492369:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997267328 00000100:00100000:1.0:1788890890.492380:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997267328 00010000:00010000:1.0:1788890890.492420:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250813ed600/0xa66601b03fd52a11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52a0a expref: 19 pid: 6490 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890890.492489:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997267840 00000100:00100000:1.0:1788890890.492493:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997267840 00010000:00010000:1.0:1788890890.492508:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925081522800/0xa66601b03fd5291c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52915 expref: 20 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890890.494251:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890890.494335:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997267712 00000100:00100000:2.0:1788890890.494340:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997267712 00010000:00010000:2.0:1788890890.494361:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250c214ba00/0xa66601b03fd52993 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd5298c expref: 21 pid: 6490 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890890.494377:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997267456 00000100:00100000:2.0:1788890890.494380:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997267456 00010000:00010000:2.0:1788890890.494389:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925091a8a600/0xa66601b03fd529e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd529e0 expref: 22 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890890.494402:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788890890.494411:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:3630:x1875787997267328:12345-0@lo:103: 00010000:00010000:2.0:1788890890.494441:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890890.494507:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250813ed600/0xa66601b03fd52a11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52a0a expref: 22 pid: 6490 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.494547:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250813ed600/0xa66601b03fd52a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52a0a expref: 22 pid: 6490 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.494563:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813ed600/0xa66601b03fd52a11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52a0a expref: 22 pid: 6490 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.494578:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890890.494630:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:3630:x1875787997267328:12345-0@lo:103: Request processed in 220us (13457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890890.494637:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788890890.494653:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788890890.494660:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:3630:x1875787997267840:12345-0@lo:103: 00010000:00010000:2.0:1788890890.494668:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890890.494672:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925081522800/0xa66601b03fd5291c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52915 expref: 20 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.494681:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925081522800/0xa66601b03fd5291c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52915 expref: 20 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.494689:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925081522800/0xa66601b03fd5291c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52915 expref: 20 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.494698:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890890.494717:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:3630:x1875787997267840:12345-0@lo:103: Request processed in 59us (13456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890890.494723:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788890890.494732:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788890890.494750:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:3629:x1875787997267712:12345-0@lo:103: 00010000:00010000:2.0:1788890890.494937:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890890.494943:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250c214ba00/0xa66601b03fd52993 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd5298c expref: 18 pid: 6490 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.494951:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250c214ba00/0xa66601b03fd52993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd5298c expref: 18 pid: 6490 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.494961:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250c214ba00/0xa66601b03fd52993 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd5298c expref: 18 pid: 6490 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.494971:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890890.495001:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:3629:x1875787997267712:12345-0@lo:103: Request processed in 263us (3348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890890.495008:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788890890.495022:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788890890.495028:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:3627:x1875787997267456:12345-0@lo:103: 00010000:00010000:2.0:1788890890.495036:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890890.495040:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925091a8a600/0xa66601b03fd529e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd529e0 expref: 16 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.495048:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925091a8a600/0xa66601b03fd529e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd529e0 expref: 16 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.495057:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8a600/0xa66601b03fd529e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd529e0 expref: 16 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.495066:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890890.495091:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:3627:x1875787997267456:12345-0@lo:103: Request processed in 64us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890890.496850:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788890890.496904:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997267712:0@lo:103: 00000100:00100000:2.0:1788890890.496935:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997267456:0@lo:103: 00000100:00100000:2.0:1788890890.496973:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890890.497010:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997267584 00000100:00100000:2.0:1788890890.497016:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997267584 00010000:00010000:2.0:1788890890.497037:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925081523200/0xa66601b03fd529cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd529c4 expref: 15 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890890.497055:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788890890.497061:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090433c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:3628:x1875787997267584:12345-0@lo:103: 00010000:00010000:2.0:1788890890.497072:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890890.497078:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925081523200/0xa66601b03fd529cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd529c4 expref: 15 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.497087:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925081523200/0xa66601b03fd529cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd529c4 expref: 15 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.497330:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925081523200/0xa66601b03fd529cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd529c4 expref: 15 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.497345:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff925091a8a800/0xa66601b03fd52a50 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.497353:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8a800/0xa66601b03fd52a50 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.497369:0:7436:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925091a8a800/0xa66601b03fd52a50 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.497382:0:7436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925091a8a800/0xa66601b03fd52a50 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.497388:0:7436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff925091a8a800/0xa66601b03fd52a50 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.497395:0:7436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff925091a8a800/0xa66601b03fd52a50 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.497401:0:7436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788890890.497405:0:7436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff925091a8a800/0xa66601b03fd52a50 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.497413:0:7436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff925091a8a800/0xa66601b03fd52a50 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.497891:0:7436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff925091a8a800/0xa66601b03fd52a50 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.497905:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890890.497963:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090433c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:3628:x1875787997267584:12345-0@lo:103: Request processed in 901us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890890.497971:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788890890.498038:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997267584:0@lo:103: 00000100:00100000:2.0:1788890890.498069:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997267328:0@lo:103: 00000100:00100000:2.0:1788890890.498078:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997267840:0@lo:103: 00010000:00010000:3.0:1788890890.498470:0:6488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff925091a8a800/0xa66601b03fd52a50 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890890.498481:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff925091a8a800/0xa66601b03fd52a50 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890890.498488:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8a800/0xa66601b03fd52a50 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788890890.498503:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788890890.501705:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:8402:x1875787997266560:12345-0@lo:253: Request processed in 36890us (44625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890890.501719:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788890890.501766:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090312a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997266560:0@lo:253: 10000000:01000000:2.0:1788890890.501810:0:8402:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788890890.501814:0:8402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788890890.501816:0:8402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788890890.501817:0:8402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788890890.501818:0:8402:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788890890.501820:0:8402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788890890.501822:0:8402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788890890.501825:0:8402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788890890.501828:0:8402:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788890890.504812:0:8402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788890890.504827:0:8402:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788890890.504871:0:8402:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9250ba9ab800 from lustre-OST0000 10000000:01000000:2.0:1788890890.504917:0:8402:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788890890.504922:0:8402:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788890890.504932:0:8402:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff925091ac8000 local copy 10000000:01000000:2.0:1788890890.504937:0:8402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788890890.504993:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.505007:0:8402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.505020:0:8402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890890.505051:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997267968:0@lo:101: 00000100:00100000:2.0:1788890890.505143:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890890.505269:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788890890.505284:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997267968 00000100:00100000:3.0:1788890890.505299:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997267968 00000100:00100000:3.0:1788890890.505375:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788890890.505386:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:8402:x1875787997267968:12345-0@lo:101: 00010000:00010000:3.0:1788890890.505403:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890890.505423:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250813ece00/0xa66601b03fd52a5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52a57 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890890.505467:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813ece00/0xa66601b03fd52a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52a57 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890890.505479:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250813ece00/0xa66601b03fd52a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52a57 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890890.505489:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ece00, rc 0) 00000100:00100000:3.0:1788890890.505596:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:8402:x1875787997267968:12345-0@lo:101: Request processed in 212us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890890.505603:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788890890.506047:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997267968:0@lo:101: 00010000:00010000:2.0:1788890890.506068:0:8402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa66601b03fd52a5e expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.506336:0:8402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa66601b03fd52a5e expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890890.506456:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997268096:0@lo:501: 00000100:00100000:2.0:1788890890.506498:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890890.506554:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788890890.506574:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997268096 00000100:00100000:3.0:1788890890.506581:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997268096 00000100:00100000:3.0:1788890890.506621:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788890890.506629:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:8402:x1875787997268096:12345-0@lo:501: 00000100:00100000:3.0:1788890890.506728:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:8402:x1875787997268096:12345-0@lo:501: Request processed in 99us (229us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788890890.506736:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788890890.506769:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997268096:0@lo:501: 10000000:01000000:0.0:1788890890.506792:0:8402:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788890890.506827:0:8402:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788890890.506833:0:8402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa66601b03fd52a5e expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890890.506842:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa66601b03fd52a5e expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890890.506849:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa66601b03fd52a5e expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890890.506873:0:8402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788890890.506900:0:8402:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9250ba9ab800 10000000:01000000:0.0:1788890890.506905:0:8402:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788890890.506910:0:8402:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788890890.506913:0:8402:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788890890.506918:0:8402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788890890.506921:0:8402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788890890.506944:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925080030000/0xa66601b03fd52a65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890890.506952:0:8402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925080030000/0xa66601b03fd52a65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.506959:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788890890.506960:0:8402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925080030000/0xa66601b03fd52a65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.506965:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xa66601b03fd52a5e expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.506971:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8bc00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890890.506974:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa66601b03fd52a5e expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890890.506977:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997268224:0@lo:101: 00010000:00010000:2.0:1788890890.506983:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa66601b03fd52a5e expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890890.506989:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa66601b03fd52a5e expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890890.506994:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788890890.507008:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788890890.507012:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa66601b03fd52a5e expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.507018:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788890890.507044:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff925088646480 going to sleep for 11 seconds 00000100:00100000:3.0:1788890890.507057:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997268352:0@lo:103: 00000100:00100000:3.0:1788890890.507084:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788890890.507132:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa66601b03fd52a5e expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.507140:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa66601b03fd52a5e expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.507158:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890890.507160:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890890.507162:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890890.507600:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997268352 00000100:00100000:0.0:1788890890.507609:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997268352 00000100:00100000:0.0:1788890890.507645:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788890890.507652:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1262300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:3627:x1875787997268352:12345-0@lo:103: 00010000:00010000:0.0:1788890890.507660:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890890.507671:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813ece00/0xa66601b03fd52a5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd52a57 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890890.507684:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890890.507751:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997268224 00000100:00100000:1.0:1788890890.507756:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997268224 00000100:00100000:1.0:1788890890.507961:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788890890.507970:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:8402:x1875787997268224:12345-0@lo:101: 00010000:00010000:1.0:1788890890.507978:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890890.507989:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250c214b800/0xa66601b03fd52a6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52a65 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890890.508005:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250c214b800/0xa66601b03fd52a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52a65 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890890.508014:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250c214b800/0xa66601b03fd52a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52a65 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890890.508020:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250c214b800, rc 0) 00000100:00100000:1.0:1788890890.508059:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8402:x1875787997268224:12345-0@lo:101: Request processed in 91us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890890.508070:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788890890.508161:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997268224:0@lo:101: 00010000:00010000:2.0:1788890890.508173:0:8402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925080030000/0xa66601b03fd52a65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52a6c expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.508182:0:8402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925080030000/0xa66601b03fd52a65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52a6c expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890890.508245:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997268480:0@lo:501: 00000100:00100000:2.0:1788890890.508281:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890890.508311:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890890.509029:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997268480 00000100:00100000:1.0:1788890890.509034:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997268480 00000100:00100000:1.0:1788890890.509061:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788890890.509068:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8402:x1875787997268480:12345-0@lo:501: 00000100:00100000:1.0:1788890890.509159:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8402:x1875787997268480:12345-0@lo:501: Request processed in 91us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890890.509165:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788890890.509241:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997268480:0@lo:501: 00000100:00100000:2.0:1788890890.509267:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997268608:0@lo:503: 00000100:00100000:2.0:1788890890.509303:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890890.509328:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890890.509365:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997268608 00000100:00100000:1.0:1788890890.509369:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997268608 00000100:00100000:1.0:1788890890.509399:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788890890.509405:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8402:x1875787997268608:12345-0@lo:503: 00000100:00100000:1.0:1788890890.509475:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8402:x1875787997268608:12345-0@lo:503: Request processed in 70us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890890.509482:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788890890.509573:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997268608:0@lo:503: 00000040:00080000:2.0:1788890890.510134:0:8402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788890890.510194:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997268736:0@lo:502: 00000100:00100000:2.0:1788890890.510224:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890890.510240:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890890.510293:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997268736 00000100:00100000:1.0:1788890890.510297:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997268736 00000100:00100000:1.0:1788890890.510325:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788890890.510332:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8402:x1875787997268736:12345-0@lo:502: 00000100:00100000:1.0:1788890890.510400:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8402:x1875787997268736:12345-0@lo:502: Request processed in 68us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890890.510407:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788890890.510558:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997268736:0@lo:502: 00000040:00080000:2.0:1788890890.510738:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788890890.510768:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788890890.510784:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788890890.510796:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788890890.510807:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788890890.510820:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788890890.510840:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997268864:0@lo:502: 00000100:00100000:2.0:1788890890.510870:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890890.510978:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997268864 00000100:00100000:1.0:1788890890.510983:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997268864 00000100:00100000:1.0:1788890890.511007:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788890890.511013:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8402:x1875787997268864:12345-0@lo:502: 00000100:00100000:1.0:1788890890.511075:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8402:x1875787997268864:12345-0@lo:502: Request processed in 62us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890890.511082:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788890890.511966:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890890.511980:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997268864:0@lo:502: 00000040:00080000:2.0:1788890890.512014:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788890890.512022:0:8402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788890890.512355:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788890890.512362:0:8425:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788890890.512369:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890890.512371:0:8425:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788890890.512377:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788890890.512390:0:8425:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff925090b219b8) 00000020:00000080:2.0:1788890890.512409:0:8425:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788890890.512414:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788890890.512479:0:8425:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9250ba9ab800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788890890.512487:0:8425:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788890890.512493:0:8425:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa66601b03fd52a7a 00000100:00100000:0.0:1788890890.513995:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1262300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:3627:x1875787997268352:12345-0@lo:103: Request processed in 6338us (6905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890890.514006:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788890890.520148:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997268352:0@lo:103: 00010000:00010000:2.0:1788890890.521120:0:8425:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1788890890.521395:0:8425:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788890890.527204:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788890890.527639:0:8425:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788890890.537064:0:8425:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788890890.537238:0:8425:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788890890.547381:0:8425:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788890890.550951:0:8425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788890890.550962:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890890.550968:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890890.550971:0:8425:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788890890.550975:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890890.550978:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890890.550980:0:8425:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788890890.550982:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788890890.550984:0:8425:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788890890.551008:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890890.551011:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890890.551013:0:8425:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788890890.551016:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788890890.551103:0:8402:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788890890.551130:0:8402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788890890.551155:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925080030000/0xa66601b03fd52a65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52a6c expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890890.551166:0:8402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925080030000/0xa66601b03fd52a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52a6c expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890890.551174:0:8402:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9250ba9ab800 from 1 10000000:01000000:0.0:1788890890.551178:0:8402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788890890.551211:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925080031800/0xa66601b03fd52a81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890890.551219:0:8402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925080031800/0xa66601b03fd52a81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890890.551230:0:8402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925080031800/0xa66601b03fd52a81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890890.551252:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997268992:0@lo:101: 00000100:00100000:0.0:1788890890.551323:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890890.551365:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff925088646300 going to sleep for 11 seconds 00000100:00100000:0.0:1788890890.551386:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997268992 00000100:00100000:0.0:1788890890.551393:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997268992 00000100:00100000:0.0:1788890890.551431:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788890890.551456:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:8402:x1875787997268992:12345-0@lo:101: 00010000:00010000:0.0:1788890890.551469:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890890.551479:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925080030a00/0xa66601b03fd52a88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52a81 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890890.551498:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925080030a00/0xa66601b03fd52a88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52a81 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890890.551507:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925080030a00/0xa66601b03fd52a88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52a81 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890890.551516:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080030a00, rc 0) 00000100:00100000:0.0:1788890890.551576:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8402:x1875787997268992:12345-0@lo:101: Request processed in 121us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890890.551583:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788890890.551625:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997268992:0@lo:101: 00010000:00010000:0.0:1788890890.551638:0:8402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925080031800/0xa66601b03fd52a81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52a88 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890890.551647:0:8402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925080031800/0xa66601b03fd52a81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52a88 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890890.551718:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997269120:0@lo:501: 00000100:00100000:0.0:1788890890.551749:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890890.551769:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff925088646300 going to sleep for 11 seconds 00000100:00100000:2.0:1788890890.552795:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997269120 00000100:00100000:2.0:1788890890.552807:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997269120 00000100:00100000:2.0:1788890890.552839:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788890890.552847:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8402:x1875787997269120:12345-0@lo:501: 00000100:00100000:2.0:1788890890.552952:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8402:x1875787997269120:12345-0@lo:501: Request processed in 106us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890890.552959:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788890890.553174:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997269120:0@lo:501: 00000100:00100000:0.0:1788890890.553207:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997269248:0@lo:503: 00000100:00100000:0.0:1788890890.553246:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890890.553274:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff925088646300 going to sleep for 11 seconds 00000100:00100000:2.0:1788890890.556066:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997269248 00000100:00100000:2.0:1788890890.556076:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997269248 00000100:00100000:2.0:1788890890.556146:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788890890.556155:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8402:x1875787997269248:12345-0@lo:503: 00000100:00100000:2.0:1788890890.556506:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8402:x1875787997269248:12345-0@lo:503: Request processed in 351us (3259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890890.556514:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788890890.556559:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997269248:0@lo:503: 00000040:00080000:1.0:1788890890.556790:0:8402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788890890.556868:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090311500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997269376:0@lo:502: 00000100:00100000:1.0:1788890890.556910:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890890.556944:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b6854a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788890890.556971:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997269376 00000100:00100000:2.0:1788890890.556976:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997269376 00000100:00100000:2.0:1788890890.557008:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788890890.557015:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8402:x1875787997269376:12345-0@lo:502: 00000100:00100000:2.0:1788890890.557092:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8402:x1875787997269376:12345-0@lo:502: Request processed in 76us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890890.557099:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788890890.557123:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090311500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997269376:0@lo:502: 00000040:00080000:1.0:1788890890.557276:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788890890.557299:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788890890.557315:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090311500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997269504:0@lo:502: 00000100:00100000:1.0:1788890890.557345:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890890.557366:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b6854a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788890890.557787:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997269504 00000100:00100000:2.0:1788890890.557792:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997269504 00000100:00100000:2.0:1788890890.557823:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788890890.557829:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8402:x1875787997269504:12345-0@lo:502: 00000100:00100000:2.0:1788890890.557962:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8402:x1875787997269504:12345-0@lo:502: Request processed in 132us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890890.557968:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788890890.561590:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090311500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997269504:0@lo:502: 00000040:00080000:0.0:1788890890.561812:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788890890.561826:0:8402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788890890.564000:0:8429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788890890.564009:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890890.564011:0:8429:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788890890.564018:0:8429:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9250ba9ab800 00000020:00000080:0.0:1788890890.564021:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788890890.564031:0:8429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788890890.564034:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890890.564035:0:8429:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788890890.564038:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788890890.567805:0:8402:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788890890.567844:0:8402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788890890.568046:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925080031800/0xa66601b03fd52a81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52a88 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.568061:0:8402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925080031800/0xa66601b03fd52a81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52a88 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890890.568131:0:8402:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788890890.568134:0:8402:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9250ba9ab800 10000000:01000000:2.0:1788890890.568137:0:8402:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9250ba9ab800 10000000:01000000:2.0:1788890890.568140:0:8402:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788890890.568147:0:8402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9250ba9ab800 from 1 10000000:01000000:2.0:1788890890.568149:0:8402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788890890.568182:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.568192:0:8402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.568202:0:8402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890890.568224:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997269632:0@lo:101: 00000100:00100000:2.0:1788890890.568285:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890890.568329:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788890890.568329:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997269632 00000100:00100000:1.0:1788890890.568336:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997269632 00000100:00100000:1.0:1788890890.568380:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788890890.568389:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8402:x1875787997269632:12345-0@lo:101: 00010000:00010000:1.0:1788890890.568401:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890890.568413:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250c214ba00/0xa66601b03fd52a96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52a8f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890890.568435:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250c214ba00/0xa66601b03fd52a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52a8f expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890890.568595:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250c214ba00/0xa66601b03fd52a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52a8f expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890890.568604:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250c214ba00, rc 0) 00000100:00100000:1.0:1788890890.568651:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:8402:x1875787997269632:12345-0@lo:101: Request processed in 262us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890890.568658:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788890890.568968:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997269632:0@lo:101: 00010000:00010000:3.0:1788890890.568984:0:8402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52a96 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890890.568992:0:8402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52a96 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890890.569090:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1263800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997269760:0@lo:501: 00000100:00100000:3.0:1788890890.569116:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890890.569145:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c0a62cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890890.569205:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997269760 00000100:00100000:2.0:1788890890.569210:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997269760 00000100:00100000:2.0:1788890890.569238:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788890890.569245:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:8402:x1875787997269760:12345-0@lo:501: 00000100:00100000:2.0:1788890890.569351:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:8402:x1875787997269760:12345-0@lo:501: Request processed in 106us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890890.569359:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788890890.569844:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1263800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997269760:0@lo:501: 00000100:00100000:3.0:1788890890.569871:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1263800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997269888:0@lo:503: 00000100:00100000:3.0:1788890890.570037:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890890.570062:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c0a62cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890890.570113:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997269888 00000100:00100000:2.0:1788890890.570117:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997269888 00000100:00100000:2.0:1788890890.570148:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788890890.570155:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:8402:x1875787997269888:12345-0@lo:503: 00000100:00100000:2.0:1788890890.570238:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:8402:x1875787997269888:12345-0@lo:503: Request processed in 83us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890890.570246:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788890890.570807:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1263800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997269888:0@lo:503: 00000040:00080000:0.0:1788890890.571087:0:8402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788890890.571142:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997270016:0@lo:502: 00000100:00100000:0.0:1788890890.571178:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890890.571199:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff925088646c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788890890.571250:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997270016 00000100:00100000:2.0:1788890890.571254:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997270016 00000100:00100000:2.0:1788890890.571285:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788890890.571292:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:8402:x1875787997270016:12345-0@lo:502: 00000100:00100000:2.0:1788890890.571367:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:8402:x1875787997270016:12345-0@lo:502: Request processed in 74us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890890.571374:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788890890.571514:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997270016:0@lo:502: 00000040:00080000:0.0:1788890890.573037:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788890890.573069:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788890890.573087:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788890890.573100:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788890890.573112:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788890890.573133:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788890890.573147:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788890890.573161:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788890890.573190:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788890890.573202:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788890890.573213:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788890890.573225:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788890890.573240:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788890890.573256:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788890890.573268:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788890890.573281:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788890890.573291:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788890890.573305:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788890890.573320:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788890890.573334:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788890890.573346:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788890890.573357:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788890890.573370:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788890890.573385:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788890890.573400:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788890890.573413:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788890890.573425:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788890890.573437:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788890890.573451:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788890890.573482:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788890890.573501:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788890890.573776:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788890890.573795:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788890890.573810:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788890890.573826:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788890890.573840:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788890890.573852:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1788890890.573878:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997270144:0@lo:502: 00000100:00100000:0.0:1788890890.574838:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890890.574878:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff925088646c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788890890.575003:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997270144 00000100:00100000:2.0:1788890890.575009:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997270144 00000100:00100000:2.0:1788890890.575046:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788890890.575054:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:8402:x1875787997270144:12345-0@lo:502: 00000100:00100000:2.0:1788890890.575152:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:8402:x1875787997270144:12345-0@lo:502: Request processed in 99us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890890.575159:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788890890.575245:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997270144:0@lo:502: 00000040:00080000:0.0:1788890890.575291:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788890890.575300:0:8402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788890890.586155:0:8430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788890890.586181:0:8430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff924f81ed3370) 00000020:00000080:3.0:1788890890.586221:0:8430:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788890890.586301:0:8430:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9250ba9ab800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788890890.586306:0:8430:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9250ba9ab800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788890890.586308:0:8430:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9250ba9ab800 3 00010000:00080000:3.0:1788890890.586338:0:8430:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f81ede000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.126@tcp at head 00010000:00010000:2.0:1788890890.592450:0:8430:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1788890890.592812:0:8430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788890890.592870:0:8430:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788890890.592885:0:8430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa66601b03fd52aa4 00000100:00080000:2.0:1788890890.592956:0:8430:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788890890.592962:0:8430:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff924f81ede000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788890890.592999:0:8430:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9250c12a5f80 x1875787997270272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788890890.593015:0:8430:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788890890.596297:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1875787997270272:0@lo:38: 00000100:00100000:3.0:1788890890.596379:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890890.596588:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997270272 00000100:00100000:2.0:1788890890.596596:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997270272 00000100:00100000:2.0:1788890890.596632:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788890890.596639:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1875787997270272:12345-0@lo:38: 00010000:00080000:2.0:1788890890.596663:0:6495:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 112 last 0 00000020:00000080:2.0:1788890890.596706:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa66601b03fd52aab 00000004:00100000:2.0:1788890890.596720:0:6495:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788890890.596748:0:6495:0:(import.c:65:import_set_state_nolock()) ffff924f81c26000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788890890.596794:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875787997270272:12345-0@lo:38: Request processed in 154us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890890.596800:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1788890890.596910:0:8430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788890890.596923:0:8430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff925090b23370) 00000020:00000080:2.0:1788890890.596938:0:8430:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1788890890.597026:0:8430:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9250ba9ab800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788890890.597030:0:8430:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9250ba9ab800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788890890.597032:0:8430:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9250ba9ab800 3 00010000:00080000:2.0:1788890890.597058:0:8430:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f81c24800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.126@tcp at head 00010000:00010000:2.0:1788890890.599132:0:8430:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00010000:00080000:3.0:1788890890.599275:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9250c12a5f80 x1875787997270272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788890900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890890.599288:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788890890.599296:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788890890.599304:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788890890.599309:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788890890.599312:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f81ede000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788890890.599318:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1875787997270272:0@lo:38: 00000100:00100000:3.0:1788890890.600242:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788890890.600254:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1260e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997270400:0@lo:400: 00000100:00100000:3.0:1788890890.600306:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890890.600350:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997270400 00000100:00100000:3.0:1788890890.600355:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997270400 00000100:00100000:3.0:1788890890.600393:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788890890.600403:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997270400:12345-0@lo:400: 00000100:00100000:3.0:1788890890.600447:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997270400:12345-0@lo:400: Request processed in 44us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890890.600454:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788890890.600485:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9250c1260e00 x1875787997270400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890890.600496:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1260e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997270400:0@lo:400: 00000100:00100000:3.0:1788890890.600559:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1260e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997270528:0@lo:400: 00000100:00100000:3.0:1788890890.600584:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890890.600617:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997270528 00000100:00100000:3.0:1788890890.600622:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997270528 00000100:00100000:3.0:1788890890.600643:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788890890.600649:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997270528:12345-0@lo:400: 00000100:00100000:3.0:1788890890.600684:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997270528:12345-0@lo:400: Request processed in 36us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890890.600690:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788890890.600726:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9250c1260e00 x1875787997270528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890890.600736:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1260e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997270528:0@lo:400: 00000100:00100000:3.0:1788890890.600780:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1260e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997270656:0@lo:400: 00000100:00100000:3.0:1788890890.600807:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890890.600837:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997270656 00000100:00100000:3.0:1788890890.600841:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997270656 00000100:00100000:3.0:1788890890.600863:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788890890.600868:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997270656:12345-0@lo:400: 00000100:00100000:3.0:1788890890.600918:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997270656:12345-0@lo:400: Request processed in 49us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890890.600924:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788890890.600948:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1260e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997270656:0@lo:400: 00000020:00000080:2.0:1788890890.605825:0:8430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788890890.605873:0:8430:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788890890.605898:0:8430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xa66601b03fd52ab9 00000100:00080000:2.0:1788890890.605918:0:8430:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788890890.605924:0:8430:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff924f81c24800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788890890.605959:0:8430:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9250c12a4000 x1875787997270784/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788890890.605987:0:8430:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788890890.606201:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3626:1875787997270784:0@lo:38: 00000100:00100000:3.0:1788890890.606264:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890890.606975:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997270784 00000100:00100000:2.0:1788890890.606982:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997270784 00000100:00100000:2.0:1788890890.607016:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788890890.607024:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1875787997270784:12345-0@lo:38: 00010000:00080000:2.0:1788890890.607047:0:6495:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 112 last 0 00000020:00000080:2.0:1788890890.607090:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xa66601b03fd52ac0 00000004:00100000:2.0:1788890890.607105:0:6495:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788890890.607133:0:6495:0:(import.c:65:import_set_state_nolock()) ffff924f8216a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788890890.607185:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875787997270784:12345-0@lo:38: Request processed in 160us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890890.607192:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788890890.607228:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9250c12a4000 x1875787997270784/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788890900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890890.607238:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788890890.607246:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788890890.607253:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788890890.607257:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788890890.607259:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f81c24800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788890890.607265:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3626:1875787997270784:0@lo:38: 00000040:00080000:2.0:1788890890.607348:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1788890890.619071:0:8402:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788890890.619112:0:8402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788890890.619174:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52a96 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890890.619186:0:8402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52a96 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788890890.619236:0:8402:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788890890.619238:0:8402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788890890.619240:0:8402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788890890.619241:0:8402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788890890.619242:0:8402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788890890.619244:0:8402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788890890.619246:0:8402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788890890.619247:0:8402:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788890890.619248:0:8402:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788890890.619250:0:8402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788890890.619251:0:8402:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788890890.619255:0:8402:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788890890.619257:0:8402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788890890.619258:0:8402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788890890.619259:0:8402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788890890.619260:0:8402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788890890.619261:0:8402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788890890.619262:0:8402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788890890.619263:0:8402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788890890.619264:0:8402:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788890890.619265:0:8402:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788890890.619266:0:8402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788890890.619272:0:8402:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788890890.619302:0:8402:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788890890.619319:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997270912:0@lo:253: 00000100:00100000:0.0:1788890890.619385:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890890.619428:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff925088646840 going to sleep for 11 seconds 00000100:00100000:2.0:1788890890.620471:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997270912 00000100:00100000:2.0:1788890890.620486:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997270912 00000100:00100000:2.0:1788890890.620556:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788890890.620566:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:8402:x1875787997270912:12345-0@lo:253: 20000000:01000000:2.0:1788890890.620593:0:6488:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788890890.620606:0:6488:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788890890.626470:0:6488:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788890890.626498:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788890890.626645:0:6511:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788890890.626656:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788890890.626679:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ac7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890890.626699:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925081523800/0xa66601b03fd529bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd529b6 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890890.626708:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925080031200/0xa66601b03fd529d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd529d2 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890890.626716:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ac7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890890.626775:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925080031200/0xa66601b03fd529d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd529d2 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890890.626790:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925080031200/0xa66601b03fd529d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd529d2 expref: 16 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890890.626807:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090311500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6511:1875787997271040:0@lo:104: 00000100:00100000:1.0:1788890890.626870:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890890.626994:0:6480:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788890890.627018:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997271040 00000100:00100000:2.0:1788890890.627026:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997271040 00000100:00100000:2.0:1788890890.627068:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788890890.627077:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b660c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:6511:x1875787997271040:12345-0@lo:104: 00010000:00010000:2.0:1788890890.627090:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925091a8be00/0xa66601b03fd529d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd529d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890890.632227:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:8402:x1875787997270912:12345-0@lo:253: Request processed in 11648us (12827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890890.632247:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788890890.632366:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8402:1875787997270912:0@lo:253: 10000000:01000000:0.0:1788890890.632385:0:8402:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788890890.632389:0:8402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788890890.632392:0:8402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788890890.632393:0:8402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788890890.632394:0:8402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788890890.632395:0:8402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788890890.632397:0:8402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788890890.632398:0:8402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788890890.632400:0:8402:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788890890.632402:0:8402:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788890890.632404:0:8402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788890890.632406:0:8402:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788890890.632423:0:8402:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788890890.633650:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788890890.633665:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b660c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:6511:x1875787997271040:12345-0@lo:104: Request processed in 6585us (6792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890890.633677:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1788890890.633749:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788890890.633756:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8be00/0xa66601b03fd529d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd529d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.633767:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8be00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890890.633771:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8be00/0xa66601b03fd529d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd529d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.633783:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8be00/0xa66601b03fd529d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd529d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890890.633792:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8be00/0xa66601b03fd529d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd529d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890890.633809:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890890.633855:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925091a8be00/0xa66601b03fd529d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd529d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.633862:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890890.633955:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8be00/0xa66601b03fd529d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd529d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.633964:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8be00/0xa66601b03fd529d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd529d9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.633976:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890890.633978:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890890.633979:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890890.633987:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788890890.634003:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997271168:0@lo:103: 00000100:00100000:2.0:1788890890.634042:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890890.634090:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997271168 00000100:00100000:2.0:1788890890.634096:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997271168 00010000:00010000:2.0:1788890890.634118:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925080031200/0xa66601b03fd529d9 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd529d2 expref: 16 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890890.634144:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788890890.634152:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:3628:x1875787997271168:12345-0@lo:103: 00010000:00010000:2.0:1788890890.634164:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890890.634168:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925080031200/0xa66601b03fd529d9 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd529d2 expref: 16 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.634179:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925080031200/0xa66601b03fd529d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd529d2 expref: 16 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.634201:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890890.634233:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:3628:x1875787997271168:12345-0@lo:103: Request processed in 82us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890890.634240:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788890890.634277:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997271168:0@lo:103: 00010000:00010000:1.0:1788890890.634385:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925081523800/0xa66601b03fd529bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd529b6 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890890.634398:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925081523800/0xa66601b03fd529bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd529b6 expref: 15 pid: 6488 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890890.634408:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090312a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6511:1875787997271296:0@lo:104: 00000100:00100000:1.0:1788890890.634433:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890890.634446:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250908c60c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788890890.634457:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925080031200/0xa66601b03fd529d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd529d2 expref: 15 pid: 6491 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890890.634468:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090311500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6511:1875787997271040:0@lo:104: 00000100:00100000:2.0:1788890890.634548:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997271296 00000100:00100000:2.0:1788890890.634553:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997271296 00000100:00100000:2.0:1788890890.634580:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788890890.634588:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090312680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:6511:x1875787997271296:12345-0@lo:104: 00010000:00010000:2.0:1788890890.634597:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250c214a400/0xa66601b03fd529b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd529bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.634632:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788890890.634637:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090312680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:6511:x1875787997271296:12345-0@lo:104: Request processed in 51us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890890.634643:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788890890.634658:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788890890.634663:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250c214a400/0xa66601b03fd529b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd529bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.634670:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250c214a400 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890890.634673:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250c214a400/0xa66601b03fd529b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd529bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.634679:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250c214a400/0xa66601b03fd529b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd529bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890890.634697:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250c214a400/0xa66601b03fd529b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd529bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890890.634702:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890890.634722:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250c214a400/0xa66601b03fd529b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd529bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.634728:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890890.634737:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250c214a400/0xa66601b03fd529b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd529bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.634743:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250c214a400/0xa66601b03fd529b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd529bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.634756:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890890.634757:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890890.634759:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890890.634770:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997271424:0@lo:103: 00000100:00100000:2.0:1788890890.634794:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890890.634820:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997271424 00000100:00100000:2.0:1788890890.634824:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997271424 00010000:00010000:2.0:1788890890.634835:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925081523800/0xa66601b03fd529bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd529b6 expref: 15 pid: 6488 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890890.634854:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788890890.634860:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:3628:x1875787997271424:12345-0@lo:103: 00010000:00010000:2.0:1788890890.634868:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890890.634872:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925081523800/0xa66601b03fd529bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd529b6 expref: 15 pid: 6488 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.635092:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925081523800/0xa66601b03fd529bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd529b6 expref: 15 pid: 6488 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.635107:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ac7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.635116:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ac7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788890890.635129:0:7436:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008474286s 00010000:00010000:2.0:1788890890.635133:0:7436:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ac7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.635139:0:7436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ac7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.635147:0:7436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ac7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.635152:0:7436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ac7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.635158:0:7436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250c214be00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788890890.635162:0:7436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ac7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.635170:0:7436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ac7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.635179:0:7436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ac7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.635198:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890890.635222:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:3628:x1875787997271424:12345-0@lo:103: Request processed in 362us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890890.635229:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788890890.635259:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925081523800/0xa66601b03fd529bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd529b6 expref: 14 pid: 6488 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890890.635270:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090312a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6511:1875787997271296:0@lo:104: 00010000:00010000:2.0:1788890890.635284:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ac7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.635292:0:6511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ac7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.635299:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ac7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890890.635305:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ac7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890890.635360:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997271424:0@lo:103: 00080000:10000000:1.0:1788890890.644174:0:8402:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788890890.644348:0:8402:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788890890.644589:0:8402:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788890890.644755:0:8402:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788890890.644978:0:8402:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788890890.645160:0:8402:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788890890.652110:0:8402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788890890.676864:0:8402:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788890890.676874:0:8402:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788890890.676976:0:8402:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788890890.677023:0:8402:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788890890.677047:0:8402:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788890890.677073:0:8402:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788890890.679305:0:8402:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788890890.679996:0:8402:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788890891.196109:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788890891.696965:0:8486:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788890891.697220:0:8486:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788890892.221851:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890893.253682:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788890893.567660:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788890893.567668:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92508475e000 from 30 10000000:01000000:3.0:1788890893.567674:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788890893.567717:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ec400/0xa66601b03fd52ace lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890893.567730:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250813ec400/0xa66601b03fd52ace lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890893.567742:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250813ec400/0xa66601b03fd52ace lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890893.567765:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1262d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997271552:0@lo:101: 00000100:00100000:3.0:1788890893.567832:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890893.567879:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508630d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788890893.569419:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997271552 00000100:00100000:1.0:1788890893.569429:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997271552 00000100:00100000:1.0:1788890893.569496:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788890893.569505:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:6493:x1875787997271552:12345-0@lo:101: 00010000:00010000:1.0:1788890893.569519:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890893.569552:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ad5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52ace expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890893.569575:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52ace expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890893.569585:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52ace expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890893.569594:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250c214be00, rc 0) 00000100:00100000:1.0:1788890893.569651:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:6493:x1875787997271552:12345-0@lo:101: Request processed in 147us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890893.569657:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788890893.569710:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1262d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997271552:0@lo:101: 00010000:00010000:1.0:1788890893.569736:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250813ec400/0xa66601b03fd52ace lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890893.569745:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250813ec400/0xa66601b03fd52ace lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890893.569811:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997271680:0@lo:501: 00000100:00100000:1.0:1788890893.569839:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890893.575964:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b6854480 going to sleep for 11 seconds 00000100:00100000:3.0:1788890893.576272:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997271680 00000100:00100000:3.0:1788890893.576281:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997271680 00000100:00100000:3.0:1788890893.576344:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788890893.576354:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:6493:x1875787997271680:12345-0@lo:501: 00000100:00100000:3.0:1788890893.576546:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:6493:x1875787997271680:12345-0@lo:501: Request processed in 193us (6705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890893.576554:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788890893.578458:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997271680:0@lo:501: 00000100:00100000:0.0:1788890893.578546:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997271808:0@lo:503: 00000100:00100000:0.0:1788890893.578604:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890893.578630:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab18d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788890893.578723:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997271808 00000100:00100000:2.0:1788890893.578729:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997271808 00000100:00100000:2.0:1788890893.578763:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788890893.578771:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:6493:x1875787997271808:12345-0@lo:503: 00000100:00100000:2.0:1788890893.578865:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:6493:x1875787997271808:12345-0@lo:503: Request processed in 94us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890893.578873:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788890893.585079:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997271808:0@lo:503: 00000100:00100000:0.0:1788890893.585321:0:8573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8573:1875787997271936:0@lo:502: 00000100:00100000:0.0:1788890893.585406:0:8573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890893.585443:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997271936 00000100:00100000:0.0:1788890893.585450:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997271936 00000100:00100000:0.0:1788890893.585503:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788890893.585512:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8573:x1875787997271936:12345-0@lo:502: 00000100:00100000:0.0:1788890893.585638:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8573:x1875787997271936:12345-0@lo:502: Request processed in 126us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890893.585646:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788890893.587704:0:8573:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab18900 going to sleep for 11 seconds 00000100:00100000:0.0:1788890893.587733:0:8573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8573:1875787997271936:0@lo:502: 00000100:00100000:0.0:1788890893.587787:0:8573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8573:1875787997272064:0@lo:502: 00000100:00100000:0.0:1788890893.587837:0:8573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890893.587865:0:8573:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab18900 going to sleep for 11 seconds 00000100:00100000:1.0:1788890893.587972:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997272064 00000100:00100000:1.0:1788890893.587977:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997272064 00000100:00100000:1.0:1788890893.588017:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788890893.588025:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8573:x1875787997272064:12345-0@lo:502: 00000100:00100000:1.0:1788890893.588135:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:8573:x1875787997272064:12345-0@lo:502: Request processed in 110us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890893.588142:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788890893.588214:0:8573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8573:1875787997272064:0@lo:502: 00000040:00080000:2.0:1788890893.588234:0:8573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788890893.588386:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788890893.588408:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788890893.588418:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ec400/0xa66601b03fd52ace lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890893.588429:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250813ec400/0xa66601b03fd52ace lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890893.588439:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788890893.588442:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92508475e000 from 5 10000000:01000000:1.0:1788890893.588445:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788890893.588484:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250c214b400/0xa66601b03fd52adc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890893.588504:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250c214b400/0xa66601b03fd52adc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890893.588514:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250c214b400/0xa66601b03fd52adc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890893.588644:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090311180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997272192:0@lo:101: 00000100:00100000:1.0:1788890893.588674:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890893.588697:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b68543c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890893.588772:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997272192 00000100:00100000:2.0:1788890893.588777:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997272192 00000100:00100000:2.0:1788890893.588800:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788890893.588807:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:6493:x1875787997272192:12345-0@lo:101: 00010000:00010000:2.0:1788890893.588815:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890893.588828:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8b600/0xa66601b03fd52ae3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52adc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890893.588848:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8b600/0xa66601b03fd52ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52adc expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890893.588859:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8b600/0xa66601b03fd52ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52adc expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890893.588868:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8b600, rc 0) 00000100:00100000:2.0:1788890893.588899:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997272192:12345-0@lo:101: Request processed in 93us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890893.588905:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788890893.588973:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090311180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997272192:0@lo:101: 00010000:00010000:1.0:1788890893.588985:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250c214b400/0xa66601b03fd52adc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890893.588994:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250c214b400/0xa66601b03fd52adc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890893.589038:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090311180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997272320:0@lo:256: 00000100:00100000:1.0:1788890893.589068:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890893.589087:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b68543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890893.589099:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997272320 00000100:00100000:1.0:1788890893.589103:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997272320 00000100:00100000:1.0:1788890893.589120:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788890893.589126:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997272320:12345-0@lo:256: 20000000:01000000:1.0:1788890893.589139:0:6491:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788890893.589155:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788890893.589158:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788890893.589232:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997272320:12345-0@lo:256: Request processed in 105us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890893.589245:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788890893.589276:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090311180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997272320:0@lo:256: 10000000:01000000:1.0:1788890893.589314:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788890893.589320:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250c214b400/0xa66601b03fd52adc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890893.589328:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250c214b400/0xa66601b03fd52adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890893.589335:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788890893.589338:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1788890893.589340:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788890893.589355:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250c214b200/0xa66601b03fd52aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890893.589363:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250c214b200/0xa66601b03fd52aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890893.589370:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250c214b200/0xa66601b03fd52aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890893.589382:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090311180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997272448:0@lo:101: 00000100:00100000:1.0:1788890893.589407:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890893.589420:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b68543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890893.589432:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997272448 00000100:00100000:1.0:1788890893.589435:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997272448 00000100:00100000:1.0:1788890893.589452:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788890893.589458:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997272448:12345-0@lo:101: 00010000:00010000:1.0:1788890893.589486:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890893.589494:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250c214ac00/0xa66601b03fd52af1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52aea expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890893.589508:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250c214ac00/0xa66601b03fd52af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52aea expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890893.589517:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250c214ac00/0xa66601b03fd52af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52aea expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890893.589549:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250c214ac00, rc 0) 00000100:00100000:1.0:1788890893.589579:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997272448:12345-0@lo:101: Request processed in 121us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890893.589586:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788890893.589615:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090311180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997272448:0@lo:101: 00010000:00010000:1.0:1788890893.589625:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250c214b200/0xa66601b03fd52aea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52af1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890893.589632:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250c214b200/0xa66601b03fd52aea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52af1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890893.589677:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090311180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997272576:0@lo:501: 00000100:00100000:1.0:1788890893.589700:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890893.589714:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b68543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890893.589725:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997272576 00000100:00100000:1.0:1788890893.589728:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997272576 00000100:00100000:1.0:1788890893.589745:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788890893.589751:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997272576:12345-0@lo:501: 00000100:00100000:1.0:1788890893.589858:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997272576:12345-0@lo:501: Request processed in 107us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890893.589866:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788890893.589893:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090311180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997272576:0@lo:501: 00000100:00100000:1.0:1788890893.589917:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090311180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997272704:0@lo:503: 00000100:00100000:1.0:1788890893.589952:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890893.589965:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b68543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890893.589976:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997272704 00000100:00100000:1.0:1788890893.589979:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997272704 00000100:00100000:1.0:1788890893.589996:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788890893.590002:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997272704:12345-0@lo:503: 00000100:00100000:1.0:1788890893.590085:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997272704:12345-0@lo:503: Request processed in 82us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890893.590091:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788890893.590127:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090311180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997272704:0@lo:503: 00000100:00100000:1.0:1788890893.590285:0:8574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090311180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8574:1875787997272832:0@lo:502: 00000100:00100000:1.0:1788890893.590318:0:8574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890893.590336:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997272832 00000100:00100000:1.0:1788890893.590340:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997272832 00000100:00100000:1.0:1788890893.590358:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788890893.590364:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:8574:x1875787997272832:12345-0@lo:502: 00000100:00100000:1.0:1788890893.590432:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:8574:x1875787997272832:12345-0@lo:502: Request processed in 68us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890893.590440:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788890893.590480:0:8574:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab15cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890893.590498:0:8574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090311180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8574:1875787997272832:0@lo:502: 00000020:01000000:1.0:1788890893.590518:0:8574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788890893.590544:0:8574:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788890893.590551:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890893.590554:0:8574:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788890893.590562:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788890893.590566:0:8574:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:1.0:1788890893.590588:0:8574:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788890893.590591:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788890893.590605:0:8574:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9250ba8899b8) 00000020:00000080:1.0:1788890893.590623:0:8574:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1788890893.590628:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788890893.590699:0:8574:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788890893.590706:0:8574:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788890893.590714:0:8574:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa66601b03fd52aff 00010000:00080000:1.0:1788890893.590741:0:8574:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9250c1537000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1788890893.590958:0:8574:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788890893.631162:0:8574:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788890893.631185:0:8574:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788890893.631393:0:8574:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788890893.631628:0:8574:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788890893.631791:0:8574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788890893.631880:0:8574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788890893.634899:0:8585:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788890893.634906:0:8585:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788890893.653199:0:8574:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788890893.653213:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788890893.653256:0:8574:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788890893.653279:0:8574:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd52b06 00000100:00080000:0.0:1788890893.653288:0:8574:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788890893.653293:0:8574:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9250c1537000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788890893.653325:0:8574:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9250a4884e00 x1875787997272960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788890893.653359:0:8574:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788890893.653412:0:8574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788890893.653417:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890893.653419:0:8574:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788890893.653422:0:8574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788890893.653425:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890893.653426:0:8574:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788890893.653429:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788890893.653430:0:8574:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788890893.653458:0:8574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8574:1875787997273088:0@lo:502: 00000100:00100000:0.0:1788890893.653564:0:8574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890893.653601:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997273088 00000100:00100000:0.0:1788890893.653607:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997273088 00000100:00100000:0.0:1788890893.653651:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788890893.653661:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:8574:x1875787997273088:12345-0@lo:502: 00000100:00100000:0.0:1788890893.653766:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:8574:x1875787997273088:12345-0@lo:502: Request processed in 106us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890893.653774:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788890893.653964:0:8574:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890893.653986:0:8574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8574:1875787997273088:0@lo:502: 00000020:01000000:0.0:1788890893.654010:0:8574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788890893.654015:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890893.654017:0:8574:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788890893.654020:0:8574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1788890893.654071:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1788890893.654089:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788890893.654097:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250c214b200/0xa66601b03fd52aea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52af1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890893.654120:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250c214b200/0xa66601b03fd52aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52af1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890893.654130:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788890893.654132:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92509099a000 from 30 10000000:01000000:0.0:1788890893.654135:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788890893.654158:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52b0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890893.654165:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52b0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890893.654173:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52b0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890893.654184:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997273216:0@lo:101: 00000100:00100000:0.0:1788890893.654210:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890893.654226:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890893.654240:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997273216 00000100:00100000:0.0:1788890893.654243:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997273216 00000100:00100000:0.0:1788890893.654265:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788890893.654272:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997273216:12345-0@lo:101: 00010000:00010000:0.0:1788890893.654281:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890893.654292:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925080031c00/0xa66601b03fd52b14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52b0d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890893.654313:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925080031c00/0xa66601b03fd52b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52b0d expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890893.654335:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925080031c00/0xa66601b03fd52b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52b0d expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890893.654344:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080031c00, rc 0) 00000100:00100000:0.0:1788890893.654375:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997273216:12345-0@lo:101: Request processed in 103us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890893.654381:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788890893.654411:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997273216:0@lo:101: 00010000:00010000:0.0:1788890893.654423:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52b0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890893.654431:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52b0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890893.654499:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997273344:0@lo:501: 00000100:00100000:0.0:1788890893.654522:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890893.654550:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890893.654561:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997273344 00000100:00100000:0.0:1788890893.654564:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997273344 00000100:00100000:0.0:1788890893.654584:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788890893.654590:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997273344:12345-0@lo:501: 00000100:00100000:2.0:1788890893.657368:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997272960:0@lo:8: 00000100:00100000:2.0:1788890893.657428:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890893.657608:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997273856:0@lo:400: 00000100:00100000:2.0:1788890893.657650:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890893.657671:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788890893.657676:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875787997273728:0@lo:400: 00000100:00100000:2.0:1788890893.657708:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890893.657737:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997273856 00000100:00100000:2.0:1788890893.657743:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997273856 00000100:00100000:2.0:1788890893.657787:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788890893.657796:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997273856:12345-0@lo:400: 00000100:00100000:2.0:1788890893.657971:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997273856:12345-0@lo:400: Request processed in 174us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890893.657978:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788890893.658013:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997273856:0@lo:400: 00000100:00100000:0.0:1788890893.658888:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997273344:12345-0@lo:501: Request processed in 4295us (4361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890893.658896:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788890893.660712:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997273344:0@lo:501: 00000100:00100000:2.0:1788890893.660757:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997274240:0@lo:503: 00000100:00100000:2.0:1788890893.660807:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890893.660847:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff925082d22b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788890893.660863:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997274240 00000100:00100000:2.0:1788890893.660868:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997274240 00000100:00100000:2.0:1788890893.660902:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788890893.660911:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997274240:12345-0@lo:503: 00000100:00100000:2.0:1788890893.661026:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997274240:12345-0@lo:503: Request processed in 115us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890893.661033:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788890893.661075:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997274240:0@lo:503: 00000100:00100000:3.0:1788890893.661498:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997272960 00000100:00100000:3.0:1788890893.661504:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997272960 00000100:00100000:3.0:1788890893.661680:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788890893.661686:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3626:x1875787997272960:12345-0@lo:8: 00010000:00080000:3.0:1788890893.661710:0:8408:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 115 last 0 00000020:00000080:3.0:1788890893.661736:0:8408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd52b1b 00002000:00100000:3.0:1788890893.661774:0:8408:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff924f81edc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788890893.661779:0:8408:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1788890893.661782:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788890893.661852:0:8408:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788890893.662084:0:8408:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788890893.662106:0:8408:0:(import.c:65:import_set_state_nolock()) ffff924f81ede800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788890893.662162:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3626:x1875787997272960:12345-0@lo:8: Request processed in 475us (4734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890893.662169:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788890893.662193:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997273472:0@lo:400: 00000100:00100000:3.0:1788890893.662223:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890893.662247:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997273984:0@lo:400: 00000100:00100000:3.0:1788890893.662268:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890893.662296:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788890893.662302:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997273600:0@lo:400: 00000100:00100000:3.0:1788890893.662327:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890893.662345:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997274112:0@lo:400: 00000100:00100000:3.0:1788890893.662364:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890893.662392:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997273728 00000100:00100000:3.0:1788890893.662396:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997273728 00000100:00100000:3.0:1788890893.662415:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997273472 00000100:00100000:3.0:1788890893.662418:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997273472 00000100:00100000:3.0:1788890893.662427:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997273984 00000100:00100000:3.0:1788890893.662429:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997273984 00000100:00100000:3.0:1788890893.662451:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997274112 00000100:00100000:3.0:1788890893.662453:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997274112 00000100:00100000:3.0:1788890893.662480:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788890893.662487:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875787997273728:12345-0@lo:400: 00000100:00100000:3.0:1788890893.662544:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875787997273728:12345-0@lo:400: Request processed in 58us (4835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890893.662550:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788890893.662563:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788890893.662569:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997273472:12345-0@lo:400: 00000100:00100000:3.0:1788890893.662614:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997273472:12345-0@lo:400: Request processed in 45us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890893.662621:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788890893.662633:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788890893.662639:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997273984:12345-0@lo:400: 00000100:00100000:3.0:1788890893.662665:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997273984:12345-0@lo:400: Request processed in 27us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890893.662670:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788890893.662688:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788890893.662693:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997274112:12345-0@lo:400: 00000100:00100000:3.0:1788890893.662721:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997274112:12345-0@lo:400: Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890893.662727:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788890893.662743:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997273600 00000100:00100000:3.0:1788890893.662746:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997273600 00000100:00100000:3.0:1788890893.662769:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788890893.662776:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997273600:12345-0@lo:400: 00000100:00100000:3.0:1788890893.662806:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997273600:12345-0@lo:400: Request processed in 31us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890893.662813:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788890893.662853:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250a4884e00 x1875787997272960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788890903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890893.662864:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788890893.662871:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788890893.662878:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788890893.662883:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788890893.662886:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250c1537000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788890893.662897:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788890893.662902:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997272960:0@lo:8: 00010000:00080000:3.0:1788890893.662942:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250c12a4380 x1875787997273728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890893.662951:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875787997273728:0@lo:400: 00000100:00100000:3.0:1788890893.662978:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997273600:0@lo:400: 00010000:00080000:3.0:1788890893.662987:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bf6cf100 x1875787997274112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890893.663003:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997274112:0@lo:400: 00010000:00080000:3.0:1788890893.663014:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250c12a5880 x1875787997273472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890893.663022:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997273472:0@lo:400: 00010000:00080000:3.0:1788890893.663031:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bf6ce300 x1875787997273984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890893.663039:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997273984:0@lo:400: 00000100:00100000:3.0:1788890893.663080:0:8586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1262d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8586:1875787997274368:0@lo:700: 00000100:00100000:3.0:1788890893.663104:0:8586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890893.663120:0:8586:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508630d0c0 going to sleep for 11 seconds 00000100:00080000:0.0:1788890893.663549:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788890893.663554:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890893.663587:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997274368 00000100:00100000:0.0:1788890893.663590:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997274368 00000100:00100000:0.0:1788890893.663629:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788890893.663646:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8586:x1875787997274368:12345-0@lo:700: 00000100:00100000:0.0:1788890893.663677:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8417:1875787997274496:0@lo:700: 00000100:00100000:0.0:1788890893.663837:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890893.663853:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab18900 going to sleep for 11 seconds 00000004:00080000:2.0:1788890893.666439:0:8585:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788890893.666554:0:8585:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 115911030076ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788890893.666563:0:8585:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:3.0:1788890893.666774:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890893.666801:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997274496 00000100:00100000:3.0:1788890893.666808:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997274496 00000100:00100000:3.0:1788890893.666917:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788890893.666928:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8417:x1875787997274496:12345-0@lo:700: 00000100:00100000:0.0:1788890893.667406:0:8588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8588:1875787997274624:0@lo:502: 00000100:00100000:0.0:1788890893.667490:0:8588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890893.667570:0:8588:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab18b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788890893.668487:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997274624 00000100:00100000:3.0:1788890893.668495:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997274624 00000100:00100000:3.0:1788890893.668560:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788890893.668568:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:8588:x1875787997274624:12345-0@lo:502: 00000100:00100000:3.0:1788890893.668686:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:8588:x1875787997274624:12345-0@lo:502: Request processed in 119us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890893.668693:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788890893.669739:0:8588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8588:1875787997274624:0@lo:502: 00000100:00100000:2.0:1788890893.669808:0:8588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8588:1875787997274752:0@lo:502: 00000100:00100000:2.0:1788890893.669855:0:8588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890893.669888:0:8588:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090b93b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788890893.670234:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997274752 00000100:00100000:3.0:1788890893.670240:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997274752 00000100:00100000:3.0:1788890893.670280:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788890893.670288:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:8588:x1875787997274752:12345-0@lo:502: 00000100:00100000:3.0:1788890893.670378:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:8588:x1875787997274752:12345-0@lo:502: Request processed in 91us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890893.670454:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788890893.670639:0:8588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8588:1875787997274752:0@lo:502: 00000040:00080000:2.0:1788890893.670659:0:8588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788890893.670837:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788890893.670859:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788890893.670868:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52b0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890893.670877:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52b0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890893.670885:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788890893.670888:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92509099a000 from 5 10000000:01000000:3.0:1788890893.670890:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788890893.670916:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ec600/0xa66601b03fd52b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890893.670923:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250813ec600/0xa66601b03fd52b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890893.670932:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250813ec600/0xa66601b03fd52b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890893.670943:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997274880:0@lo:101: 00000100:00100000:3.0:1788890893.670969:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890893.670991:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508630da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788890893.671002:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997274880 00000100:00100000:3.0:1788890893.671005:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997274880 00000100:00100000:3.0:1788890893.671033:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788890893.671039:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997274880:12345-0@lo:101: 00010000:00010000:3.0:1788890893.671046:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890893.671056:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250813eda00/0xa66601b03fd52b29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52b22 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890893.671074:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813eda00/0xa66601b03fd52b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52b22 expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890893.671083:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250813eda00/0xa66601b03fd52b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52b22 expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890893.671092:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813eda00, rc 0) 00000100:00100000:3.0:1788890893.671117:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:6493:x1875787997274880:12345-0@lo:101: Request processed in 78us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890893.671123:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788890893.671148:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997274880:0@lo:101: 00010000:00010000:3.0:1788890893.671157:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250813ec600/0xa66601b03fd52b22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52b29 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890893.671165:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250813ec600/0xa66601b03fd52b22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52b29 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890893.671203:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997275008:0@lo:256: 00000100:00100000:3.0:1788890893.671230:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890893.671243:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508630da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788890893.671254:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997275008 00000100:00100000:3.0:1788890893.671257:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997275008 00000100:00100000:3.0:1788890893.671276:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788890893.671288:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:6493:x1875787997275008:12345-0@lo:256: 20000000:01000000:3.0:1788890893.671299:0:6491:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788890893.671311:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788890893.671314:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788890893.671378:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:6493:x1875787997275008:12345-0@lo:256: Request processed in 90us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890893.671384:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788890893.671411:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997275008:0@lo:256: 10000000:01000000:3.0:1788890893.671444:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788890893.671449:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ec600/0xa66601b03fd52b22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52b29 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890893.671456:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250813ec600/0xa66601b03fd52b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52b29 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890893.671473:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788890893.671474:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788890893.671476:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788890893.671490:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52b30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890893.671495:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52b30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890893.671502:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52b30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890893.671513:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997275136:0@lo:101: 00000100:00100000:3.0:1788890893.671561:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890893.671586:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090298d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788890893.671596:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997275136 00000100:00100000:3.0:1788890893.671600:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997275136 00000100:00100000:3.0:1788890893.671619:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788890893.671625:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:6493:x1875787997275136:12345-0@lo:101: 00010000:00010000:3.0:1788890893.671631:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890893.671638:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250813ede00/0xa66601b03fd52b37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52b30 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890893.671649:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813ede00/0xa66601b03fd52b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52b30 expref: 20 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890893.671658:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250813ede00/0xa66601b03fd52b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52b30 expref: 20 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890893.671663:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ede00, rc 0) 00000100:00100000:3.0:1788890893.671690:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997275136:12345-0@lo:101: Request processed in 65us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890893.671695:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788890893.671723:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997275136:0@lo:101: 00010000:00010000:3.0:1788890893.671732:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52b30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52b37 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890893.671739:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52b30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52b37 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890893.671781:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997275264:0@lo:501: 00000100:00100000:3.0:1788890893.671806:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890893.671818:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090298d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788890893.671835:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997275264 00000100:00100000:3.0:1788890893.671838:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997275264 00000100:00100000:3.0:1788890893.671857:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788890893.671863:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997275264:12345-0@lo:501: 00000100:00100000:3.0:1788890893.671953:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997275264:12345-0@lo:501: Request processed in 89us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890893.671959:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788890893.671988:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997275264:0@lo:501: 00000100:00100000:3.0:1788890893.672013:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997275392:0@lo:503: 00000100:00100000:3.0:1788890893.672046:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890893.672058:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090298d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788890893.672068:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997275392 00000100:00100000:3.0:1788890893.672072:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997275392 00000100:00100000:3.0:1788890893.672090:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788890893.672095:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997275392:12345-0@lo:503: 00000100:00100000:3.0:1788890893.672161:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997275392:12345-0@lo:503: Request processed in 64us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890893.672167:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788890893.672200:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997275392:0@lo:503: 00000004:00080000:1.0:1788890893.673376:0:7425:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 40000000:02000000:1.0:1788890893.674645:0:6502:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1788890893.681137:0:8589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8589:1875787997275520:0@lo:502: 00000100:00100000:2.0:1788890893.681245:0:8589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890893.681294:0:8589:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090b93540 going to sleep for 11 seconds 00000100:00100000:3.0:1788890893.681344:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997275520 00000100:00100000:3.0:1788890893.681352:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997275520 00000100:00100000:3.0:1788890893.681406:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788890893.681416:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:8589:x1875787997275520:12345-0@lo:502: 00000100:00100000:3.0:1788890893.681608:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:8589:x1875787997275520:12345-0@lo:502: Request processed in 191us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890893.681618:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788890893.681766:0:8589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8589:1875787997275520:0@lo:502: 00000020:01000000:2.0:1788890893.681804:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788890893.681812:0:8589:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788890893.681819:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890893.681822:0:8589:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788890893.681827:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788890893.681832:0:8589:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:2.0:1788890893.681869:0:8589:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788890893.681873:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788890893.681896:0:8589:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9250bf67cd28) 00000020:00000080:2.0:1788890893.681922:0:8589:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788890893.681931:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788890893.682007:0:8589:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788890893.682013:0:8589:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788890893.682019:0:8589:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd52b45 00010000:00080000:2.0:1788890893.682065:0:8589:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9250ba96c000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:2.0:1788890893.682366:0:8589:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:1.0:1788890893.685315:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8417:x1875787997274496:12345-0@lo:700: Request processed in 18383us (21470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890893.685352:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788890893.686434:0:8417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250a4885880 x1875787997274496/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788890909 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890893.686456:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8417:1875787997274496:0@lo:700: 40000000:02000000:0.0:1788890893.686483:0:8417:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:1.0:1788890893.698190:0:8589:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788890893.698214:0:8589:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788890893.698408:0:8589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788890893.698662:0:8589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788890893.699222:0:8589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788890893.699311:0:8589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788890893.700430:0:8591:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788890893.700436:0:8591:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788890893.709053:0:8589:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788890893.709073:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788890893.709127:0:8589:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788890893.709157:0:8589:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd52b4c 00000100:00080000:0.0:1788890893.709169:0:8589:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788890893.709177:0:8589:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9250ba96c000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788890893.709231:0:8589:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9250a4885880 x1875787997275648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788890893.709265:0:8589:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788890893.709385:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788890893.709390:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890893.709392:0:8589:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788890893.709395:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788890893.709406:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890893.709408:0:8589:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788890893.709412:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788890893.709413:0:8589:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788890893.709450:0:8589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8589:1875787997275776:0@lo:502: 00000100:00100000:0.0:1788890893.709608:0:8589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890893.709652:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997275776 00000100:00100000:0.0:1788890893.709659:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997275776 00000100:00100000:0.0:1788890893.709706:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788890893.709716:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:8589:x1875787997275776:12345-0@lo:502: 00000100:00100000:0.0:1788890893.709855:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:8589:x1875787997275776:12345-0@lo:502: Request processed in 140us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890893.709863:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788890893.709945:0:8589:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab18c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890893.709972:0:8589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:8589:1875787997275776:0@lo:502: 00000020:01000000:0.0:1788890893.710001:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788890893.710006:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890893.710008:0:8589:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788890893.710012:0:8589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788890893.710080:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788890893.710105:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788890893.710116:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52b30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52b37 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890893.710129:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52b37 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890893.710140:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788890893.710143:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff925091ac8000 from 1 10000000:01000000:0.0:1788890893.710152:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788890893.710179:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925080031200/0xa66601b03fd52b53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890893.710188:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925080031200/0xa66601b03fd52b53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890893.710199:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925080031200/0xa66601b03fd52b53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890893.710213:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997275904:0@lo:101: 00000100:00100000:0.0:1788890893.710245:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890893.710262:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab18c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890893.710277:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997275904 00000100:00100000:0.0:1788890893.710281:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997275904 00000100:00100000:0.0:1788890893.710304:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788890893.710312:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997275904:12345-0@lo:101: 00010000:00010000:0.0:1788890893.710322:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890893.710338:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925081523800/0xa66601b03fd52b5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52b53 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890893.710364:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925081523800/0xa66601b03fd52b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52b53 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890893.710375:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925081523800/0xa66601b03fd52b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52b53 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890893.710386:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925081523800, rc 0) 00000100:00100000:0.0:1788890893.710418:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997275904:12345-0@lo:101: Request processed in 107us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890893.710436:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788890893.710488:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997275904:0@lo:101: 00010000:00010000:0.0:1788890893.710501:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925080031200/0xa66601b03fd52b53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52b5a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890893.710509:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925080031200/0xa66601b03fd52b53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52b5a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890893.710589:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997276032:0@lo:501: 00000100:00100000:0.0:1788890893.710614:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890893.710628:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab18c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890893.710642:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997276032 00000100:00100000:0.0:1788890893.710645:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997276032 00000100:00100000:0.0:1788890893.710668:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788890893.710675:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997276032:12345-0@lo:501: 00000100:00100000:0.0:1788890893.710746:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997276032:12345-0@lo:501: Request processed in 70us (130us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788890893.710753:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788890893.710781:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997276032:0@lo:501: 10000000:01000000:0.0:1788890893.710802:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788890893.710807:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925080031200/0xa66601b03fd52b53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52b5a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890893.710815:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925080031200/0xa66601b03fd52b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52b5a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890893.711055:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997275648:0@lo:8: 00000100:00100000:2.0:1788890893.711100:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890893.712433:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997275648 00000100:00100000:0.0:1788890893.712449:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997275648 00000100:00100000:0.0:1788890893.712497:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788890893.712508:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1875787997275648:12345-0@lo:8: 00010000:00080000:0.0:1788890893.712659:0:8411:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 115 last 0 00000020:00000080:0.0:1788890893.712694:0:8411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd52b61 00002000:00100000:0.0:1788890893.712713:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff924f81777000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788890893.712718:0:8411:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788890893.712721:0:8411:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788890893.712834:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788890893.712867:0:8411:0:(import.c:65:import_set_state_nolock()) ffff924f81770800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788890893.715950:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3626:x1875787997275648:12345-0@lo:8: Request processed in 3434us (4837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890893.715966:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788890893.716494:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250a4885880 x1875787997275648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788890903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890893.716509:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788890893.716886:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788890893.716899:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788890893.716906:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788890893.716911:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250ba96c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788890893.716973:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788890893.716982:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997275648:0@lo:8: 00000004:00080000:0.0:1788890893.718716:0:8591:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788890893.719131:0:8591:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 115963606408ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788890893.719142:0:8591:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000001:00100000:0.0:1788890893.719738:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788890893.719883:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8586:x1875787997274368:12345-0@lo:700: Request processed in 56242us (56773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890893.719896:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788890893.719929:0:8586:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250c1262d80 x1875787997274368/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788890909 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890893.719949:0:8586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1262d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8586:1875787997274368:0@lo:700: 00000004:00080000:0.0:1788890893.723498:0:8593:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788890893.723564:0:8593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8593:1875787997276288:0@lo:7: 00000100:00100000:3.0:1788890893.723593:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997276160:0@lo:13: 00000100:00100000:3.0:1788890893.723669:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890893.723669:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890893.725757:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997276288 00000100:00100000:1.0:1788890893.725778:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997276288 00000100:00100000:1.0:1788890893.725892:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788890893.725905:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8593:x1875787997276288:12345-0@lo:7: 00000100:00100000:0.0:1788890893.728408:0:8593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab18c00 going to sleep for 11 seconds 00000100:00080000:0.0:1788890893.728710:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788890893.728745:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997276160 00000100:00100000:0.0:1788890893.728756:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997276160 00000100:00100000:0.0:1788890893.728816:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788890893.728836:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1875787997276160:12345-0@lo:13: 00002000:00000024:0.0:1788890893.728871:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923918848 avail 3692396544 00000100:00100000:0.0:1788890893.728953:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1875787997276160:12345-0@lo:13: Request processed in 119us (5291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890893.728962:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788890893.736779:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250a4885c00 x1875787997276160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890893.736812:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997276160:0@lo:13: 00002000:00080000:0.0:1788890893.739912:0:8410:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788890893.739926:0:8410:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788890893.740056:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8593:x1875787997276288:12345-0@lo:7: Request processed in 14147us (16387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890893.740071:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788890893.740121:0:8593:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250a4885180 x1875787997276288/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788890909 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890893.740177:0:8593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8593:1875787997276288:0@lo:7: 00000004:00080000:3.0:1788890893.740193:0:8593:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788890893.740239:0:8593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8593:1875787997276416:0@lo:5: 00000100:00100000:3.0:1788890893.740301:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890893.740354:0:8593:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090298000 going to sleep for 11 seconds 00000004:00080000:1.0:1788890893.740980:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788890893.741886:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997276416 00000100:00100000:0.0:1788890893.741898:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997276416 00000100:00100000:0.0:1788890893.741966:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788890893.741977:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1262d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8593:x1875787997276416:12345-0@lo:5: 00002000:00080000:0.0:1788890893.742016:0:8411:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788890893.742021:0:8411:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000004:00080000:2.0:1788890893.742790:0:8586:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788890893.742817:0:8586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8586:1875787997276672:0@lo:7: 00000100:00100000:3.0:1788890893.742894:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788890893.742899:0:8586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890893.742921:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997276544:0@lo:13: 00000100:00100000:2.0:1788890893.742951:0:8586:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090b93d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788890893.742984:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890893.743262:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997276544 00000100:00100000:0.0:1788890893.743270:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997276544 00000100:00100000:0.0:1788890893.743316:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788890893.743327:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997276544:12345-0@lo:13: 00002000:00000024:0.0:1788890893.743347:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923918848 avail 3692396544 00000100:00100000:0.0:1788890893.743429:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997276544:12345-0@lo:13: Request processed in 104us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890893.743437:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788890893.743516:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bf6cc000 x1875787997276544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890893.743561:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997276544:0@lo:13: 00000100:00100000:0.0:1788890893.743592:0:8410:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788890893.743608:0:8410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788890893.745592:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997276672 00000100:00100000:1.0:1788890893.745606:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997276672 00000100:00100000:1.0:1788890893.745805:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788890893.745816:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8586:x1875787997276672:12345-0@lo:7: 00000001:00080000:3.0:1788890893.749024:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788890893.749044:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788890893.754326:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1262d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8593:x1875787997276416:12345-0@lo:5: Request processed in 12341us (14015us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788890893.754341:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788890893.754571:0:8593:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250c12a4380 x1875787997276416/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788890909 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890893.754585:0:8593:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788890893.754593:0:8593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8593:1875787997276416:0@lo:5: 00000004:00080000:0.0:1788890893.754613:0:8593:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788890893.754865:0:8593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4887b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8593:1875787997276800:0@lo:700: 00000100:00100000:0.0:1788890893.754917:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890893.754953:0:8593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab18c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788890893.755050:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997276800 00000100:00100000:3.0:1788890893.755058:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997276800 00000100:00100000:3.0:1788890893.755109:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788890893.755123:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8593:x1875787997276800:12345-0@lo:700: 00002000:00080000:1.0:1788890893.755340:0:8596:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788890893.755349:0:8596:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788890893.755443:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8586:x1875787997276672:12345-0@lo:7: Request processed in 9626us (12544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890893.755453:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788890893.756427:0:8586:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bf6cdc00 x1875787997276672/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788890909 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890893.756443:0:8586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8586:1875787997276672:0@lo:7: 00000004:00080000:3.0:1788890893.756456:0:8586:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788890893.756498:0:8586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab51880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8586:1875787997276928:0@lo:5: 00000100:00100000:3.0:1788890893.756567:0:8586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890893.756597:0:8586:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090298000 going to sleep for 11 seconds 00000100:00100000:1.0:1788890893.762003:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997276928 00000100:00100000:1.0:1788890893.762025:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997276928 00000100:00100000:1.0:1788890893.762281:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788890893.762296:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8586:x1875787997276928:12345-0@lo:5: 00002000:00080000:1.0:1788890893.762340:0:8408:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788890893.762449:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8586:x1875787997276928:12345-0@lo:5: Request processed in 157us (5883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890893.762468:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788890893.762516:0:8586:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bab51880 x1875787997276928/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788890909 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890893.762576:0:8586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab51880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8586:1875787997276928:0@lo:5: 00000004:00080000:3.0:1788890893.762593:0:8586:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788890893.762839:0:8586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab51880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8586:1875787997277056:0@lo:5: 00000100:00100000:3.0:1788890893.762898:0:8586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890893.762935:0:8586:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090298000 going to sleep for 11 seconds 00000100:00100000:2.0:1788890893.762964:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997277056 00000100:00100000:2.0:1788890893.762972:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997277056 00000100:00100000:2.0:1788890893.763011:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788890893.763019:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8586:x1875787997277056:12345-0@lo:5: 00002000:00080000:2.0:1788890893.763051:0:8411:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788890893.781328:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8586:x1875787997277056:12345-0@lo:5: Request processed in 18303us (18423us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788890893.781343:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788890893.782562:0:8586:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bab51880 x1875787997277056/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788890909 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890893.782591:0:8586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab51880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8586:1875787997277056:0@lo:5: 00000004:00080000:1.0:1788890893.782613:0:8586:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1788890893.782673:0:8586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090311180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8586:1875787997277184:0@lo:900: 00000100:00100000:1.0:1788890893.782757:0:8586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890893.782808:0:8586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab15c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890893.783367:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997277184 00000100:00100000:0.0:1788890893.783377:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997277184 00000100:00100000:0.0:1788890893.783506:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788890893.783548:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8586:x1875787997277184:12345-0@lo:900: 00000100:00100000:0.0:1788890893.783630:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8586:x1875787997277184:12345-0@lo:900: Request processed in 113us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890893.783638:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788890893.784399:0:8586:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925090311180 x1875787997277184/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788890909 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890893.784415:0:8586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090311180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8586:1875787997277184:0@lo:900: 00000001:00080000:1.0:1788890893.803021:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:3.0:1788890893.809842:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8593:x1875787997276800:12345-0@lo:700: Request processed in 54714us (54916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890893.809860:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788890893.809931:0:8593:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250a4887b80 x1875787997276800/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788890909 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890893.809952:0:8593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4887b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8593:1875787997276800:0@lo:700: 00000004:02000040:0.0:1788890893.819255:0:8593:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1788890893.831284:0:8593:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090311180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8593:1875787997277312:0@lo:5: 00000100:00100000:1.0:1788890893.831412:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890893.831500:0:8593:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab15c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890893.832306:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997277312 00000100:00100000:0.0:1788890893.832316:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997277312 00000100:00100000:0.0:1788890893.832385:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788890893.832395:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090310e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8593:x1875787997277312:12345-0@lo:5: 00002000:00080000:1.0:1788890893.843246:0:8410:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788890893.843277:0:8410:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1788890893.848599:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090310e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8593:x1875787997277312:12345-0@lo:5: Request processed in 16195us (17177us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788890893.848617:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788890893.850968:0:8593:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925090311180 x1875787997277312/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788890909 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890893.851014:0:8593:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090311180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8593:1875787997277312:0@lo:5: 00000004:00080000:0.0:1788890893.851033:0:8593:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:0.0:1788890893.947998:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997277440:0@lo:41: 00000100:00100000:0.0:1788890893.948104:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890893.948225:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997277440 00000100:00100000:0.0:1788890893.948235:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997277440 00000100:00100000:0.0:1788890893.948298:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788890893.948310:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997277440:12345-0@lo:41: 00000004:00000024:0.0:1788890893.948357:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788890893.948439:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997277440:12345-0@lo:41: Request processed in 131us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890893.948448:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788890893.949501:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997277440:0@lo:41: 00010000:00010000:3.0:1788890894.268936:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890894.973836:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788890894.973872:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997277568:0@lo:41: 00000100:00100000:3.0:1788890894.973942:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890894.974193:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997277568 00000100:00100000:1.0:1788890894.974201:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997277568 00000100:00100000:1.0:1788890894.974249:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788890894.974258:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997277568:12345-0@lo:41: 00000004:00000024:1.0:1788890894.974292:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788890894.974340:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997277568:12345-0@lo:41: Request processed in 83us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890894.974347:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788890894.974453:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997277568:0@lo:41: 00010000:00010000:1.0:1788890895.295881:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890896.316811:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788890896.767217:0:8785:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788890897.345133:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788890897.684199:0:8837:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788890897.684452:0:8837:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788890898.363876:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788890898.615489:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1788890899.068299:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788890899.068323:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997277696:0@lo:41: 00000100:00100000:2.0:1788890899.068408:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890899.068509:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997277696 00000100:00100000:3.0:1788890899.068517:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997277696 00000100:00100000:3.0:1788890899.068584:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788890899.068593:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997277696:12345-0@lo:41: 00000004:00000024:3.0:1788890899.068623:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788890899.068673:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997277696:12345-0@lo:41: Request processed in 81us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890899.068680:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788890899.068751:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997277952:0@lo:400: 00000100:00100000:3.0:1788890899.068773:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997278080:0@lo:400: 00000100:00100000:0.0:1788890899.068794:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890899.068808:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890899.068833:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1875787997278592:0@lo:400: 00000100:00100000:0.0:1788890899.068837:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997278464:0@lo:400: 00000100:00100000:3.0:1788890899.068874:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890899.068877:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997277952 00000100:00100000:0.0:1788890899.068882:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997277952 00000100:00100000:0.0:1788890899.068917:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788890899.068923:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997278080 00000100:00100000:0.0:1788890899.068925:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:3629:x1875787997277952:12345-0@lo:400: 00000100:00100000:3.0:1788890899.068929:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997278080 00000100:00100000:3.0:1788890899.068958:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997278592 00000100:00100000:3.0:1788890899.068961:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997278592 00000100:00100000:0.0:1788890899.068966:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:3629:x1875787997277952:12345-0@lo:400: Request processed in 40us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890899.068985:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788890899.068989:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788890899.068997:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997278080:12345-0@lo:400: 00000100:00080000:0.0:1788890899.069025:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788890899.069036:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997278080:12345-0@lo:400: Request processed in 40us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890899.069042:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997277824:0@lo:13: 00000100:00100000:3.0:1788890899.069045:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788890899.069068:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788890899.069075:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875787997278592:12345-0@lo:400: 00000100:00100000:0.0:1788890899.069083:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890899.069108:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875787997278336:0@lo:400: 00000100:00100000:3.0:1788890899.069115:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875787997278592:12345-0@lo:400: Request processed in 38us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890899.069128:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788890899.069139:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890899.069201:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997278208:0@lo:400: 00000100:00100000:0.0:1788890899.069239:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997278848:0@lo:400: 00000100:00100000:3.0:1788890899.069567:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997278336 00000100:00100000:3.0:1788890899.069571:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997278336 00000100:00100000:3.0:1788890899.069590:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788890899.069595:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875787997278336:12345-0@lo:400: 00000100:00100000:1.0:1788890899.079339:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890899.079401:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997278720:0@lo:400: 00000100:00100000:1.0:1788890899.079434:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890899.079538:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997278208 00000100:00100000:1.0:1788890899.079546:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997278208 00000100:00100000:1.0:1788890899.079603:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788890899.079612:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997278208:12345-0@lo:400: 00000100:00100000:1.0:1788890899.080718:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997278208:12345-0@lo:400: Request processed in 1104us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890899.080727:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788890899.080779:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997278208:0@lo:400: 00000100:00100000:1.0:1788890899.080827:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997277824 00000100:00100000:1.0:1788890899.080833:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997277824 00000100:00100000:1.0:1788890899.080872:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788890899.080879:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997277824:12345-0@lo:13: 00002000:00000024:1.0:1788890899.080902:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788890899.080938:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997277824:12345-0@lo:13: Request processed in 60us (11859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890899.080944:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788890899.080965:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788890899.080998:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997278720 00000100:00100000:1.0:1788890899.081001:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997278720 00000100:00100000:1.0:1788890899.081031:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788890899.081038:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090310000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997278720:12345-0@lo:400: 00000100:00100000:1.0:1788890899.081076:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090310000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997278720:12345-0@lo:400: Request processed in 39us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890899.081082:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788890899.081095:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788890899.081122:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bab52a00 x1875787997278080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890899.081135:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997278080:0@lo:400: 00010000:00080000:1.0:1788890899.081164:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bab50000 x1875787997278592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890899.081174:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1875787997278592:0@lo:400: 00000100:00100000:1.0:1788890899.081190:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788890899.081198:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997278976:0@lo:13: 00000100:00100000:1.0:1788890899.081229:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890899.081256:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997278976 00000100:00100000:1.0:1788890899.081259:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997278976 00000100:00100000:1.0:1788890899.081279:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788890899.081287:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090312a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997278976:12345-0@lo:13: 00002000:00000024:1.0:1788890899.081297:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788890899.081324:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090312a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997278976:12345-0@lo:13: Request processed in 38us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890899.081331:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788890899.081371:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925090313480 x1875787997278976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890899.081379:0:3630:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788890899.081394:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997278976:0@lo:13: 00010000:00080000:1.0:1788890899.081416:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bab50e00 x1875787997278720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890899.081426:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997278720:0@lo:400: 00000100:00100000:0.0:1788890899.084319:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890899.084413:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997277696:0@lo:41: 00010000:00080000:0.0:1788890899.084452:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250a4886d80 x1875787997277824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890899.084461:0:3628:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788890899.084474:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997277824:0@lo:13: 00000100:00100000:1.0:1788890899.088914:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997278848 00000100:00100000:1.0:1788890899.088928:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997278848 00000100:00100000:1.0:1788890899.089000:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788890899.089011:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997278848:12345-0@lo:400: 00000100:00100000:1.0:1788890899.089120:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997278848:12345-0@lo:400: Request processed in 111us (4807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890899.089127:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788890899.090729:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bab52300 x1875787997278848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890899.090745:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997278848:0@lo:400: 00000100:00100000:3.0:1788890899.092023:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875787997278336:12345-0@lo:400: Request processed in 22421us (22878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890899.092035:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788890899.093849:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bab50700 x1875787997278336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890899.093867:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875787997278336:0@lo:400: 00000100:00100000:2.0:1788890899.099911:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890899.100009:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997277952:0@lo:400: 00000100:00100000:3.0:1788890899.100108:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997278464 00000100:00100000:3.0:1788890899.100116:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997278464 00000100:00100000:3.0:1788890899.100188:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788890899.100199:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997278464:12345-0@lo:400: 00000100:00100000:3.0:1788890899.100289:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997278464:12345-0@lo:400: Request processed in 93us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890899.100297:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788890899.100380:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788890899.100447:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bab50a80 x1875787997278464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890899.100470:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997278464:0@lo:400: 00010000:00010000:1.0:1788890899.387792:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890900.093124:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997279104:0@lo:41: 00000100:00100000:2.0:1788890900.093201:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890900.093425:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997279104 00000100:00100000:3.0:1788890900.093434:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997279104 00000100:00100000:3.0:1788890900.093741:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788890900.093751:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997279104:12345-0@lo:41: 00000004:00000024:3.0:1788890900.093784:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788890900.093855:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997279104:12345-0@lo:41: Request processed in 105us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890900.093862:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788890900.093953:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997279104:0@lo:41: 00010000:00010000:2.0:1788890900.413408:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788890900.499804:0:8938:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788890900.500059:0:8938:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1788890901.377270:0:8986:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788890901.377280:0:8986:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1788890901.436767:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890902.466623:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890903.485246:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890904.187812:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788890904.187837:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997279232:0@lo:13: 00000100:00100000:0.0:1788890904.187907:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890904.188100:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997279232 00000100:00100000:1.0:1788890904.188107:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997279232 00000100:00100000:1.0:1788890904.188159:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788890904.188169:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997279232:12345-0@lo:13: 00002000:00000024:1.0:1788890904.188199:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788890904.188569:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997279360:0@lo:13: 00000100:00100000:3.0:1788890904.188962:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997279488:0@lo:41: 00000100:00100000:2.0:1788890904.189199:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997279744:0@lo:400: 00000100:00100000:0.0:1788890904.191268:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890904.191351:0:8413:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788890904.191361:0:8413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:0.0:1788890904.191383:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788890904.191825:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997279360 00000100:00100000:0.0:1788890904.191833:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997279360 00000100:00080000:0.0:1788890904.191881:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788890904.192093:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788890904.192103:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997279360:12345-0@lo:13: 00002000:00000024:0.0:1788890904.192131:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788890904.192192:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997279360:12345-0@lo:13: Request processed in 91us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890904.192200:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788890904.192343:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997279232:12345-0@lo:13: Request processed in 4173us (4433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890904.192351:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788890904.192507:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250a4886d80 x1875787997279232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890904.192687:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890904.192734:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997280000:0@lo:400: 00000100:00100000:3.0:1788890904.192765:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890904.192786:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997280512:0@lo:400: 00000100:00100000:3.0:1788890904.192810:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890904.192833:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788890904.192836:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997279232:0@lo:13: 00000100:00100000:3.0:1788890904.192839:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997279616:0@lo:400: 00000100:00100000:0.0:1788890904.192857:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997279872:0@lo:400: 00000100:00100000:3.0:1788890904.192864:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890904.192880:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890904.192895:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997280384:0@lo:400: 00000100:00100000:0.0:1788890904.192922:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890904.193007:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997280128:0@lo:400: 00000100:00100000:3.0:1788890904.193034:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890904.193108:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997279488 00000100:00100000:1.0:1788890904.193114:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997279488 00000100:00100000:1.0:1788890904.193138:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997279872 00000100:00100000:1.0:1788890904.193140:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997279872 00000100:00100000:1.0:1788890904.193150:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997280128 00000100:00100000:1.0:1788890904.193152:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997280128 00000100:00100000:1.0:1788890904.193162:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788890904.193168:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1875787997279488:12345-0@lo:41: 00000004:00000024:1.0:1788890904.193198:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788890904.193237:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1875787997279488:12345-0@lo:41: Request processed in 69us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890904.193243:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788890904.193275:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788890904.193281:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997279872:12345-0@lo:400: 00000100:00100000:3.0:1788890904.193300:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997280000 00000100:00100000:1.0:1788890904.193314:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997279872:12345-0@lo:400: Request processed in 33us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890904.193320:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788890904.193332:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788890904.193338:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997280128:12345-0@lo:400: 00000100:00100000:1.0:1788890904.193364:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997280128:12345-0@lo:400: Request processed in 26us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890904.193370:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788890904.193375:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997280000 00000100:00100000:3.0:1788890904.193404:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997280384 00000100:00100000:3.0:1788890904.193407:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997280384 00000100:00100000:1.0:1788890904.193413:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997279616 00000100:00100000:1.0:1788890904.193416:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997279616 00000100:00100000:3.0:1788890904.193429:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788890904.193435:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997280000:12345-0@lo:400: 00000100:00100000:1.0:1788890904.193451:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788890904.193457:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:3629:x1875787997279616:12345-0@lo:400: 00000100:00100000:3.0:1788890904.193467:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997280000:12345-0@lo:400: Request processed in 33us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890904.193473:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788890904.193481:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:3629:x1875787997279616:12345-0@lo:400: Request processed in 25us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890904.193485:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788890904.193490:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875787997280384:12345-0@lo:400: 00000100:00100000:1.0:1788890904.193497:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788890904.193517:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875787997280384:12345-0@lo:400: Request processed in 27us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890904.193547:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788890904.193564:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997280512 00000100:00100000:3.0:1788890904.193568:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997280512 00000100:00100000:3.0:1788890904.193598:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788890904.193605:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997280512:12345-0@lo:400: 00010000:00080000:0.0:1788890904.193610:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250a4885880 x1875787997279360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890904.193628:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997279360:0@lo:13: 00000100:00100000:0.0:1788890904.193664:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997279872:0@lo:400: 00010000:00080000:0.0:1788890904.193675:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bf6cf800 x1875787997280384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890904.193695:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997280384:0@lo:400: 00000100:00100000:3.0:1788890904.194794:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997280512:12345-0@lo:400: Request processed in 1185us (1978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890904.194806:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788890904.194841:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788890904.194864:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997279616:0@lo:400: 00000100:00100000:3.0:1788890904.194876:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997280128:0@lo:400: 00010000:00080000:3.0:1788890904.194887:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bf6ce680 x1875787997280000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890904.195068:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890904.195103:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997280256:0@lo:400: 00000100:00100000:2.0:1788890904.195127:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890904.195174:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997279744 00000100:00100000:2.0:1788890904.195180:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997279744 00000100:00100000:2.0:1788890904.195208:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997280256 00000100:00100000:2.0:1788890904.195211:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997280256 00000100:00100000:2.0:1788890904.195229:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788890904.195236:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997279744:12345-0@lo:400: 00000100:00100000:2.0:1788890904.195286:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997279744:12345-0@lo:400: Request processed in 50us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890904.195292:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788890904.195383:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997280000:0@lo:400: 00010000:00080000:3.0:1788890904.195401:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bf6cdc00 x1875787997280512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890904.195408:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997280512:0@lo:400: 00000100:00100000:3.0:1788890904.195424:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997279488:0@lo:41: 00000100:00100000:3.0:1788890904.195457:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788890904.195466:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997280256:12345-0@lo:400: 00000100:00100000:3.0:1788890904.195503:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997280256:12345-0@lo:400: Request processed in 39us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890904.195509:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788890904.195551:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788890904.195888:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bf6cea00 x1875787997279744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890904.195899:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997279744:0@lo:400: 00010000:00080000:0.0:1788890904.195909:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bf6ced80 x1875787997280256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890904.195916:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997280256:0@lo:400: 00010000:00010000:0.0:1788890904.509834:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890905.211687:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788890905.211713:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997280640:0@lo:41: 00000100:00100000:1.0:1788890905.211780:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890905.212019:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997280640 00000100:00100000:2.0:1788890905.212028:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997280640 00000100:00100000:2.0:1788890905.212085:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788890905.212095:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997280640:12345-0@lo:41: 00000004:00000024:2.0:1788890905.212129:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788890905.212187:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997280640:12345-0@lo:41: Request processed in 94us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890905.212207:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788890905.212254:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997280640:0@lo:41: 00010000:00010000:1.0:1788890905.532245:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890906.556656:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890907.590987:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890908.603687:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890909.311220:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997281024:0@lo:400: 00000100:00100000:1.0:1788890909.311292:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890909.311375:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997281024 00000100:00100000:1.0:1788890909.311383:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997281024 00000100:00100000:1.0:1788890909.311434:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788890909.311452:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997281024:12345-0@lo:400: 00000100:00100000:1.0:1788890909.311509:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997281024:12345-0@lo:400: Request processed in 58us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890909.311516:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788890909.311574:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997281024:0@lo:400: 00000100:00100000:1.0:1788890909.311610:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997281152:0@lo:400: 00000100:00100000:1.0:1788890909.311636:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890909.311672:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997281152 00000100:00100000:1.0:1788890909.311676:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997281152 00000100:00100000:1.0:1788890909.311702:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788890909.311709:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997281152:12345-0@lo:400: 00000100:00100000:1.0:1788890909.311743:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997281152:12345-0@lo:400: Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890909.311750:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788890909.311775:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bab50a80 x1875787997281152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890909.311786:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997281152:0@lo:400: 00000100:00100000:1.0:1788890909.311823:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997281536:0@lo:400: 00000100:00100000:1.0:1788890909.312040:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890909.312092:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997281664:0@lo:400: 00000100:00100000:1.0:1788890909.312216:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890909.312257:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997281664 00000100:00100000:1.0:1788890909.312261:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997281664 00000100:00100000:1.0:1788890909.312302:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788890909.312309:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997281664:12345-0@lo:400: 00000100:00100000:1.0:1788890909.312360:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997281664:12345-0@lo:400: Request processed in 51us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890909.312367:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788890909.312383:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788890909.312402:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bab51880 x1875787997281664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890909.312412:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997281664:0@lo:400: 00000100:00100000:1.0:1788890909.312466:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997280896:0@lo:400: 00000100:00100000:1.0:1788890909.312491:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890909.312507:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997281408:0@lo:400: 00000100:00100000:1.0:1788890909.312560:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890909.312578:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788890909.312583:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997280768:0@lo:400: 00000100:00100000:1.0:1788890909.312607:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890909.312625:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997281280:0@lo:400: 00000100:00100000:1.0:1788890909.312660:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890909.312681:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997281792:0@lo:400: 00000100:00100000:1.0:1788890909.312702:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890909.312729:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997281280 00000100:00100000:1.0:1788890909.312733:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997281280 00000100:00100000:1.0:1788890909.312755:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788890909.312761:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997281280:12345-0@lo:400: 00000100:00100000:1.0:1788890909.312793:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997281280:12345-0@lo:400: Request processed in 32us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890909.312799:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788890909.312820:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997281792 00000100:00100000:1.0:1788890909.312824:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997281792 00000100:00100000:3.0:1788890909.314749:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997281536 00000100:00100000:3.0:1788890909.314758:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997281536 00000100:00100000:3.0:1788890909.314795:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997280896 00000100:00100000:3.0:1788890909.314798:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997280896 00000100:00100000:3.0:1788890909.314825:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997281408 00000100:00100000:3.0:1788890909.314827:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997281408 00000100:00100000:1.0:1788890909.315257:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788890909.315272:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997281792:12345-0@lo:400: 00000100:00100000:1.0:1788890909.315354:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997281792:12345-0@lo:400: Request processed in 86us (2650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890909.315360:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788890909.315388:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788890909.315399:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997281920:0@lo:41: 00000100:00100000:1.0:1788890909.315432:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788890909.315463:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788890909.315467:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788890909.315470:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788890909.315478:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997281920 00000100:00100000:1.0:1788890909.315482:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997281920 00000100:00100000:1.0:1788890909.315501:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788890909.315507:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997281920:12345-0@lo:41: 00000004:00000024:1.0:1788890909.315549:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788890909.315587:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997281920:12345-0@lo:41: Request processed in 79us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890909.315593:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788890909.315631:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997281920:0@lo:41: 00000100:00100000:3.0:1788890909.315961:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788890909.315973:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997281536:12345-0@lo:400: 00000100:00100000:3.0:1788890909.316023:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997281536:12345-0@lo:400: Request processed in 54us (4177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890909.318427:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788890909.318445:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788890909.318473:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997280768 00000100:00100000:0.0:1788890909.318483:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997280768 00000100:00100000:0.0:1788890909.318551:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788890909.318562:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:3628:x1875787997280768:12345-0@lo:400: 00000100:00100000:0.0:1788890909.318642:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:3628:x1875787997280768:12345-0@lo:400: Request processed in 82us (6033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890909.318649:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788890909.319267:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997282176:0@lo:13: 00000100:00100000:0.0:1788890909.319310:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890909.319343:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788890909.319349:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997282048:0@lo:13: 00000100:00100000:0.0:1788890909.319370:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890909.319394:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997282176 00000100:00100000:0.0:1788890909.319405:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997282176 00000100:00100000:0.0:1788890909.319434:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997282048 00000100:00100000:0.0:1788890909.319437:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997282048 00000100:00100000:0.0:1788890909.319450:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788890909.319456:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997282176:12345-0@lo:13: 00002000:00000024:0.0:1788890909.319477:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788890909.319512:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997282176:12345-0@lo:13: Request processed in 56us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890909.319519:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788890909.319549:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788890909.319555:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997282048:12345-0@lo:13: 00002000:00000024:0.0:1788890909.319564:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788890909.319586:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997282048:12345-0@lo:13: Request processed in 32us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890909.319592:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788890909.319625:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250a4885880 x1875787997282048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890909.319643:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997282048:0@lo:13: 00010000:00080000:0.0:1788890909.319653:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bab60a80 x1875787997282176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890909.319664:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997282176:0@lo:13: 00000100:00100000:1.0:1788890909.320247:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788890909.320259:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997280896:12345-0@lo:400: 00000100:00100000:1.0:1788890909.320304:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997280896:12345-0@lo:400: Request processed in 48us (7811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890909.320311:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788890909.320337:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788890909.320347:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788890909.320354:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875787997281408:12345-0@lo:400: 00000100:00100000:1.0:1788890909.320384:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875787997281408:12345-0@lo:400: Request processed in 32us (7824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890909.320390:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788890909.320431:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997280768:0@lo:400: 00000100:00100000:1.0:1788890909.320444:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997281280:0@lo:400: 00010000:00080000:1.0:1788890909.320454:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bab51880 x1875787997281792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890909.320462:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997281792:0@lo:400: 00010000:00080000:1.0:1788890909.320473:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925090311500 x1875787997280896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890909.320480:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997280896:0@lo:400: 00010000:00080000:1.0:1788890909.320489:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bab52300 x1875787997281408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890909.320497:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997281408:0@lo:400: 00010000:00080000:1.0:1788890909.320549:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bab53b80 x1875787997281536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890909.320558:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997281536:0@lo:400: 00000100:00100000:3.0:1788890909.326456:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1788890909.629180:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890910.332810:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788890910.332848:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997282304:0@lo:41: 00000100:00100000:3.0:1788890910.332919:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890910.333075:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997282304 00000100:00100000:1.0:1788890910.333083:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997282304 00000100:00100000:1.0:1788890910.333146:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788890910.333156:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997282304:12345-0@lo:41: 00000004:00000024:1.0:1788890910.333200:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788890910.333246:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997282304:12345-0@lo:41: Request processed in 91us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890910.333254:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788890910.333344:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997282304:0@lo:41: 00010000:00010000:0.0:1788890910.653381:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788890911.277396:0:9487:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788890911.277400:0:9487:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788890911.277401:0:9487:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788890911.277557:0:9487:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9250c12de800 00000020:01000004:0.0:1788890911.277572:0:9487:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788890911.277586:0:9487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788890911.277603:0:9487:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9250baa699b8) 00000020:00000080:0.0:1788890911.277623:0:9487:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788890911.332645:0:9487:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788890911.332703:0:9487:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1788890911.366024:0:9487:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788890911.366407:0:9487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788890911.366422:0:9487:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788890911.366434:0:9487:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa66601b03fd52b6f 00000020:01000004:0.0:1788890911.366441:0:9487:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788890911.366463:0:9487:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788890911.366466:0:9487:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788890911.366472:0:9487:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788890911.366497:0:9487:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788890911.366512:0:9487:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788890911.388565:0:9487:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788890911.388604:0:9487:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.126@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788890911.388608:0:9487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788890911.388610:0:9487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788890911.388611:0:9487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788890911.388613:0:9487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788890911.388614:0:9487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788890911.388615:0:9487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788890911.388617:0:9487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788890911.388618:0:9487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788890911.388620:0:9487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788890911.388622:0:9487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788890911.388623:0:9487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788890911.388626:0:9487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788890911.388629:0:9487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788890911.388630:0:9487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788890911.388631:0:9487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788890911.388632:0:9487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788890911.388633:0:9487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788890911.388634:0:9487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788890911.388636:0:9487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788890911.388637:0:9487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788890911.388638:0:9487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788890911.388639:0:9487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788890911.388640:0:9487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788890911.388666:0:9487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788890911.388683:0:9487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e77100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997282432:0@lo:253: 00000100:00100000:1.0:1788890911.388767:0:9487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890911.388820:0:9487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab18240 going to sleep for 11 seconds 00000100:00100000:0.0:1788890911.389193:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997282432 00000100:00100000:0.0:1788890911.389200:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997282432 00000100:00100000:0.0:1788890911.389259:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788890911.389270:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:9487:x1875787997282432:12345-0@lo:253: 20000000:01000000:0.0:1788890911.389302:0:6490:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788890911.389306:0:6490:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788890911.389311:0:6490:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788890911.389315:0:6490:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788890911.389551:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788890911.389693:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1788890911.389707:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788890911.389724:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1788890911.389730:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788890911.389741:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1788890911.389753:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1788890911.389830:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1788890911.389844:0:6490:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.126@tcp 20000000:01000000:0.0:1788890911.389846:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788890911.389860:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1788890911.389874:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788890911.389891:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1788890911.389897:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:0.0:1788890911.389909:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1788890911.389915:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788890911.389928:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1788890911.389945:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1788890911.390016:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1788890911.390028:0:6490:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.126@tcp 20000000:01000000:0.0:1788890911.390029:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788890911.390044:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1788890911.390051:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788890911.391705:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1788890911.391729:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:0.0:1788890911.392372:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1788890911.392388:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788890911.392407:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1788890911.392429:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1788890911.395753:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1788890911.396178:0:6490:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.126@tcp 20000000:01000000:0.0:1788890911.396181:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788890911.396203:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1788890911.396212:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788890911.396227:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1788890911.396233:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:0.0:1788890911.396247:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1788890911.396256:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788890911.396271:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1788890911.396306:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1788890911.396324:0:6490:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788890911.396336:0:6490:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788890911.396340:0:6490:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788890911.396388:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788890911.396391:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788890911.399471:0:9493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1788890911.399781:0:9493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1788890911.399802:0:9493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1788890911.400684:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1788890911.400714:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1788890911.400731:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:0.0:1788890911.400742:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788890911.400745:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788890911.401437:0:9494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1788890911.401460:0:9494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1788890911.401507:0:9494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1788890911.401674:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1788890911.401697:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1788890911.401727:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1788890911.401740:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788890911.401742:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788890911.429783:0:9495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1788890911.429840:0:9495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1788890911.429855:0:9495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1788890911.429984:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1788890911.430008:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1788890911.430025:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1788890911.430035:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788890911.430038:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788890911.438262:0:9496:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1788890911.438325:0:9496:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1788890911.438340:0:9496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788890911.438609:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788890911.438635:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1788890911.438650:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1788890911.438660:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788890911.438663:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788890911.439276:0:9497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1788890911.439421:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1788890911.439445:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1788890911.439460:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:3.0:1788890911.439485:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788890911.439507:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9250813ed600/0xa66601b03fd52b76 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.439550:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250c214b800/0xa66601b03fd52a6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52a65 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.439559:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250c214ba00/0xa66601b03fd52a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52a8f expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.439565:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52ace expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.439585:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250c214ac00/0xa66601b03fd52af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52aea expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.439593:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925080031c00/0xa66601b03fd52b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52b0d expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.439600:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250813ede00/0xa66601b03fd52b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52b30 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.439606:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925081523800/0xa66601b03fd52b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52b53 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.439615:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9250813ed600/0xa66601b03fd52b76 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.439655:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925081523800/0xa66601b03fd52b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52b53 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.439672:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925081523800/0xa66601b03fd52b5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52b53 expref: 21 pid: 6488 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890911.439687:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875787997282560:0@lo:104: 00000100:00100000:3.0:1788890911.439763:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788890911.439830:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250813ede00/0xa66601b03fd52b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52b30 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.439838:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250813ede00/0xa66601b03fd52b37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52b30 expref: 21 pid: 6491 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890911.439847:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875787997282688:0@lo:104: 00000100:00100000:3.0:1788890911.439874:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788890911.439898:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925080031c00/0xa66601b03fd52b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52b0d expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.439906:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925080031c00/0xa66601b03fd52b14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52b0d expref: 21 pid: 6490 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890911.439914:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875787997282816:0@lo:104: 00000100:00100000:3.0:1788890911.439935:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788890911.439952:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250c214ac00/0xa66601b03fd52af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52aea expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.439960:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250c214ac00/0xa66601b03fd52af1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52aea expref: 21 pid: 6491 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890911.439969:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875787997282944:0@lo:104: 00000100:00100000:3.0:1788890911.439988:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788890911.440002:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52ace expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.440009:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ad5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52ace expref: 21 pid: 6490 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890911.440017:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875787997283072:0@lo:104: 00000100:00100000:3.0:1788890911.440036:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788890911.440053:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250c214ba00/0xa66601b03fd52a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52a8f expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.440061:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250c214ba00/0xa66601b03fd52a96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52a8f expref: 21 pid: 6490 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890911.440081:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875787997283200:0@lo:104: 00000100:00100000:3.0:1788890911.440106:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788890911.440137:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250c214b800/0xa66601b03fd52a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52a65 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.440145:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250c214b800/0xa66601b03fd52a6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52a65 expref: 21 pid: 6491 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890911.440152:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875787997283328:0@lo:104: 00000100:00100000:3.0:1788890911.440172:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508a4256c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890911.440358:0:6479:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788890911.440377:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890911.440393:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997282560 00000100:00100000:2.0:1788890911.440400:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997282560 00000100:00100000:2.0:1788890911.440434:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997282688 00000100:00100000:2.0:1788890911.440437:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997282688 00000100:00100000:2.0:1788890911.440448:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997282816 00000100:00100000:2.0:1788890911.440450:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997282816 00000100:00100000:2.0:1788890911.440459:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997282944 00000100:00100000:2.0:1788890911.440461:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997282944 00000100:00100000:2.0:1788890911.440470:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997283072 00000100:00100000:2.0:1788890911.440472:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997283072 00000100:00100000:2.0:1788890911.440480:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997283200 00000100:00100000:2.0:1788890911.440482:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997283200 00000100:00100000:2.0:1788890911.440501:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997283328 00000100:00100000:2.0:1788890911.440504:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997283328 00000100:00100000:2.0:1788890911.440517:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788890911.440552:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+9:6490:x1875787997282560:12345-0@lo:104: 00010000:00010000:2.0:1788890911.440566:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925080031200/0xa66601b03fd52b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52b5a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.440624:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788890911.440631:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+9:6490:x1875787997282560:12345-0@lo:104: Request processed in 82us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.440638:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788890911.440658:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788890911.440665:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+8:6490:x1875787997282688:12345-0@lo:104: 00010000:00010000:2.0:1788890911.440674:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52b37 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.440723:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788890911.440729:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+8:6490:x1875787997282688:12345-0@lo:104: Request processed in 65us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.440735:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788890911.440748:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788890911.440754:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+7:6490:x1875787997282816:12345-0@lo:104: 00010000:00010000:2.0:1788890911.440761:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52b0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.440788:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788890911.440794:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+7:6490:x1875787997282816:12345-0@lo:104: Request processed in 41us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.440809:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788890911.440821:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788890911.440827:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+6:6490:x1875787997282944:12345-0@lo:104: 00010000:00010000:2.0:1788890911.440834:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250c214b200/0xa66601b03fd52aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52af1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.440862:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788890911.440867:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+6:6490:x1875787997282944:12345-0@lo:104: Request processed in 41us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.440872:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788890911.440885:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788890911.440891:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+5:6490:x1875787997283072:12345-0@lo:104: 00010000:00010000:2.0:1788890911.440898:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250813ec400/0xa66601b03fd52ace lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.440927:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788890911.440932:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+5:6490:x1875787997283072:12345-0@lo:104: Request processed in 42us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.440938:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788890911.440950:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788890911.440955:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f81fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:6490:x1875787997283200:12345-0@lo:104: 00010000:00010000:2.0:1788890911.440963:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52a96 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.440987:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788890911.440991:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f81fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:6490:x1875787997283200:12345-0@lo:104: Request processed in 37us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.441002:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788890911.441027:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788890911.441033:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:6490:x1875787997283328:12345-0@lo:104: 00010000:00010000:2.0:1788890911.441041:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925080030000/0xa66601b03fd52a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52a6c expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441070:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788890911.441074:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:6490:x1875787997283328:12345-0@lo:104: Request processed in 43us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.441080:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788890911.441102:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788890911.441108:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925080031200/0xa66601b03fd52b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52b5a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441126:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080031200 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890911.441130:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925080031200/0xa66601b03fd52b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52b5a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441139:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925080031200/0xa66601b03fd52b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52b5a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890911.441147:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925080031200/0xa66601b03fd52b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52b5a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890911.441152:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890911.441192:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925080031200/0xa66601b03fd52b53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52b5a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441198:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890911.441223:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925080031200/0xa66601b03fd52b53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52b5a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441230:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925080031200/0xa66601b03fd52b53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52b5a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441243:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788890911.441247:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52b37 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441252:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ec200 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890911.441255:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52b37 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441262:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52b37 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890911.441269:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52b37 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890911.441274:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890911.441286:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52b30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52b37 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441292:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890911.441306:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52b30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52b37 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441312:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52b30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52b37 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441322:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788890911.441331:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52b0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441337:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030800 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890911.441341:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52b0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441348:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890911.441354:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890911.441359:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890911.441373:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52b0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441378:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890911.441384:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52b0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441391:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925080030800/0xa66601b03fd52b0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52b14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441401:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788890911.441403:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250c214b200/0xa66601b03fd52aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52af1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441408:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250c214b200 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890911.441410:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250c214b200/0xa66601b03fd52aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52af1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441427:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250c214b200/0xa66601b03fd52aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52af1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890911.441433:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250c214b200/0xa66601b03fd52aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52af1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890911.441438:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890911.441452:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250c214b200/0xa66601b03fd52aea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52af1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441458:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890911.441463:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250c214b200/0xa66601b03fd52aea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52af1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441470:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250c214b200/0xa66601b03fd52aea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52af1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441480:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788890911.441483:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250813ec400/0xa66601b03fd52ace lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441488:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ec400 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890911.441491:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250813ec400/0xa66601b03fd52ace lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441497:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250813ec400/0xa66601b03fd52ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890911.441503:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250813ec400/0xa66601b03fd52ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890911.441515:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890911.441548:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250813ec400/0xa66601b03fd52ace lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441554:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890911.441559:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250813ec400/0xa66601b03fd52ace lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441565:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250813ec400/0xa66601b03fd52ace lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52ad5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441574:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788890911.441576:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52a96 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441582:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8bc00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890911.441585:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52a96 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441591:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52a96 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890911.441598:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52a96 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890911.441603:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890911.441614:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52a96 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441620:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890911.441631:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52a96 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441638:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8bc00/0xa66601b03fd52a8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52a96 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441648:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788890911.441651:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925080030000/0xa66601b03fd52a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52a6c expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441657:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030000 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890911.441660:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925080030000/0xa66601b03fd52a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52a6c expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441667:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925080030000/0xa66601b03fd52a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52a6c expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890911.441673:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925080030000/0xa66601b03fd52a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52a6c expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890911.441679:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890911.441691:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925080030000/0xa66601b03fd52a65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52a6c expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441696:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890911.441700:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925080030000/0xa66601b03fd52a65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52a6c expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441706:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925080030000/0xa66601b03fd52a65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52a6c expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.441719:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890911.441726:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890911.441728:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890911.441736:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890911.441748:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997283456:0@lo:103: 00000100:00100000:2.0:1788890911.441781:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890911.441803:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997283968:0@lo:103: 00000100:00100000:2.0:1788890911.441835:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890911.441858:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788890911.441864:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997283840:0@lo:103: 00000100:00100000:2.0:1788890911.441886:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890911.441913:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997283584:0@lo:103: 00000100:00100000:2.0:1788890911.441934:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890911.441947:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997284096:0@lo:103: 00000100:00100000:2.0:1788890911.441967:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890911.441978:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788890911.441982:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997283712:0@lo:103: 00000100:00100000:2.0:1788890911.441999:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890911.442006:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997284224:0@lo:103: 00000100:00100000:2.0:1788890911.442019:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890911.442044:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997283456 00000100:00100000:2.0:1788890911.442049:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997283456 00010000:00010000:2.0:1788890911.442069:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925081523800/0xa66601b03fd52b5a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52b53 expref: 22 pid: 6488 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890911.442087:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997283968 00000100:00100000:2.0:1788890911.442090:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997283968 00010000:00010000:2.0:1788890911.442101:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ad5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52ace expref: 23 pid: 6490 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890911.442154:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997283840 00000100:00100000:2.0:1788890911.442157:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997283840 00010000:00010000:2.0:1788890911.442169:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250c214ac00/0xa66601b03fd52af1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52aea expref: 24 pid: 6491 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890911.442180:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997283584 00000100:00100000:2.0:1788890911.442182:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997283584 00010000:00010000:2.0:1788890911.442191:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250813ede00/0xa66601b03fd52b37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52b30 expref: 25 pid: 6491 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890911.442199:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997284096 00000100:00100000:2.0:1788890911.442201:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997284096 00010000:00010000:2.0:1788890911.442208:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250c214ba00/0xa66601b03fd52a96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52a8f expref: 26 pid: 6490 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890911.442216:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997283712 00000100:00100000:2.0:1788890911.442218:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997283712 00010000:00010000:2.0:1788890911.442226:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925080031c00/0xa66601b03fd52b14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52b0d expref: 27 pid: 6490 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890911.442234:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997284224 00000100:00100000:2.0:1788890911.442236:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997284224 00010000:00010000:2.0:1788890911.442245:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250c214b800/0xa66601b03fd52a6c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52a65 expref: 28 pid: 6491 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890911.442259:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788890911.442265:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+28:3628:x1875787997283456:12345-0@lo:103: 00010000:00010000:2.0:1788890911.442277:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890911.442282:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925081523800/0xa66601b03fd52b5a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52b53 expref: 28 pid: 6488 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442302:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925081523800/0xa66601b03fd52b5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52b53 expref: 28 pid: 6488 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442320:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890911.442353:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+28:3628:x1875787997283456:12345-0@lo:103: Request processed in 87us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.442359:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788890911.442375:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788890911.442381:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+27:3628:x1875787997283968:12345-0@lo:103: 00010000:00010000:2.0:1788890911.442389:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890911.442393:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ad5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52ace expref: 27 pid: 6490 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442401:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ad5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52ace expref: 27 pid: 6490 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442410:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890911.442431:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+27:3628:x1875787997283968:12345-0@lo:103: Request processed in 51us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.442437:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788890911.442449:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788890911.442454:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+26:3628:x1875787997283840:12345-0@lo:103: 00010000:00010000:2.0:1788890911.442461:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890911.442465:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250c214ac00/0xa66601b03fd52af1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52aea expref: 26 pid: 6491 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442473:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250c214ac00/0xa66601b03fd52af1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52aea expref: 26 pid: 6491 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442489:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890911.442512:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+26:3628:x1875787997283840:12345-0@lo:103: Request processed in 58us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.442518:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788890911.442557:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788890911.442563:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090430450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+25:3629:x1875787997283584:12345-0@lo:103: 00010000:00010000:2.0:1788890911.442570:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890911.442574:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250813ede00/0xa66601b03fd52b37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52b30 expref: 25 pid: 6491 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442582:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250813ede00/0xa66601b03fd52b37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52b30 expref: 25 pid: 6491 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442591:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890911.442618:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090430450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+25:3629:x1875787997283584:12345-0@lo:103: Request processed in 55us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.442624:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788890911.442658:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788890911.442664:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3629:x1875787997284096:12345-0@lo:103: 00010000:00010000:2.0:1788890911.442671:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890911.442675:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250c214ba00/0xa66601b03fd52a96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52a8f expref: 24 pid: 6490 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442682:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250c214ba00/0xa66601b03fd52a96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52a8f expref: 24 pid: 6490 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442691:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890911.442718:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3629:x1875787997284096:12345-0@lo:103: Request processed in 54us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.442724:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788890911.442737:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788890911.442743:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:3629:x1875787997283712:12345-0@lo:103: 00010000:00010000:2.0:1788890911.442749:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890911.442753:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925080031c00/0xa66601b03fd52b14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52b0d expref: 23 pid: 6490 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442761:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925080031c00/0xa66601b03fd52b14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52b0d expref: 23 pid: 6490 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442771:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890911.442791:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:3629:x1875787997283712:12345-0@lo:103: Request processed in 49us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.442796:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788890911.442808:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788890911.442814:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:3629:x1875787997284224:12345-0@lo:103: 00010000:00010000:2.0:1788890911.442820:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890911.442824:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250c214b800/0xa66601b03fd52a6c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52a65 expref: 22 pid: 6491 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442833:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250c214b800/0xa66601b03fd52a6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52a65 expref: 22 pid: 6491 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442845:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9250813ed600/0xa66601b03fd52b76 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442853:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813ed600/0xa66601b03fd52b76 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442875:0:6482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250813ed600/0xa66601b03fd52b76 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442881:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250813ed600/0xa66601b03fd52b76 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442888:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9250813ed600/0xa66601b03fd52b76 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442894:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9250813ed600/0xa66601b03fd52b76 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442899:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788890911.442903:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9250813ed600/0xa66601b03fd52b76 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442911:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9250813ed600/0xa66601b03fd52b76 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442920:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9250813ed600/0xa66601b03fd52b76 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.442930:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890911.442953:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:3629:x1875787997284224:12345-0@lo:103: Request processed in 139us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.442959:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788890911.443009:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997283712:0@lo:103: 00000100:00100000:2.0:1788890911.443018:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997284224:0@lo:103: 00000100:00100000:2.0:1788890911.443023:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997283584:0@lo:103: 00000100:00100000:2.0:1788890911.443037:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997284096:0@lo:103: 00000100:00100000:2.0:1788890911.443064:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997283840:0@lo:103: 00000100:00100000:2.0:1788890911.443072:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997283456:0@lo:103: 00000100:00100000:2.0:1788890911.443079:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997283968:0@lo:103: 00010000:00010000:3.0:1788890911.443583:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925081523800/0xa66601b03fd52b5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52b53 expref: 21 pid: 6488 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890911.443596:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875787997282560:0@lo:104: 00010000:00010000:3.0:1788890911.443606:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813ede00/0xa66601b03fd52b37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52b30 expref: 20 pid: 6491 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890911.443613:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875787997282688:0@lo:104: 00010000:00010000:3.0:1788890911.443621:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925080031c00/0xa66601b03fd52b14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52b0d expref: 19 pid: 6490 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890911.443629:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875787997282816:0@lo:104: 00010000:00010000:3.0:1788890911.443636:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250c214ac00/0xa66601b03fd52af1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52aea expref: 18 pid: 6491 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890911.443644:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875787997282944:0@lo:104: 00010000:00010000:3.0:1788890911.443653:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250c214be00/0xa66601b03fd52ad5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52ace expref: 17 pid: 6490 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890911.443672:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875787997283072:0@lo:104: 00010000:00010000:3.0:1788890911.443683:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250c214ba00/0xa66601b03fd52a96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52a8f expref: 16 pid: 6490 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890911.443690:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875787997283200:0@lo:104: 00010000:00010000:3.0:1788890911.443698:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250c214b800/0xa66601b03fd52a6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52a65 expref: 15 pid: 6491 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890911.443706:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875787997283328:0@lo:104: 00010000:00010000:3.0:1788890911.443741:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9250813ed600/0xa66601b03fd52b76 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.443751:0:6490:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9250813ed600/0xa66601b03fd52b76 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.443757:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9250813ed600/0xa66601b03fd52b76 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.443763:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813ed600/0xa66601b03fd52b76 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788890911.443778:0:6490:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788890911.446982:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:9487:x1875787997282432:12345-0@lo:253: Request processed in 57703us (58205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890911.446998:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788890911.447133:0:9487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e77100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997282432:0@lo:253: 10000000:01000000:1.0:1788890911.447149:0:9487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788890911.447152:0:9487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788890911.447154:0:9487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788890911.447155:0:9487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788890911.447157:0:9487:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788890911.447158:0:9487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788890911.447160:0:9487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788890911.447161:0:9487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788890911.447163:0:9487:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788890911.447165:0:9487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788890911.447166:0:9487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788890911.447192:0:9487:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9250c12de800 from lustre-OST0001 10000000:01000000:1.0:1788890911.447223:0:9487:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788890911.447226:0:9487:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788890911.447237:0:9487:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff925091ac8000 local copy 10000000:01000000:1.0:1788890911.447241:0:9487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788890911.447283:0:9487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7000/0xa66601b03fd52b7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890911.447293:0:9487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.126@tcp lock: ffff9250b69c7000/0xa66601b03fd52b7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890911.447302:0:9487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250b69c7000/0xa66601b03fd52b7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890911.447320:0:9487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e77100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997284352:0@lo:101: 00000100:00100000:1.0:1788890911.447359:0:9487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890911.447416:0:9487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890911.454575:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997284352 00000100:00100000:2.0:1788890911.454592:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997284352 00000100:00100000:2.0:1788890911.454682:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788890911.454694:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:9487:x1875787997284352:12345-0@lo:101: 00010000:00010000:2.0:1788890911.454863:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890911.454887:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8b200/0xa66601b03fd52b84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52b7d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.454918:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8b200/0xa66601b03fd52b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52b7d expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.454931:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8b200/0xa66601b03fd52b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52b7d expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.454940:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8b200, rc 0) 00000100:00100000:2.0:1788890911.455190:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:9487:x1875787997284352:12345-0@lo:101: Request processed in 497us (7828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.455197:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788890911.455510:0:9487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e77100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997284352:0@lo:101: 00010000:00010000:0.0:1788890911.455547:0:9487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250b69c7000/0xa66601b03fd52b7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa66601b03fd52b84 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890911.455558:0:9487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250b69c7000/0xa66601b03fd52b7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa66601b03fd52b84 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890911.455669:0:9487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997284480:0@lo:501: 00000100:00100000:0.0:1788890911.455707:0:9487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890911.455757:0:9487:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8221c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788890911.456255:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997284480 00000100:00100000:2.0:1788890911.456262:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997284480 00000100:00100000:2.0:1788890911.456304:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788890911.456312:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:9487:x1875787997284480:12345-0@lo:501: 00000100:00100000:2.0:1788890911.456418:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:9487:x1875787997284480:12345-0@lo:501: Request processed in 106us (710us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788890911.456426:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788890911.456631:0:9487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997284480:0@lo:501: 10000000:01000000:3.0:1788890911.456645:0:9487:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788890911.456674:0:9487:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788890911.456680:0:9487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7000/0xa66601b03fd52b7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa66601b03fd52b84 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.456688:0:9487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7000/0xa66601b03fd52b7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa66601b03fd52b84 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.456694:0:9487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9250b69c7000/0xa66601b03fd52b7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa66601b03fd52b84 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.456727:0:9487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788890911.456754:0:9487:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9250c12de800 10000000:01000000:3.0:1788890911.456759:0:9487:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788890911.456764:0:9487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788890911.456767:0:9487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788890911.456772:0:9487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788890911.456775:0:9487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788890911.456797:0:9487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52b8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.456804:0:9487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52b8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.456813:0:9487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52b8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890911.456825:0:9487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997284608:0@lo:101: 00000100:00100000:3.0:1788890911.456856:0:9487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890911.456870:0:9487:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090085180 going to sleep for 11 seconds 00000100:00100000:0.0:1788890911.457024:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997284608 00000100:00100000:0.0:1788890911.457030:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997284608 00000100:00100000:0.0:1788890911.457063:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788890911.457071:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:9487:x1875787997284608:12345-0@lo:101: 00010000:00010000:0.0:1788890911.457081:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890911.457092:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925081522e00/0xa66601b03fd52b92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52b8b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890911.457133:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925081522e00/0xa66601b03fd52b92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52b8b expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890911.457143:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925081522e00/0xa66601b03fd52b92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52b8b expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890911.457151:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925081522e00, rc 0) 00000100:00100000:0.0:1788890911.457182:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:9487:x1875787997284608:12345-0@lo:101: Request processed in 112us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890911.457188:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788890911.457283:0:9487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997284608:0@lo:101: 00010000:00010000:3.0:1788890911.457301:0:9487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52b8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52b92 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.457309:0:9487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52b8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52b92 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890911.457371:0:9487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997284736:0@lo:501: 00000100:00100000:3.0:1788890911.457396:0:9487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890911.457418:0:9487:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090085180 going to sleep for 11 seconds 00000100:00100000:0.0:1788890911.457471:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997284736 00000100:00100000:0.0:1788890911.457475:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997284736 00000100:00100000:0.0:1788890911.457505:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788890911.457511:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a92a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:9487:x1875787997284736:12345-0@lo:501: 00000100:00100000:0.0:1788890911.457623:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a92a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:9487:x1875787997284736:12345-0@lo:501: Request processed in 111us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890911.457629:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788890911.457737:0:9487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997284736:0@lo:501: 00000100:00100000:3.0:1788890911.457761:0:9487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997284864:0@lo:503: 00010000:00010000:2.0:1788890911.458212:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788890911.458220:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250b69c7000/0xa66601b03fd52b7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa66601b03fd52b84 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.458230:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7000 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890911.458234:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c7000/0xa66601b03fd52b7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa66601b03fd52b84 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.458244:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250b69c7000/0xa66601b03fd52b7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa66601b03fd52b84 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890911.458252:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c7000/0xa66601b03fd52b7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa66601b03fd52b84 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890911.458258:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890911.458279:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250b69c7000/0xa66601b03fd52b7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa66601b03fd52b84 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.458286:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890911.458305:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250b69c7000/0xa66601b03fd52b7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa66601b03fd52b84 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.458312:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250b69c7000/0xa66601b03fd52b7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa66601b03fd52b84 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.458324:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890911.458326:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890911.458335:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890911.458348:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997284992:0@lo:103: 00000100:00100000:2.0:1788890911.458384:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890911.458423:0:9487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890911.458448:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997284992 00000100:00100000:3.0:1788890911.458452:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997284864 00000100:00100000:2.0:1788890911.458456:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997284992 00000100:00100000:3.0:1788890911.458458:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997284864 00000100:00100000:3.0:1788890911.458494:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788890911.458504:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a92a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:9487:x1875787997284864:12345-0@lo:503: 00000100:00100000:2.0:1788890911.458507:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788890911.458519:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:3627:x1875787997284992:12345-0@lo:103: 00010000:00010000:2.0:1788890911.458547:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890911.458563:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8b200/0xa66601b03fd52b84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd52b7d expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.458576:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788890911.458767:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a92a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:9487:x1875787997284864:12345-0@lo:503: Request processed in 264us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890911.458774:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788890911.458813:0:9487:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090085180 going to sleep for 11 seconds 00000100:00100000:3.0:1788890911.458829:0:9487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997284864:0@lo:503: 00000100:00100000:2.0:1788890911.458915:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:3627:x1875787997284992:12345-0@lo:103: Request processed in 398us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.458922:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788890911.458957:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997284992:0@lo:103: 00000040:00080000:3.0:1788890911.459081:0:9487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788890911.459169:0:9487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997285120:0@lo:502: 00000100:00100000:3.0:1788890911.459207:0:9487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890911.459237:0:9487:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090085180 going to sleep for 11 seconds 00000100:00100000:0.0:1788890911.459935:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997285120 00000100:00100000:0.0:1788890911.459943:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997285120 00000100:00100000:0.0:1788890911.459982:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788890911.459990:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a92ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:9487:x1875787997285120:12345-0@lo:502: 00000100:00100000:0.0:1788890911.460101:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a92ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:9487:x1875787997285120:12345-0@lo:502: Request processed in 111us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890911.460107:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788890911.460348:0:9487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997285120:0@lo:502: 00000040:00080000:3.0:1788890911.460616:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788890911.460646:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788890911.460659:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788890911.460670:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788890911.460682:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788890911.460694:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788890911.461823:0:9487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997285248:0@lo:502: 00000100:00100000:3.0:1788890911.461902:0:9487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890911.461947:0:9487:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090085180 going to sleep for 11 seconds 00000100:00100000:0.0:1788890911.461963:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997285248 00000100:00100000:0.0:1788890911.461971:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997285248 00000100:00100000:0.0:1788890911.462017:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788890911.462035:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:9487:x1875787997285248:12345-0@lo:502: 00000100:00100000:0.0:1788890911.462170:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:9487:x1875787997285248:12345-0@lo:502: Request processed in 136us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890911.462177:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788890911.462235:0:9487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997285248:0@lo:502: 00000040:00080000:3.0:1788890911.462300:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788890911.462311:0:9487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1788890911.464796:0:9498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788890911.464808:0:9498:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788890911.464816:0:9498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890911.464818:0:9498:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788890911.464825:0:9498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788890911.464841:0:9498:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9250bf6799b8) 00000020:00000080:2.0:1788890911.464867:0:9498:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788890911.464872:0:9498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788890911.464938:0:9498:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9250c12de800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788890911.464948:0:9498:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788890911.464973:0:9498:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa66601b03fd52ba0 00010000:00010000:2.0:1788890911.469265:0:9498:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1788890911.469623:0:9498:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788890911.475621:0:9498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788890911.475973:0:9498:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788890911.492028:0:9498:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788890911.492264:0:9498:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788890911.500459:0:9498:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788890911.503045:0:9498:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788890911.503057:0:9498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788890911.503064:0:9498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890911.503066:0:9498:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788890911.503069:0:9498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788890911.503072:0:9498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890911.503074:0:9498:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788890911.503077:0:9498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788890911.503079:0:9498:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788890911.503102:0:9498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788890911.503105:0:9498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890911.503106:0:9498:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788890911.503109:0:9498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788890911.503555:0:9487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788890911.503598:0:9487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788890911.503615:0:9487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52b8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52b92 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890911.503627:0:9487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52b92 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890911.503636:0:9487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9250c12de800 from 1 10000000:01000000:0.0:1788890911.503638:0:9487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788890911.503675:0:9487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd52ba7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890911.503683:0:9487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd52ba7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890911.503693:0:9487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd52ba7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890911.503714:0:9487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab61500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997285376:0@lo:101: 00000100:00100000:0.0:1788890911.503778:0:9487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890911.503814:0:9487:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8221cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788890911.504015:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997285376 00000100:00100000:2.0:1788890911.504023:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997285376 00000100:00100000:2.0:1788890911.504073:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788890911.504082:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:9487:x1875787997285376:12345-0@lo:101: 00010000:00010000:2.0:1788890911.504096:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890911.504108:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8b200/0xa66601b03fd52bae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52ba7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.504142:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8b200/0xa66601b03fd52bae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52ba7 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.504153:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8b200/0xa66601b03fd52bae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52ba7 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.504161:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8b200, rc 0) 00000100:00100000:2.0:1788890911.504218:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:9487:x1875787997285376:12345-0@lo:101: Request processed in 136us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.504224:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788890911.504572:0:9487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab61500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997285376:0@lo:101: 00010000:00010000:0.0:1788890911.504586:0:9487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd52ba7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52bae expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890911.504607:0:9487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd52ba7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52bae expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890911.504687:0:9487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab61500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997285504:0@lo:501: 00000100:00100000:0.0:1788890911.504715:0:9487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890911.504740:0:9487:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8221cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788890911.504796:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997285504 00000100:00100000:1.0:1788890911.504801:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997285504 00000100:00100000:1.0:1788890911.504829:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788890911.504836:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:9487:x1875787997285504:12345-0@lo:501: 00000100:00100000:0.0:1788890911.504993:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:9487:x1875787997285504:12345-0@lo:501: Request processed in 156us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890911.505000:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788890911.505009:0:9487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab61500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997285504:0@lo:501: 00000100:00100000:1.0:1788890911.505037:0:9487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997285632:0@lo:503: 00000100:00100000:1.0:1788890911.505078:0:9487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890911.505106:0:9487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fb000 going to sleep for 11 seconds 00000100:00100000:0.0:1788890911.505167:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997285632 00000100:00100000:0.0:1788890911.505172:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997285632 00000100:00100000:0.0:1788890911.505204:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788890911.505211:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:9487:x1875787997285632:12345-0@lo:503: 00000100:00100000:0.0:1788890911.505294:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:9487:x1875787997285632:12345-0@lo:503: Request processed in 82us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890911.505300:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788890911.505381:0:9487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997285632:0@lo:503: 00000040:00080000:1.0:1788890911.505633:0:9487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788890911.505705:0:9487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997285760:0@lo:502: 00000100:00100000:1.0:1788890911.505735:0:9487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890911.505760:0:9487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fb000 going to sleep for 11 seconds 00000100:00100000:2.0:1788890911.505818:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997285760 00000100:00100000:2.0:1788890911.505824:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997285760 00000100:00100000:2.0:1788890911.505855:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788890911.505862:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:9487:x1875787997285760:12345-0@lo:502: 00000100:00100000:2.0:1788890911.505944:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:9487:x1875787997285760:12345-0@lo:502: Request processed in 81us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.505951:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788890911.506021:0:9487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997285760:0@lo:502: 00000040:00080000:1.0:1788890911.506235:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788890911.506259:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788890911.506277:0:9487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997285888:0@lo:502: 00000100:00100000:1.0:1788890911.506430:0:9487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890911.506455:0:9487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fb000 going to sleep for 11 seconds 00000100:00100000:2.0:1788890911.506505:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997285888 00000100:00100000:2.0:1788890911.506510:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997285888 00000100:00100000:2.0:1788890911.506557:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788890911.506565:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:9487:x1875787997285888:12345-0@lo:502: 00000100:00100000:2.0:1788890911.506628:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:9487:x1875787997285888:12345-0@lo:502: Request processed in 63us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.506634:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788890911.506714:0:9487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997285888:0@lo:502: 00000040:00080000:1.0:1788890911.506749:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788890911.506756:0:9487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788890911.508194:0:9501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788890911.508205:0:9501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890911.508208:0:9501:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788890911.508215:0:9501:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9250c12de800 00000020:00000080:2.0:1788890911.508217:0:9501:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788890911.508228:0:9501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788890911.508231:0:9501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890911.508233:0:9501:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788890911.508236:0:9501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788890911.508452:0:9487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788890911.508480:0:9487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788890911.508504:0:9487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd52ba7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52bae expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890911.508549:0:9487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd52ba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52bae expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890911.508602:0:9487:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788890911.508605:0:9487:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9250c12de800 10000000:01000000:1.0:1788890911.508608:0:9487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9250c12de800 10000000:01000000:1.0:1788890911.508612:0:9487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788890911.508618:0:9487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9250c12de800 from 1 10000000:01000000:1.0:1788890911.508620:0:9487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788890911.508651:0:9487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c6600/0xa66601b03fd52bb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890911.508662:0:9487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250b69c6600/0xa66601b03fd52bb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890911.508672:0:9487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250b69c6600/0xa66601b03fd52bb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890911.508692:0:9487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997286016:0@lo:101: 00000100:00100000:1.0:1788890911.508747:0:9487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890911.508791:0:9487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788890911.509014:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997286016 00000100:00100000:3.0:1788890911.509021:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997286016 00000100:00100000:3.0:1788890911.509069:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788890911.509087:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:9487:x1875787997286016:12345-0@lo:101: 00010000:00010000:3.0:1788890911.509099:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890911.509120:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250813ede00/0xa66601b03fd52bbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52bb5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.509143:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813ede00/0xa66601b03fd52bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52bb5 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.509154:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250813ede00/0xa66601b03fd52bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52bb5 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.509163:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ede00, rc 0) 00000100:00100000:3.0:1788890911.509220:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:9487:x1875787997286016:12345-0@lo:101: Request processed in 135us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890911.509227:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788890911.509390:0:9487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997286016:0@lo:101: 00010000:00010000:1.0:1788890911.509404:0:9487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250b69c6600/0xa66601b03fd52bb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52bbc expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890911.509413:0:9487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250b69c6600/0xa66601b03fd52bb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52bbc expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890911.509503:0:9487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997286144:0@lo:501: 00000100:00100000:1.0:1788890911.509559:0:9487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890911.509577:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997286144 00000100:00100000:1.0:1788890911.509580:0:9487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788890911.509581:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997286144 00000100:00100000:3.0:1788890911.509602:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788890911.509608:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:9487:x1875787997286144:12345-0@lo:501: 00000100:00100000:2.0:1788890911.511941:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:9487:x1875787997286144:12345-0@lo:501: Request processed in 2326us (2375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.511957:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788890911.512143:0:9487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997286144:0@lo:501: 00000100:00100000:1.0:1788890911.512261:0:9487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997286272:0@lo:503: 00000100:00100000:1.0:1788890911.512389:0:9487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890911.512427:0:9487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788890911.512456:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997286272 00000100:00100000:3.0:1788890911.512463:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997286272 00000100:00100000:3.0:1788890911.512507:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788890911.512516:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:9487:x1875787997286272:12345-0@lo:503: 00000100:00100000:3.0:1788890911.512644:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:9487:x1875787997286272:12345-0@lo:503: Request processed in 129us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890911.512651:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788890911.512663:0:9487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997286272:0@lo:503: 00000040:00080000:2.0:1788890911.512893:0:9487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788890911.512952:0:9487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997286400:0@lo:502: 00000100:00100000:2.0:1788890911.512987:0:9487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890911.513016:0:9487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c0a62b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788890911.513062:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997286400 00000100:00100000:1.0:1788890911.513066:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997286400 00000100:00100000:1.0:1788890911.513095:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788890911.513102:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:9487:x1875787997286400:12345-0@lo:502: 00000100:00100000:1.0:1788890911.513389:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:9487:x1875787997286400:12345-0@lo:502: Request processed in 286us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890911.513397:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788890911.514925:0:9487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997286400:0@lo:502: 00000040:00080000:2.0:1788890911.515381:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788890911.515412:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788890911.515426:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788890911.515439:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788890911.515451:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788890911.515464:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788890911.515477:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788890911.515489:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788890911.515507:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788890911.515519:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788890911.515602:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788890911.515616:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788890911.515629:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788890911.515641:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788890911.515666:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788890911.515682:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788890911.515694:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788890911.515706:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788890911.515719:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788890911.515731:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788890911.515743:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788890911.515756:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788890911.515768:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788890911.515781:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788890911.515802:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788890911.515827:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788890911.515841:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788890911.515852:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788890911.515864:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788890911.515876:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788890911.515888:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788890911.515900:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788890911.515912:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788890911.515924:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788890911.515936:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788890911.515948:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788890911.515961:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1788890911.515972:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788890911.516380:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1788890911.516400:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1788890911.516414:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1788890911.516445:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1788890911.516460:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1788890911.516472:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1788890911.516484:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1788890911.516496:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1788890911.516602:0:9487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997286528:0@lo:502: 00000100:00100000:2.0:1788890911.516674:0:9487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890911.516747:0:9487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c0a62b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788890911.517157:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997286528 00000100:00100000:1.0:1788890911.517165:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997286528 00000100:00100000:1.0:1788890911.517214:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788890911.517221:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:9487:x1875787997286528:12345-0@lo:502: 00000100:00100000:1.0:1788890911.517398:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:9487:x1875787997286528:12345-0@lo:502: Request processed in 176us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890911.517406:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788890911.517501:0:9487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997286528:0@lo:502: 00000040:00080000:2.0:1788890911.520019:0:9487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1788890911.520041:0:9487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1788890911.526236:0:9503:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788890911.526257:0:9503:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9250baa6b370) 00000020:00000080:0.0:1788890911.526286:0:9503:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1788890911.526459:0:9503:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9250c12de800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788890911.526464:0:9503:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9250c12de800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788890911.526468:0:9503:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9250c12de800 3 00010000:00080000:0.0:1788890911.526500:0:9503:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f82210800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.126@tcp at head 00010000:00010000:0.0:1788890911.528907:0:9503:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1788890911.529241:0:9503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788890911.529287:0:9503:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788890911.529299:0:9503:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa66601b03fd52bca 00000100:00080000:0.0:1788890911.529315:0:9503:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788890911.529320:0:9503:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff924f82210800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788890911.529356:0:9503:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9250bab63b80 x1875787997286656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788890911.529487:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1875787997286656:0@lo:38: 00000100:00100000:2.0:1788890911.529588:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890911.529687:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997286656 00000100:00100000:1.0:1788890911.529695:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997286656 00000100:00100000:1.0:1788890911.529730:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788890911.529737:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875787997286656:12345-0@lo:38: 00010000:00080000:1.0:1788890911.529766:0:6497:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 133 last 0 00000020:00000080:1.0:1788890911.529798:0:6497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa66601b03fd52bd1 00000004:00100000:1.0:1788890911.529813:0:6497:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788890911.529842:0:6497:0:(import.c:65:import_set_state_nolock()) ffff924f82ea8800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788890911.529924:0:9503:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788890911.535166:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875787997286656:12345-0@lo:38: Request processed in 5417us (5567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890911.535182:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788890911.535322:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997286784:0@lo:400: 00000100:00100000:1.0:1788890911.535474:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890911.535501:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997287296:0@lo:400: 00000100:00100000:1.0:1788890911.535543:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890911.535566:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788890911.535571:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997287168:0@lo:400: 00000100:00100000:1.0:1788890911.535596:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890911.535612:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997287680:0@lo:400: 00000100:00100000:1.0:1788890911.535632:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890911.535659:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997286912:0@lo:400: 00000100:00100000:1.0:1788890911.535680:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890911.535695:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997287424:0@lo:400: 00000100:00100000:1.0:1788890911.535713:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890911.535726:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788890911.535731:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997287040:0@lo:400: 00000100:00100000:1.0:1788890911.535766:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890911.535781:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997287552:0@lo:400: 00000100:00100000:1.0:1788890911.535799:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890911.535832:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997286784 00000100:00100000:1.0:1788890911.535838:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997286784 00000100:00100000:1.0:1788890911.535866:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997287296 00000100:00100000:1.0:1788890911.535868:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997287296 00000100:00100000:1.0:1788890911.535888:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997287424 00000100:00100000:1.0:1788890911.535890:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997287424 00000100:00100000:1.0:1788890911.535901:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997287040 00000100:00100000:1.0:1788890911.535903:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997287040 00000100:00100000:1.0:1788890911.535915:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788890911.535922:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997286784:12345-0@lo:400: 00000100:00100000:1.0:1788890911.535966:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997286784:12345-0@lo:400: Request processed in 44us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890911.535972:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788890911.535984:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788890911.535989:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875787997287296:12345-0@lo:400: 00000100:00100000:1.0:1788890911.536011:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875787997287296:12345-0@lo:400: Request processed in 23us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890911.536017:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788890911.536026:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788890911.536031:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997287424:12345-0@lo:400: 00000100:00100000:1.0:1788890911.536055:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997287424:12345-0@lo:400: Request processed in 24us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890911.536061:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788890911.536212:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788890911.536220:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997287040:12345-0@lo:400: 00000100:00100000:1.0:1788890911.536249:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997287040:12345-0@lo:400: Request processed in 31us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890911.536255:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788890911.536283:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997287168 00000100:00100000:1.0:1788890911.536286:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997287168 00000100:00100000:1.0:1788890911.536317:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997286912 00000100:00100000:1.0:1788890911.536320:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997286912 00000100:00100000:1.0:1788890911.536331:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788890911.536337:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997287168:12345-0@lo:400: 00000100:00100000:0.0:1788890911.536855:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788890911.536865:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997286912:12345-0@lo:400: 00000100:00100000:1.0:1788890911.536924:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997287168:12345-0@lo:400: Request processed in 586us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890911.536931:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788890911.536953:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997287680 00000100:00100000:1.0:1788890911.536958:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997287680 00000100:00100000:1.0:1788890911.536984:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997287552 00000100:00100000:1.0:1788890911.536988:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997287552 00000100:00100000:1.0:1788890911.537006:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788890911.537012:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997287680:12345-0@lo:400: 00000100:00100000:0.0:1788890911.537222:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997286912:12345-0@lo:400: Request processed in 359us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890911.537229:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788890911.537485:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997287680:12345-0@lo:400: Request processed in 472us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890911.537492:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788890911.537505:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788890911.537511:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997287552:12345-0@lo:400: 00000100:00100000:1.0:1788890911.537580:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997287552:12345-0@lo:400: Request processed in 69us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890911.537586:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788890911.537609:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788890911.537613:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788890911.537616:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788890911.537651:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250c1e75c00 x1875787997287040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890911.537665:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997287040:0@lo:400: 00010000:00080000:1.0:1788890911.537683:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250c1e75500 x1875787997287552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890911.537692:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997287552:0@lo:400: 00000100:00100000:1.0:1788890911.537702:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997286912:0@lo:400: 00010000:00080000:1.0:1788890911.537713:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250c1e74700 x1875787997287424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890911.537722:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997287424:0@lo:400: 00000100:00100000:1.0:1788890911.537756:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997287168:0@lo:400: 00010000:00080000:1.0:1788890911.537766:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250c1e77b80 x1875787997287680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890911.537775:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997287680:0@lo:400: 00010000:00080000:1.0:1788890911.537785:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250c1e75880 x1875787997286784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890911.537793:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997286784:0@lo:400: 00010000:00080000:1.0:1788890911.537803:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250c1e75f80 x1875787997287296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890911.537811:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997287296:0@lo:400: 00000020:01000004:1.0:1788890911.538037:0:9503:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788890911.538052:0:9503:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9250ba88b370) 00000100:00080000:3.0:1788890911.538231:0:9504:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9250baa2ea00 x1875787997287808/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890911.538241:0:9504:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508630df00 going to sleep for 0 seconds 00000020:00000080:1.0:1788890911.538274:0:9503:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1788890911.538351:0:9503:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9250c12de800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788890911.538356:0:9503:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9250c12de800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788890911.538359:0:9503:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9250c12de800 3 00010000:00080000:1.0:1788890911.538465:0:9503:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f82eaa000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1788890911.545329:0:9503:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00010000:00080000:2.0:1788890911.545471:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bab63b80 x1875787997286656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788890921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890911.545485:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788890911.545494:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788890911.545503:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788890911.545508:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788890911.545511:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f82210800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788890911.545518:0:3626:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000088c9e44a): req@ffff9250baa2ea00 x1875787997287808/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890911.545548:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1875787997286656:0@lo:38: 00000100:00100000:2.0:1788890911.545645:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890911.545682:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997287808 00000100:00100000:2.0:1788890911.545688:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997287808 00000100:00100000:2.0:1788890911.545736:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788890911.545744:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9504:x1875787997287808:12345-0@lo:901: 00000100:00100000:2.0:1788890911.545824:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9504:x1875787997287808:12345-0@lo:901: Request processed in 80us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.545831:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788890911.545852:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788890911.545870:0:9504:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250baa2ea00 x1875787997287808/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788890927 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890911.545878:0:9504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9504:1875787997287808:0@lo:901: 00000020:00000080:1.0:1788890911.546303:0:9503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788890911.546348:0:9503:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788890911.546360:0:9503:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xa66601b03fd52bdf 00000100:00080000:1.0:1788890911.546444:0:9503:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788890911.546450:0:9503:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff924f82eaa000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788890911.546480:0:9503:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9250bab52300 x1875787997287936/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788890911.546577:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3626:1875787997287936:0@lo:38: 00000100:00100000:2.0:1788890911.546616:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788890911.546694:0:9503:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788890911.546747:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997287936 00000100:00100000:3.0:1788890911.546752:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997287936 00000100:00100000:3.0:1788890911.546778:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788890911.546784:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3626:x1875787997287936:12345-0@lo:38: 00010000:00080000:3.0:1788890911.546803:0:9362:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 133 last 0 00000020:00000080:3.0:1788890911.546830:0:9362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xa66601b03fd52be6 00000004:00100000:3.0:1788890911.546844:0:9362:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788890911.546871:0:9362:0:(import.c:65:import_set_state_nolock()) ffff924f81eda800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788890911.546915:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875787997287936:12345-0@lo:38: Request processed in 130us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890911.546931:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788890911.546931:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250bab52300 x1875787997287936/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788890921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890911.546950:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788890911.546956:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788890911.546962:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788890911.546966:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788890911.546968:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f82eaa000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788890911.546974:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3626:1875787997287936:0@lo:38: 00000040:00080000:1.0:1788890911.547083:0:9503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1788890911.547274:0:9487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1788890911.547306:0:9487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788890911.547329:0:9487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c6600/0xa66601b03fd52bb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52bbc expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.547339:0:9487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250b69c6600/0xa66601b03fd52bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52bbc expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788890911.547395:0:9487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788890911.547397:0:9487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788890911.547399:0:9487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788890911.547400:0:9487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788890911.547402:0:9487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788890911.547403:0:9487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788890911.547405:0:9487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788890911.547406:0:9487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788890911.547408:0:9487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788890911.547410:0:9487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788890911.547411:0:9487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788890911.547415:0:9487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788890911.547417:0:9487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788890911.547418:0:9487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788890911.547420:0:9487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788890911.547421:0:9487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788890911.547422:0:9487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788890911.547423:0:9487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788890911.547424:0:9487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788890911.547425:0:9487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788890911.547426:0:9487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788890911.547427:0:9487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788890911.547428:0:9487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788890911.547442:0:9487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788890911.547454:0:9487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997288064:0@lo:253: 00000100:00100000:3.0:1788890911.547491:0:9487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890911.547518:0:9487:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508630da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788890911.547677:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997288064 00000100:00100000:1.0:1788890911.547683:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997288064 00000100:00100000:1.0:1788890911.547721:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788890911.547728:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:9487:x1875787997288064:12345-0@lo:253: 20000000:01000000:1.0:1788890911.547748:0:6491:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788890911.547760:0:6491:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788890911.561759:0:6491:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788890911.561823:0:6491:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788890911.563185:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:9487:x1875787997288064:12345-0@lo:253: Request processed in 15449us (15686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890911.563199:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788890911.563321:0:9487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9487:1875787997288064:0@lo:253: 10000000:01000000:0.0:1788890911.563336:0:9487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788890911.563339:0:9487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788890911.563341:0:9487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788890911.563342:0:9487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788890911.563344:0:9487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788890911.563345:0:9487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788890911.563346:0:9487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788890911.563348:0:9487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788890911.563350:0:9487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788890911.563351:0:9487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788890911.563352:0:9487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788890911.563354:0:9487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788890911.563377:0:9487:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788890911.566459:0:6511:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788890911.566722:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788890911.567018:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9250813ed200/0xa66601b03fd52bed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.567040:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925091a8b600/0xa66601b03fd52ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52adc expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.567049:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250813eda00/0xa66601b03fd52b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52b22 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.567058:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9250813ed200/0xa66601b03fd52bed lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.567237:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250813eda00/0xa66601b03fd52b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52b22 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.567252:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250813eda00/0xa66601b03fd52b29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52b22 expref: 16 pid: 6488 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890911.567268:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6511:1875787997288192:0@lo:104: 00000100:00100000:3.0:1788890911.567335:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788890911.567453:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925091a8b600/0xa66601b03fd52ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52adc expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890911.567475:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925091a8b600/0xa66601b03fd52ae3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52adc expref: 16 pid: 6488 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890911.567505:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6511:1875787997288320:0@lo:104: 00000100:00100000:3.0:1788890911.567560:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890911.567753:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508a7c99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890911.567783:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997288192 00000100:00100000:1.0:1788890911.567786:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997288320 00000100:00100000:1.0:1788890911.567791:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997288320 00000100:00100000:2.0:1788890911.567792:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997288192 00000100:00100000:1.0:1788890911.567837:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788890911.567846:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:6511:x1875787997288192:12345-0@lo:104: 00010000:00010000:1.0:1788890911.567869:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250813ec600/0xa66601b03fd52b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52b29 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890911.567942:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788890911.567949:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:6511:x1875787997288192:12345-0@lo:104: Request processed in 104us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890911.567956:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788890911.567983:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788890911.567990:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:6511:x1875787997288320:12345-0@lo:104: 00010000:00010000:1.0:1788890911.567998:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250c214b400/0xa66601b03fd52adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890911.568036:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788890911.568041:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:6511:x1875787997288320:12345-0@lo:104: Request processed in 52us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890911.568047:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788890911.568132:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6511:1875787997288192:0@lo:104: 00000100:00100000:3.0:1788890911.568143:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6511:1875787997288320:0@lo:104: 00010000:00010000:3.0:1788890911.568162:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9250813ed200/0xa66601b03fd52bed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.568631:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788890911.568639:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250813ec600/0xa66601b03fd52b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52b29 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.568647:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ec600 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890911.568652:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250813ec600/0xa66601b03fd52b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52b29 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.568660:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250813ec600/0xa66601b03fd52b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52b29 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890911.568668:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250813ec600/0xa66601b03fd52b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52b29 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890911.568675:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890911.568716:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250813ec600/0xa66601b03fd52b22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52b29 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.568723:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788890911.568776:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997288448:0@lo:103: 00000100:00100000:3.0:1788890911.568814:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788890911.569617:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250813ec600/0xa66601b03fd52b22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52b29 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.569628:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250813ec600/0xa66601b03fd52b22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52b29 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.569644:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788890911.569648:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250c214b400/0xa66601b03fd52adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.569655:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250c214b400 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890911.569658:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250c214b400/0xa66601b03fd52adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.569666:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250c214b400/0xa66601b03fd52adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890911.569673:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250c214b400/0xa66601b03fd52adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890911.569678:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890911.569706:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250c214b400/0xa66601b03fd52adc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.569712:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890911.569728:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250c214b400/0xa66601b03fd52adc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.569735:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250c214b400/0xa66601b03fd52adc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52ae3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.569749:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890911.569759:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890911.569762:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890911.569770:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890911.569787:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997288448 00000100:00100000:2.0:1788890911.569793:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997288448 00010000:00010000:2.0:1788890911.569818:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250813eda00/0xa66601b03fd52b29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52b22 expref: 17 pid: 6488 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890911.569845:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788890911.569854:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:3628:x1875787997288448:12345-0@lo:103: 00010000:00010000:2.0:1788890911.569866:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890911.569872:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250813eda00/0xa66601b03fd52b29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52b22 expref: 17 pid: 6488 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.569884:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250813eda00/0xa66601b03fd52b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52b22 expref: 17 pid: 6488 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.569897:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813eda00/0xa66601b03fd52b29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52b22 expref: 17 pid: 6488 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.569911:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890911.571043:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:3628:x1875787997288448:12345-0@lo:103: Request processed in 1186us (2225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.571054:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788890911.571087:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788890911.571101:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997288576:0@lo:103: 00000100:00100000:2.0:1788890911.571151:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890911.571193:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997288576 00000100:00100000:2.0:1788890911.571198:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997288576 00010000:00010000:2.0:1788890911.571219:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925091a8b600/0xa66601b03fd52ae3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52adc expref: 16 pid: 6488 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890911.571248:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788890911.571255:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:3630:x1875787997288576:12345-0@lo:103: 00010000:00010000:2.0:1788890911.571266:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890911.571445:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925091a8b600/0xa66601b03fd52ae3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52adc expref: 16 pid: 6488 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.571458:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925091a8b600/0xa66601b03fd52ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52adc expref: 16 pid: 6488 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.571552:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8b600/0xa66601b03fd52ae3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52adc expref: 16 pid: 6488 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.571567:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9250813ed200/0xa66601b03fd52bed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.571574:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813ed200/0xa66601b03fd52bed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788890911.571589:0:6482:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008474286s 00010000:00010000:2.0:1788890911.571594:0:6482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250813ed200/0xa66601b03fd52bed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.571600:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250813ed200/0xa66601b03fd52bed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.571606:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9250813ed200/0xa66601b03fd52bed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.571612:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9250813ed200/0xa66601b03fd52bed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.571625:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788890911.571629:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9250813ed200/0xa66601b03fd52bed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.571636:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9250813ed200/0xa66601b03fd52bed lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.571653:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9250813ed200/0xa66601b03fd52bed lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.571664:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890911.571696:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:3630:x1875787997288576:12345-0@lo:103: Request processed in 441us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.571702:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788890911.571736:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997288576:0@lo:103: 00010000:00010000:2.0:1788890911.571767:0:6511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9250813ed200/0xa66601b03fd52bed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.571774:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9250813ed200/0xa66601b03fd52bed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890911.571780:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813ed200/0xa66601b03fd52bed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890911.571988:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997288448:0@lo:103: 00080000:10000000:3.0:1788890911.573041:0:9487:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788890911.573223:0:9487:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788890911.574254:0:9487:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788890911.574815:0:9487:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788890911.575130:0:9487:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788890911.575767:0:9487:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1788890911.577853:0:9487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788890911.602581:0:9487:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788890911.602593:0:9487:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788890911.602659:0:9487:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788890911.602737:0:9487:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788890911.602760:0:9487:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788890911.602784:0:9487:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788890911.604135:0:9487:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788890911.605077:0:9487:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788890911.685385:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788890912.503957:0:9560:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788890912.504219:0:9560:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788890912.701466:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890913.724610:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890914.427682:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997288704:0@lo:41: 00000100:00100000:2.0:1788890914.427750:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890914.427836:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997288704 00000100:00100000:2.0:1788890914.427844:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997288704 00000100:00100000:2.0:1788890914.427893:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788890914.427902:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997288704:12345-0@lo:41: 00000004:00000024:2.0:1788890914.427935:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788890914.427980:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997288704:12345-0@lo:41: Request processed in 78us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890914.427987:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788890914.428033:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997288704:0@lo:41: 00000100:00100000:0.0:1788890914.430562:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997288832:0@lo:13: 00000100:00100000:0.0:1788890914.430621:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890914.430743:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997288960:0@lo:13: 00000100:00100000:1.0:1788890914.430773:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890914.436113:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997288832 00000100:00100000:0.0:1788890914.436131:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997288832 00000100:00100000:0.0:1788890914.436403:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997288960 00000100:00100000:0.0:1788890914.436408:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997288960 00000100:00100000:2.0:1788890914.436588:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788890914.436601:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997288832:12345-0@lo:13: 00002000:00000024:2.0:1788890914.436635:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788890914.436724:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997288832:12345-0@lo:13: Request processed in 127us (6104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890914.436732:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788890914.436993:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788890914.437102:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bab62a00 x1875787997288832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890914.437122:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997288832:0@lo:13: 00000100:00100000:0.0:1788890914.438690:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788890914.438702:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997288960:12345-0@lo:13: 00002000:00000024:0.0:1788890914.438724:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788890914.438782:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997288960:12345-0@lo:13: Request processed in 84us (8008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890914.438789:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788890914.440841:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bab50a80 x1875787997288960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890914.440871:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997288960:0@lo:13: 00010000:00010000:1.0:1788890914.749705:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890915.452214:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997289088:0@lo:41: 00000100:00100000:2.0:1788890915.452291:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890915.452426:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997289088 00000100:00100000:2.0:1788890915.452434:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997289088 00000100:00100000:2.0:1788890915.452479:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788890915.452488:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997289088:12345-0@lo:41: 00000004:00000024:2.0:1788890915.452519:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1788890915.452581:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997289088:12345-0@lo:41: Request processed in 94us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890915.452594:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788890915.452641:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997289088:0@lo:41: 00010000:00010000:0.0:1788890915.773284:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890916.797342:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890916.987910:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997289600:0@lo:400: 00000100:00100000:1.0:1788890916.987994:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890916.988064:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997290112:0@lo:400: 00000100:00100000:1.0:1788890916.988091:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890916.988124:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788890916.988130:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997289216:0@lo:400: 00000100:00100000:1.0:1788890916.988157:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890916.988202:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997289728:0@lo:400: 00000100:00100000:1.0:1788890916.988248:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890916.988269:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997290240:0@lo:400: 00000100:00100000:1.0:1788890916.988298:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890916.988324:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997289344:0@lo:400: 00000100:00100000:1.0:1788890916.988347:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890916.988365:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997289856:0@lo:400: 00000100:00100000:1.0:1788890916.988384:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890916.988397:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997290368:0@lo:400: 00000100:00100000:1.0:1788890916.988419:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890916.988437:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788890916.988442:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997289472:0@lo:400: 00000100:00100000:1.0:1788890916.988668:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890916.988688:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997289984:0@lo:400: 00000100:00100000:1.0:1788890916.988708:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890916.988717:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997290496:0@lo:400: 00000100:00100000:1.0:1788890916.988736:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890916.988761:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997289600 00000100:00100000:1.0:1788890916.988768:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997289600 00000100:00100000:1.0:1788890916.988804:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997289344 00000100:00100000:1.0:1788890916.988807:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997289344 00000100:00100000:1.0:1788890916.988818:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997289856 00000100:00100000:1.0:1788890916.988820:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997289856 00000100:00100000:1.0:1788890916.988842:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997290368 00000100:00100000:1.0:1788890916.988844:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997290368 00000100:00100000:1.0:1788890916.988856:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997289984 00000100:00100000:1.0:1788890916.988859:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997289984 00000100:00100000:1.0:1788890916.988871:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997290496 00000100:00100000:1.0:1788890916.988874:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997290496 00000100:00100000:1.0:1788890916.988889:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788890916.988897:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997289600:12345-0@lo:400: 00000100:00100000:1.0:1788890916.988958:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997289600:12345-0@lo:400: Request processed in 60us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890916.988965:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788890916.988982:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788890916.988988:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997289344:12345-0@lo:400: 00000100:00100000:1.0:1788890916.989035:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997289344:12345-0@lo:400: Request processed in 46us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890916.989041:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788890916.989052:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788890916.989058:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997289856:12345-0@lo:400: 00000100:00100000:1.0:1788890916.989080:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997289856:12345-0@lo:400: Request processed in 23us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890916.989085:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788890916.989095:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788890916.989101:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997290368:12345-0@lo:400: 00000100:00100000:1.0:1788890916.989131:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997290368:12345-0@lo:400: Request processed in 31us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890916.989137:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788890916.989149:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788890916.989156:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997289984:12345-0@lo:400: 00000100:00100000:0.0:1788890916.989635:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788890916.989647:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997290496:12345-0@lo:400: 00000100:00100000:2.0:1788890916.990905:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997289216 00000100:00100000:2.0:1788890916.990916:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997289216 00000100:00100000:2.0:1788890916.990974:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788890916.990983:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:3629:x1875787997289216:12345-0@lo:400: 00000100:00100000:0.0:1788890916.994905:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997290112 00000100:00100000:0.0:1788890916.994920:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997290112 00000100:00100000:0.0:1788890916.994976:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997290240 00000100:00100000:0.0:1788890916.994979:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997290240 00000100:00100000:0.0:1788890916.995016:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788890916.995026:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090311180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997290112:12345-0@lo:400: 00000100:00100000:0.0:1788890916.995105:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090311180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997290112:12345-0@lo:400: Request processed in 81us (7012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890916.995112:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788890916.995128:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788890916.995134:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997290240:12345-0@lo:400: 00000100:00100000:0.0:1788890916.995163:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997290240:12345-0@lo:400: Request processed in 29us (6864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890916.995168:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788890916.995201:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997289728 00000100:00100000:0.0:1788890916.995205:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997289728 00000100:00100000:0.0:1788890916.995228:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997289472 00000100:00100000:0.0:1788890916.995239:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997289472 00000100:00100000:0.0:1788890916.995256:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788890916.995261:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997289728:12345-0@lo:400: 00000100:00100000:0.0:1788890916.995300:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997289728:12345-0@lo:400: Request processed in 39us (7052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890916.995306:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788890916.995317:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788890916.995324:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997289472:12345-0@lo:400: 00000100:00100000:0.0:1788890916.995370:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997289472:12345-0@lo:400: Request processed in 47us (6701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890916.995376:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788890916.995429:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997290496:12345-0@lo:400: Request processed in 5785us (6690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890916.995436:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788890916.998102:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997289984:12345-0@lo:400: Request processed in 8936us (9381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890916.998115:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788890916.998162:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788890916.998167:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788890916.998171:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788890916.998238:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997289728:0@lo:400: 00010000:00080000:1.0:1788890916.998256:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e75500 x1875787997290240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890916.998265:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997290240:0@lo:400: 00010000:00080000:1.0:1788890916.998277:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e75880 x1875787997289600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890916.998285:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997289600:0@lo:400: 00010000:00080000:1.0:1788890916.998296:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e74000 x1875787997290112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890916.998303:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997290112:0@lo:400: 00000100:00100000:1.0:1788890916.998347:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997289472:0@lo:400: 00010000:00080000:1.0:1788890916.998358:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e74700 x1875787997289984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890916.998366:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997289984:0@lo:400: 00010000:00080000:1.0:1788890916.998377:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff925090312680 x1875787997290496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890916.998384:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997290496:0@lo:400: 00010000:00080000:1.0:1788890916.998394:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bab52300 x1875787997289344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890916.998401:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997289344:0@lo:400: 00010000:00080000:1.0:1788890916.998413:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e74a80 x1875787997289856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890916.998434:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997289856:0@lo:400: 00010000:00080000:1.0:1788890916.998461:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e75c00 x1875787997290368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890916.998470:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997290368:0@lo:400: 00000100:00100000:2.0:1788890917.004643:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:3629:x1875787997289216:12345-0@lo:400: Request processed in 13650us (16473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.004975:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997289216:0@lo:400: 00000100:00100000:2.0:1788890917.006849:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 10000000:01000000:2.0:1788890917.499725:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788890917.499733:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9250ba9ab800 from 39 10000000:01000000:2.0:1788890917.499738:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788890917.499794:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8b600/0xa66601b03fd52bf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.499807:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8b600/0xa66601b03fd52bf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.499821:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8b600/0xa66601b03fd52bf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890917.499853:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997290624:0@lo:101: 00000100:00100000:2.0:1788890917.499932:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890917.500002:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6480 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.500126:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997290624 00000100:00100000:1.0:1788890917.500133:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997290624 00000100:00100000:1.0:1788890917.500188:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788890917.500197:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:6493:x1875787997290624:12345-0@lo:101: 00010000:00010000:1.0:1788890917.500210:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890917.500223:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52bfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52bf4 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.500246:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52bf4 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.500256:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52bf4 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.500265:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6e00, rc 0) 00000100:00100000:1.0:1788890917.500319:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997290624:12345-0@lo:101: Request processed in 122us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.500326:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788890917.500434:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997290624:0@lo:101: 00010000:00010000:0.0:1788890917.500451:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8b600/0xa66601b03fd52bf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52bfb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890917.500460:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8b600/0xa66601b03fd52bf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52bfb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890917.500562:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab62680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997290752:0@lo:501: 00000100:00100000:0.0:1788890917.500593:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890917.500610:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509271f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.500683:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997290752 00000100:00100000:1.0:1788890917.500688:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997290752 00000100:00100000:1.0:1788890917.500719:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788890917.500738:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997290752:12345-0@lo:501: 00000100:00100000:1.0:1788890917.500850:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997290752:12345-0@lo:501: Request processed in 113us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.500857:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788890917.500925:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab62680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997290752:0@lo:501: 00000100:00100000:0.0:1788890917.500949:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab62680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997290880:0@lo:503: 00000100:00100000:0.0:1788890917.500989:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890917.501025:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509271f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.501068:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997290880 00000100:00100000:1.0:1788890917.501072:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997290880 00000100:00100000:1.0:1788890917.501097:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788890917.501103:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997290880:12345-0@lo:503: 00000100:00100000:1.0:1788890917.501173:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997290880:12345-0@lo:503: Request processed in 69us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.501179:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788890917.501252:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab62680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997290880:0@lo:503: 00000100:00100000:0.0:1788890917.501614:0:9793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab62680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9793:1875787997291008:0@lo:502: 00000100:00100000:0.0:1788890917.501649:0:9793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890917.501664:0:9793:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509271fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.501731:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997291008 00000100:00100000:1.0:1788890917.501735:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997291008 00000100:00100000:1.0:1788890917.501764:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788890917.501772:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:9793:x1875787997291008:12345-0@lo:502: 00000100:00100000:1.0:1788890917.501848:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:9793:x1875787997291008:12345-0@lo:502: Request processed in 77us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.501855:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788890917.501937:0:9793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab62680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9793:1875787997291008:0@lo:502: 00000100:00100000:0.0:1788890917.501977:0:9793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab62680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9793:1875787997291136:0@lo:502: 00000100:00100000:0.0:1788890917.502022:0:9793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890917.502051:0:9793:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509271fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788890917.505027:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997291136 00000100:00100000:2.0:1788890917.505040:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997291136 00000100:00100000:2.0:1788890917.505115:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788890917.505125:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:9793:x1875787997291136:12345-0@lo:502: 00000100:00100000:2.0:1788890917.505304:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:9793:x1875787997291136:12345-0@lo:502: Request processed in 180us (3280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890917.505313:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788890917.505472:0:9793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab62680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9793:1875787997291136:0@lo:502: 00000040:00080000:0.0:1788890917.505506:0:9793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788890917.506985:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788890917.507027:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788890917.507039:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8b600/0xa66601b03fd52bf4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52bfb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.507049:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8b600/0xa66601b03fd52bf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52bfb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890917.507059:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788890917.507061:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788890917.507064:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788890917.507098:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52c02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.507106:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52c02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.507115:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52c02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890917.507134:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997291264:0@lo:101: 00000100:00100000:2.0:1788890917.507186:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890917.507230:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890917.507285:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997291264 00000100:00100000:0.0:1788890917.507292:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997291264 00000100:00100000:0.0:1788890917.507335:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788890917.507344:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997291264:12345-0@lo:101: 00010000:00010000:0.0:1788890917.507357:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890917.507369:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925081522800/0xa66601b03fd52c09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52c02 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890917.507392:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925081522800/0xa66601b03fd52c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52c02 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890917.507402:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925081522800/0xa66601b03fd52c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52c02 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890917.507411:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925081522800, rc 0) 00000100:00100000:0.0:1788890917.507479:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997291264:12345-0@lo:101: Request processed in 136us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890917.507486:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788890917.509683:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997291264:0@lo:101: 00010000:00010000:2.0:1788890917.509711:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52c02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c09 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.509742:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52c02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52c09 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890917.509825:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997291392:0@lo:501: 00000100:00100000:2.0:1788890917.509878:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890917.509923:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.509987:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997291392 00000100:00100000:1.0:1788890917.510004:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997291392 00000100:00100000:1.0:1788890917.510052:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788890917.510062:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997291392:12345-0@lo:501: 00000100:00100000:1.0:1788890917.510205:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997291392:12345-0@lo:501: Request processed in 144us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.510214:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788890917.510322:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997291392:0@lo:501: 00000100:00100000:2.0:1788890917.510349:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997291520:0@lo:503: 00000100:00100000:2.0:1788890917.510387:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890917.510409:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.512224:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997291520 00000100:00100000:1.0:1788890917.512235:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997291520 00000100:00100000:1.0:1788890917.512298:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788890917.512308:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997291520:12345-0@lo:503: 00000100:00100000:1.0:1788890917.512457:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997291520:12345-0@lo:503: Request processed in 150us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.512465:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788890917.512545:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997291520:0@lo:503: 00000100:00100000:3.0:1788890917.518806:0:9794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9794:1875787997291648:0@lo:502: 00000100:00100000:3.0:1788890917.518888:0:9794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890917.518934:0:9794:0:(client.c:2715:ptlrpc_set_wait()) set ffff925087afa540 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.519604:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997291648 00000100:00100000:1.0:1788890917.519613:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997291648 00000100:00100000:1.0:1788890917.519666:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788890917.519675:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:9794:x1875787997291648:12345-0@lo:502: 00000100:00100000:1.0:1788890917.519818:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:9794:x1875787997291648:12345-0@lo:502: Request processed in 144us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.519826:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788890917.520421:0:9794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9794:1875787997291648:0@lo:502: 00000020:01000000:3.0:1788890917.520455:0:9794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788890917.520465:0:9794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890917.520468:0:9794:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788890917.520472:0:9794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788890917.520474:0:9794:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788890917.520496:0:9794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9794:1875787997291776:0@lo:502: 00000100:00100000:3.0:1788890917.520551:0:9794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890917.520579:0:9794:0:(client.c:2715:ptlrpc_set_wait()) set ffff925087afa540 going to sleep for 11 seconds 00000100:00100000:0.0:1788890917.522347:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997291776 00000100:00100000:0.0:1788890917.522357:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997291776 00000100:00100000:0.0:1788890917.522408:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788890917.522415:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:9794:x1875787997291776:12345-0@lo:502: 00000100:00100000:0.0:1788890917.522600:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:9794:x1875787997291776:12345-0@lo:502: Request processed in 184us (2048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890917.522608:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788890917.522706:0:9794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9794:1875787997291776:0@lo:502: 00000020:01000000:2.0:1788890917.522736:0:9794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788890917.522743:0:9794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890917.522745:0:9794:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788890917.522748:0:9794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788890917.522937:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788890917.522958:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788890917.522967:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52c02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c09 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890917.522978:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52c02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c09 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890917.522988:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788890917.522991:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92508475e000 from 39 10000000:01000000:0.0:1788890917.523002:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788890917.523029:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd52c10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890917.523036:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd52c10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890917.523045:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd52c10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890917.523070:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab62680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997291904:0@lo:101: 00000100:00100000:0.0:1788890917.523102:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890917.523168:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509271f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788890917.525588:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997291904 00000100:00100000:2.0:1788890917.525599:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997291904 00000100:00100000:2.0:1788890917.525651:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788890917.525661:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997291904:12345-0@lo:101: 00010000:00010000:2.0:1788890917.525676:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890917.525693:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8ae00/0xa66601b03fd52c17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52c10 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.525719:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8ae00/0xa66601b03fd52c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52c10 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.525742:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8ae00/0xa66601b03fd52c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52c10 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.525751:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8ae00, rc 0) 00000100:00100000:2.0:1788890917.525814:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997291904:12345-0@lo:101: Request processed in 153us (2711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890917.525820:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788890917.525872:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab62680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997291904:0@lo:101: 00010000:00010000:2.0:1788890917.525889:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd52c10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c17 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.525898:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd52c10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52c17 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890917.525958:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997292032:0@lo:501: 00000100:00100000:2.0:1788890917.525986:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890917.526025:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6240 going to sleep for 11 seconds 00000100:00100000:2.0:1788890917.526037:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997292032 00000100:00100000:2.0:1788890917.526040:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997292032 00000100:00100000:2.0:1788890917.526059:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788890917.526065:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997292032:12345-0@lo:501: 00000100:00100000:2.0:1788890917.526166:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997292032:12345-0@lo:501: Request processed in 101us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890917.526173:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788890917.526199:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997292032:0@lo:501: 00000100:00100000:2.0:1788890917.529046:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997292160:0@lo:503: 00000100:00100000:2.0:1788890917.529131:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890917.529166:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6240 going to sleep for 11 seconds 00000100:00100000:2.0:1788890917.529198:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997292160 00000100:00100000:2.0:1788890917.529203:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997292160 00000100:00100000:2.0:1788890917.529239:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788890917.529247:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997292160:12345-0@lo:503: 00000100:00100000:2.0:1788890917.529338:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997292160:12345-0@lo:503: Request processed in 91us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890917.529346:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788890917.529400:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997292160:0@lo:503: 00000100:00100000:3.0:1788890917.536479:0:9797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9797:1875787997292288:0@lo:502: 00000100:00100000:3.0:1788890917.536615:0:9797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890917.536658:0:9797:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509004a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788890917.536704:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997292288 00000100:00100000:2.0:1788890917.536711:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997292288 00000100:00100000:2.0:1788890917.536762:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788890917.536771:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:9797:x1875787997292288:12345-0@lo:502: 00000100:00100000:2.0:1788890917.536902:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:9797:x1875787997292288:12345-0@lo:502: Request processed in 131us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890917.536909:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788890917.536991:0:9797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9797:1875787997292288:0@lo:502: 00000100:00100000:1.0:1788890917.537053:0:9797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9797:1875787997292416:0@lo:502: 00000100:00100000:1.0:1788890917.537090:0:9797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890917.537112:0:9797:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508a7dad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788890917.537153:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997292416 00000100:00100000:2.0:1788890917.537157:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997292416 00000100:00100000:2.0:1788890917.537186:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788890917.537193:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:9797:x1875787997292416:12345-0@lo:502: 00000100:00100000:2.0:1788890917.537254:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:9797:x1875787997292416:12345-0@lo:502: Request processed in 60us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890917.537260:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788890917.537325:0:9797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9797:1875787997292416:0@lo:502: 00000040:00080000:1.0:1788890917.537343:0:9797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788890917.537481:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788890917.537499:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788890917.537508:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd52c10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c17 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.537553:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd52c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c17 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890917.537562:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788890917.537565:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92508475e000 from 6 10000000:01000000:2.0:1788890917.537567:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788890917.537596:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd52c1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.537604:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd52c1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.537613:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd52c1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890917.537625:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997292544:0@lo:101: 00000100:00100000:2.0:1788890917.537653:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890917.537669:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788890917.537732:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997292544 00000100:00100000:3.0:1788890917.537736:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997292544 00000100:00100000:3.0:1788890917.537770:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788890917.537777:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997292544:12345-0@lo:101: 00010000:00010000:3.0:1788890917.537786:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890917.537799:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250813ed800/0xa66601b03fd52c25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52c1e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890917.537821:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813ed800/0xa66601b03fd52c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52c1e expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890917.537830:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250813ed800/0xa66601b03fd52c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52c1e expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890917.537850:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ed800, rc 0) 00000100:00100000:3.0:1788890917.537882:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:6493:x1875787997292544:12345-0@lo:101: Request processed in 106us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890917.537889:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788890917.537991:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997292544:0@lo:101: 00010000:00010000:2.0:1788890917.538012:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd52c1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c25 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.538021:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd52c1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52c25 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890917.538062:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997292672:0@lo:256: 00000100:00100000:2.0:1788890917.538090:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890917.538117:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788890917.538129:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997292672 00000100:00100000:2.0:1788890917.538132:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997292672 00000100:00100000:2.0:1788890917.538158:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788890917.538164:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:6493:x1875787997292672:12345-0@lo:256: 20000000:01000000:2.0:1788890917.538176:0:6491:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788890917.538192:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788890917.538195:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788890917.538260:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:6493:x1875787997292672:12345-0@lo:256: Request processed in 95us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890917.538267:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788890917.538294:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997292672:0@lo:256: 10000000:01000000:2.0:1788890917.538332:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788890917.538337:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd52c1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c25 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.538345:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd52c1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c25 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890917.538352:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788890917.538353:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1788890917.538355:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788890917.538370:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8ac00/0xa66601b03fd52c2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.538378:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8ac00/0xa66601b03fd52c2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.538385:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8ac00/0xa66601b03fd52c2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890917.538407:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997292800:0@lo:101: 00000100:00100000:2.0:1788890917.538432:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890917.538444:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788890917.538455:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997292800 00000100:00100000:2.0:1788890917.538458:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997292800 00000100:00100000:2.0:1788890917.538475:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788890917.538481:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:6493:x1875787997292800:12345-0@lo:101: 00010000:00010000:2.0:1788890917.538488:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890917.538495:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8bc00/0xa66601b03fd52c33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52c2c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.538508:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8bc00/0xa66601b03fd52c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52c2c expref: 20 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.538517:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8bc00/0xa66601b03fd52c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52c2c expref: 20 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.538545:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8bc00, rc 0) 00000100:00100000:2.0:1788890917.538570:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997292800:12345-0@lo:101: Request processed in 90us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890917.538576:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788890917.538600:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997292800:0@lo:101: 00010000:00010000:2.0:1788890917.538610:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8ac00/0xa66601b03fd52c2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c33 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.538617:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8ac00/0xa66601b03fd52c2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52c33 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890917.538667:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997292928:0@lo:501: 00000100:00100000:2.0:1788890917.538690:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890917.538701:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788890917.538711:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997292928 00000100:00100000:2.0:1788890917.538714:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997292928 00000100:00100000:2.0:1788890917.538728:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788890917.538733:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997292928:12345-0@lo:501: 00000100:00100000:2.0:1788890917.538829:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997292928:12345-0@lo:501: Request processed in 94us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890917.538835:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788890917.538863:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997292928:0@lo:501: 00000100:00100000:2.0:1788890917.538888:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997293056:0@lo:503: 00000100:00100000:2.0:1788890917.538925:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890917.538939:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788890917.538950:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997293056 00000100:00100000:2.0:1788890917.538953:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997293056 00000100:00100000:2.0:1788890917.538968:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788890917.538974:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997293056:12345-0@lo:503: 00000100:00100000:2.0:1788890917.539365:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997293056:12345-0@lo:503: Request processed in 390us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890917.539371:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788890917.539487:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997293056:0@lo:503: 00000100:00100000:3.0:1788890917.539875:0:9798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9798:1875787997293184:0@lo:502: 00000100:00100000:3.0:1788890917.539917:0:9798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890917.539942:0:9798:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f831090c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.539985:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997293184 00000100:00100000:1.0:1788890917.539990:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997293184 00000100:00100000:1.0:1788890917.540034:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788890917.540041:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:9798:x1875787997293184:12345-0@lo:502: 00000100:00100000:1.0:1788890917.540128:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:9798:x1875787997293184:12345-0@lo:502: Request processed in 86us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.540140:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788890917.540205:0:9798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9798:1875787997293184:0@lo:502: 00000020:01000000:3.0:1788890917.540227:0:9798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788890917.540235:0:9798:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788890917.540241:0:9798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890917.540243:0:9798:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788890917.540248:0:9798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788890917.540252:0:9798:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:3.0:1788890917.540274:0:9798:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788890917.540279:0:9798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788890917.540293:0:9798:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff924f81ed0000) 00000020:00000080:3.0:1788890917.540315:0:9798:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788890917.540321:0:9798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788890917.540392:0:9798:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788890917.540399:0:9798:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788890917.540404:0:9798:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa66601b03fd52c41 00010000:00080000:3.0:1788890917.540430:0:9798:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f83107000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.126@tcp at head 00010000:00010000:3.0:1788890917.540670:0:9798:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1788890917.540816:0:9798:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788890917.540828:0:9798:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788890917.541011:0:9798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788890917.541137:0:9798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788890917.541284:0:9798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788890917.541380:0:9798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788890917.549281:0:9799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788890917.549289:0:9799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788890917.549948:0:9798:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788890917.549961:0:9798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788890917.550009:0:9798:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788890917.550036:0:9798:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd52c48 00000100:00080000:1.0:1788890917.550049:0:9798:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788890917.550056:0:9798:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff924f83107000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788890917.550092:0:9798:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f831d9c00 x1875787997293312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788890917.550150:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997293312:0@lo:8: 00000100:00100000:2.0:1788890917.550229:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890917.550321:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997293312 00000100:00100000:3.0:1788890917.550330:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997293312 00000100:00100000:3.0:1788890917.550373:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788890917.550380:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3626:x1875787997293312:12345-0@lo:8: 00010000:00080000:3.0:1788890917.550406:0:8596:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 139 last 0 00000020:00000080:3.0:1788890917.550432:0:8596:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd52c4f 00002000:00100000:3.0:1788890917.550446:0:8596:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff924f83105000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788890917.550450:0:8596:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1788890917.550454:0:8596:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788890917.550518:0:8596:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788890917.550764:0:8596:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788890917.550787:0:8596:0:(import.c:65:import_set_state_nolock()) ffff924f83107800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788890917.551379:0:9798:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788890917.551474:0:9798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890917.551480:0:9798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890917.551482:0:9798:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788890917.551485:0:9798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890917.551493:0:9798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890917.551495:0:9798:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788890917.551497:0:9798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788890917.551499:0:9798:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788890917.551542:0:9798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9798:1875787997293440:0@lo:502: 00000100:00100000:1.0:1788890917.552447:0:9798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890917.552502:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997293440 00000100:00100000:1.0:1788890917.552508:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997293440 00000100:00100000:1.0:1788890917.552570:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788890917.552579:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:9798:x1875787997293440:12345-0@lo:502: 00000100:00100000:1.0:1788890917.552685:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:9798:x1875787997293440:12345-0@lo:502: Request processed in 106us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.552693:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788890917.552741:0:9798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.552768:0:9798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9798:1875787997293440:0@lo:502: 00000020:01000000:1.0:1788890917.552796:0:9798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890917.552801:0:9798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890917.552803:0:9798:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788890917.552806:0:9798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:1.0:1788890917.552864:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1788890917.552886:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788890917.552896:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8ac00/0xa66601b03fd52c2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c33 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.552907:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8ac00/0xa66601b03fd52c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c33 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890917.552918:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788890917.552921:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92509099a000 from 39 10000000:01000000:1.0:1788890917.552924:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788890917.552950:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c6c00/0xa66601b03fd52c56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.552960:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250b69c6c00/0xa66601b03fd52c56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.552970:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250b69c6c00/0xa66601b03fd52c56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890917.552984:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997293568:0@lo:101: 00000100:00100000:1.0:1788890917.553025:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890917.553043:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff925087938840 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.559933:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997293568 00000100:00100000:1.0:1788890917.559948:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997293568 00000100:00100000:1.0:1788890917.560040:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788890917.560051:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997293568:12345-0@lo:101: 00010000:00010000:1.0:1788890917.560069:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890917.560087:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c6200/0xa66601b03fd52c5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52c56 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.560115:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c6200/0xa66601b03fd52c5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52c56 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.560126:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c6200/0xa66601b03fd52c5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52c56 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.560136:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6200, rc 0) 00000100:00100000:1.0:1788890917.560213:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997293568:12345-0@lo:101: Request processed in 163us (7186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.560220:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788890917.560278:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997293568:0@lo:101: 00010000:00010000:1.0:1788890917.560297:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250b69c6c00/0xa66601b03fd52c56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c5d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.560307:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250b69c6c00/0xa66601b03fd52c56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52c5d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890917.560383:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997293696:0@lo:501: 00000100:00100000:1.0:1788890917.560415:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890917.560442:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff925087938840 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.560455:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997293696 00000100:00100000:1.0:1788890917.560458:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997293696 00000100:00100000:1.0:1788890917.560484:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788890917.560497:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997293696:12345-0@lo:501: 00000100:00100000:1.0:1788890917.560676:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997293696:12345-0@lo:501: Request processed in 179us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.560683:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788890917.560710:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997293696:0@lo:501: 00000100:00100000:1.0:1788890917.560738:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997293824:0@lo:503: 00000100:00100000:1.0:1788890917.560777:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890917.560792:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff925087938840 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.560803:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997293824 00000100:00100000:1.0:1788890917.560806:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997293824 00000100:00100000:1.0:1788890917.560828:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788890917.560833:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997293824:12345-0@lo:503: 00000100:00100000:1.0:1788890917.560913:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997293824:12345-0@lo:503: Request processed in 78us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.560919:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788890917.560957:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997293824:0@lo:503: 00000100:00100000:1.0:1788890917.561367:0:9801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9801:1875787997293952:0@lo:502: 00000100:00100000:1.0:1788890917.561403:0:9801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890917.561421:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997293952 00000100:00100000:1.0:1788890917.561425:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997293952 00000100:00100000:1.0:1788890917.561443:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788890917.561449:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:9801:x1875787997293952:12345-0@lo:502: 00000100:00100000:1.0:1788890917.561545:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:9801:x1875787997293952:12345-0@lo:502: Request processed in 95us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.561550:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788890917.561581:0:9801:0:(client.c:2715:ptlrpc_set_wait()) set ffff925095b6f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.561593:0:9801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9801:1875787997293952:0@lo:502: 00000100:00100000:1.0:1788890917.561626:0:9801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9801:1875787997294080:0@lo:502: 00000100:00100000:1.0:1788890917.561654:0:9801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890917.561670:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997294080 00000100:00100000:1.0:1788890917.561673:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997294080 00000100:00100000:1.0:1788890917.561690:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788890917.561695:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:9801:x1875787997294080:12345-0@lo:502: 00000100:00100000:1.0:1788890917.561746:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:9801:x1875787997294080:12345-0@lo:502: Request processed in 50us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.561752:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788890917.561777:0:9801:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82219900 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.561788:0:9801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9801:1875787997294080:0@lo:502: 00000040:00080000:1.0:1788890917.561805:0:9801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788890917.561842:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788890917.561858:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788890917.561864:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c6c00/0xa66601b03fd52c56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c5d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.561873:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250b69c6c00/0xa66601b03fd52c56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c5d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890917.561880:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788890917.561883:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92509099a000 from 6 10000000:01000000:1.0:1788890917.561885:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788890917.561902:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7200/0xa66601b03fd52c64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.561918:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250b69c7200/0xa66601b03fd52c64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.561928:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250b69c7200/0xa66601b03fd52c64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890917.561940:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997294208:0@lo:101: 00000100:00100000:1.0:1788890917.561963:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890917.561975:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82219900 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.561986:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997294208 00000100:00100000:1.0:1788890917.561989:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997294208 00000100:00100000:1.0:1788890917.562022:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788890917.562027:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997294208:12345-0@lo:101: 00010000:00010000:1.0:1788890917.562034:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890917.562045:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c7600/0xa66601b03fd52c6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52c64 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.562062:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c7600/0xa66601b03fd52c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52c64 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.562071:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c7600/0xa66601b03fd52c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52c64 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.562078:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7600, rc 0) 00000100:00100000:1.0:1788890917.562105:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997294208:12345-0@lo:101: Request processed in 78us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.562111:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788890917.562137:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997294208:0@lo:101: 00010000:00010000:1.0:1788890917.562156:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250b69c7200/0xa66601b03fd52c64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c6b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.562163:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250b69c7200/0xa66601b03fd52c64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52c6b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890917.562198:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997294336:0@lo:256: 00000100:00100000:1.0:1788890917.562225:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890917.562236:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82219900 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.562246:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997294336 00000100:00100000:1.0:1788890917.562249:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997294336 00000100:00100000:1.0:1788890917.562266:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788890917.562272:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997294336:12345-0@lo:256: 20000000:01000000:1.0:1788890917.562284:0:6490:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788890917.562299:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788890917.562302:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788890917.562366:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997294336:12345-0@lo:256: Request processed in 94us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.562373:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788890917.562398:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997294336:0@lo:256: 10000000:01000000:1.0:1788890917.562432:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788890917.562437:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7200/0xa66601b03fd52c64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c6b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.562444:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250b69c7200/0xa66601b03fd52c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c6b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890917.562451:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788890917.562456:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788890917.562458:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788890917.562470:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7800/0xa66601b03fd52c72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.562477:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250b69c7800/0xa66601b03fd52c72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.562484:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250b69c7800/0xa66601b03fd52c72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890917.562494:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997294464:0@lo:101: 00000100:00100000:1.0:1788890917.562516:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890917.562550:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82219900 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.562561:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997294464 00000100:00100000:1.0:1788890917.562564:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997294464 00000100:00100000:1.0:1788890917.562582:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788890917.562587:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997294464:12345-0@lo:101: 00010000:00010000:1.0:1788890917.562594:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890917.562600:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c7400/0xa66601b03fd52c79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52c72 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.562613:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c7400/0xa66601b03fd52c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52c72 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.562621:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c7400/0xa66601b03fd52c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52c72 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.562628:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7400, rc 0) 00000100:00100000:1.0:1788890917.562651:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997294464:12345-0@lo:101: Request processed in 64us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.562662:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788890917.562688:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997294464:0@lo:101: 00010000:00010000:1.0:1788890917.562697:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250b69c7800/0xa66601b03fd52c72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c79 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890917.562705:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250b69c7800/0xa66601b03fd52c72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52c79 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890917.562739:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997294592:0@lo:501: 00000100:00100000:1.0:1788890917.562762:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890917.562774:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82219900 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.562784:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997294592 00000100:00100000:1.0:1788890917.562787:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997294592 00000100:00100000:1.0:1788890917.562806:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788890917.562812:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997294592:12345-0@lo:501: 00000100:00100000:1.0:1788890917.562891:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997294592:12345-0@lo:501: Request processed in 79us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.562898:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788890917.562922:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997294592:0@lo:501: 00000100:00100000:1.0:1788890917.562942:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997294720:0@lo:503: 00000100:00100000:1.0:1788890917.562970:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890917.562981:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82219900 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.563002:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997294720 00000100:00100000:1.0:1788890917.563005:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997294720 00000100:00100000:1.0:1788890917.563024:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788890917.563029:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997294720:12345-0@lo:503: 00000100:00100000:1.0:1788890917.563095:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997294720:12345-0@lo:503: Request processed in 65us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.563102:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788890917.563134:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997294720:0@lo:503: 00000100:00100000:3.0:1788890917.569737:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3626:x1875787997293312:12345-0@lo:8: Request processed in 19345us (19496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890917.569753:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788890917.569867:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f831d9c00 x1875787997293312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788890927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890917.569892:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788890917.569903:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788890917.569913:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788890917.569918:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788890917.569921:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f83107000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788890917.569943:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788890917.569950:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997293312:0@lo:8: 00000100:00100000:3.0:1788890917.570193:0:9800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9800:1875787997294848:0@lo:700: 00000100:00100000:3.0:1788890917.570254:0:9800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890917.570289:0:9800:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83109d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788890917.570342:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997294848 00000100:00100000:2.0:1788890917.570349:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997294848 00000100:00100000:2.0:1788890917.570409:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788890917.570419:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9800:x1875787997294848:12345-0@lo:700: 00000100:00100000:2.0:1788890917.570454:0:8418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8418:1875787997294976:0@lo:700: 00000100:00100000:2.0:1788890917.570482:0:8418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890917.570498:0:8418:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab15d80 going to sleep for 11 seconds 00000100:00080000:3.0:1788890917.570564:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788890917.570683:0:9799:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788890917.570753:0:9799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 139815230115ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788890917.570760:0:9799:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788890917.570810:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997294976 00000100:00100000:1.0:1788890917.570813:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997294976 00000100:00100000:1.0:1788890917.570846:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788890917.570852:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8418:x1875787997294976:12345-0@lo:700: 00000100:00100000:2.0:1788890917.571030:0:9802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823eb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9802:1875787997295104:0@lo:502: 00000100:00100000:2.0:1788890917.571076:0:9802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890917.571109:0:9802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab15780 going to sleep for 11 seconds 00000100:00100000:1.0:1788890917.571416:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997295104 00000100:00100000:1.0:1788890917.571421:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997295104 00000100:00100000:1.0:1788890917.571457:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788890917.571466:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:9802:x1875787997295104:12345-0@lo:502: 00000100:00100000:3.0:1788890917.572678:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:9802:x1875787997295104:12345-0@lo:502: Request processed in 1210us (1597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890917.572687:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788890917.572848:0:9802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823eb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9802:1875787997295104:0@lo:502: 00000020:01000000:2.0:1788890917.572880:0:9802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788890917.572887:0:9802:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788890917.572893:0:9802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890917.572896:0:9802:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788890917.572900:0:9802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788890917.572904:0:9802:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:2.0:1788890917.572925:0:9802:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788890917.572928:0:9802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788890917.572951:0:9802:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9250bf67b370) 00000020:00000080:2.0:1788890917.572973:0:9802:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1788890917.572982:0:9802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788890917.573075:0:9802:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788890917.573081:0:9802:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788890917.573088:0:9802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd52c87 00010000:00080000:2.0:1788890917.573115:0:9802:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f81c20000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:2.0:1788890917.573345:0:9802:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1788890917.573451:0:9802:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788890917.573462:0:9802:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788890917.573645:0:9802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788890917.573793:0:9802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788890917.573923:0:9802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788890917.574053:0:9802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788890917.582592:0:9803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788890917.582601:0:9803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788890917.584321:0:9802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788890917.584335:0:9802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788890917.584373:0:9802:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788890917.584400:0:9802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd52c8e 00000100:00080000:2.0:1788890917.584411:0:9802:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788890917.584417:0:9802:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff924f81c20000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788890917.584451:0:9802:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f823eb100 x1875787997295232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788890917.584494:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997295232:0@lo:8: 00000004:00080000:3.0:1788890917.584680:0:7425:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788890917.584834:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788890917.584919:0:9802:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788890917.584971:0:9802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788890917.584975:0:9802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890917.584978:0:9802:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788890917.584981:0:9802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788890917.584984:0:9802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890917.585001:0:9802:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788890917.585006:0:9802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788890917.585009:0:9802:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788890917.585035:0:9802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9802:1875787997295360:0@lo:502: 00000100:00100000:2.0:1788890917.585078:0:9802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890917.585106:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997295360 00000100:00100000:2.0:1788890917.585113:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997295360 00000100:00100000:2.0:1788890917.585154:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788890917.585163:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:9802:x1875787997295360:12345-0@lo:502: 00000100:00100000:2.0:1788890917.585289:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:9802:x1875787997295360:12345-0@lo:502: Request processed in 125us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890917.585297:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788890917.585342:0:9802:0:(client.c:2715:ptlrpc_set_wait()) set ffff925087afa840 going to sleep for 11 seconds 00000100:00100000:2.0:1788890917.585361:0:9802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:9802:1875787997295360:0@lo:502: 00000020:01000000:2.0:1788890917.585382:0:9802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788890917.585386:0:9802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890917.585388:0:9802:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788890917.585391:0:9802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1788890917.585437:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1788890917.585454:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788890917.585464:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7800/0xa66601b03fd52c72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c79 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.585475:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250b69c7800/0xa66601b03fd52c72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c79 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890917.585485:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788890917.585487:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff925091ac8000 from 1 10000000:01000000:2.0:1788890917.585490:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788890917.585516:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8b800/0xa66601b03fd52c95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.585543:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8b800/0xa66601b03fd52c95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890917.585553:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8b800/0xa66601b03fd52c95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890917.585565:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997295488:0@lo:101: 00000100:00100000:2.0:1788890917.585589:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890917.585601:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff925087afa840 going to sleep for 11 seconds 00000100:00100000:3.0:1788890917.585931:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997295488 00000100:00100000:3.0:1788890917.585936:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997295488 00000100:00100000:3.0:1788890917.585968:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788890917.585976:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997295488:12345-0@lo:101: 00010000:00010000:3.0:1788890917.585985:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890917.586009:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250813ece00/0xa66601b03fd52c9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52c95 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890917.586032:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813ece00/0xa66601b03fd52c9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52c95 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890917.586042:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250813ece00/0xa66601b03fd52c9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52c95 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890917.586050:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ece00, rc 0) 00000100:00100000:3.0:1788890917.586087:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:6493:x1875787997295488:12345-0@lo:101: Request processed in 112us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890917.586093:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788890917.586126:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997295488:0@lo:101: 00010000:00010000:3.0:1788890917.586138:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8b800/0xa66601b03fd52c95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c9c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890917.586147:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8b800/0xa66601b03fd52c95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52c9c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890917.586195:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997295616:0@lo:501: 00000100:00100000:3.0:1788890917.586220:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890917.586242:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83109cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788890917.586255:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997295616 00000100:00100000:3.0:1788890917.586266:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997295616 00000100:00100000:3.0:1788890917.586290:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788890917.586297:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:6493:x1875787997295616:12345-0@lo:501: 00000100:00100000:3.0:1788890917.586363:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:6493:x1875787997295616:12345-0@lo:501: Request processed in 66us (141us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788890917.586370:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788890917.586399:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997295616:0@lo:501: 10000000:01000000:3.0:1788890917.586421:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788890917.586427:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8b800/0xa66601b03fd52c95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c9c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890917.586435:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8b800/0xa66601b03fd52c95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c9c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 40000000:02000000:2.0:1788890917.592556:0:6502:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1788890917.595694:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997295232 00000100:00100000:1.0:1788890917.595708:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997295232 00000100:00100000:1.0:1788890917.595753:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788890917.595762:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1875787997295232:12345-0@lo:8: 00010000:00080000:1.0:1788890917.595796:0:8411:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 139 last 0 00000020:00000080:1.0:1788890917.595827:0:8411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd52ca3 00002000:00100000:1.0:1788890917.595842:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9250baadf800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788890917.595846:0:8411:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788890917.595850:0:8411:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788890917.595935:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788890917.595959:0:8411:0:(import.c:65:import_set_state_nolock()) ffff9250baadd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788890917.596050:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3626:x1875787997295232:12345-0@lo:8: Request processed in 288us (11216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890917.596058:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788890917.596614:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f823eb100 x1875787997295232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788890927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890917.596627:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788890917.596635:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788890917.596641:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788890917.596647:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788890917.596649:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f81c20000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788890917.596664:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788890917.596669:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997295232:0@lo:8: 00000004:00080000:1.0:1788890917.596696:0:9803:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788890917.596759:0:9803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 139841235212ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788890917.596764:0:9803:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788890917.601644:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8418:x1875787997294976:12345-0@lo:700: Request processed in 30784us (31152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890917.601662:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788890917.601724:0:8418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f823e8380 x1875787997294976/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788890933 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890917.601738:0:8418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8418:1875787997294976:0@lo:700: 40000000:02000000:2.0:1788890917.601751:0:8418:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000004:00080000:2.0:1788890917.629495:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788890917.631774:0:9804:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788890917.631804:0:9804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823ea680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9804:1875787997295872:0@lo:7: 00000100:00100000:2.0:1788890917.631870:0:9804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890917.631908:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997295872 00000100:00100000:2.0:1788890917.631914:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997295872 00000100:00100000:2.0:1788890917.631964:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788890917.631972:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9804:x1875787997295872:12345-0@lo:7: 00000100:00100000:1.0:1788890917.634537:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997295744:0@lo:13: 00000100:00100000:1.0:1788890917.634606:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788890917.634905:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1788890917.651110:0:8408:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788890917.651120:0:8408:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788890917.651210:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9804:x1875787997295872:12345-0@lo:7: Request processed in 19233us (19335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890917.651222:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788890917.651271:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997295744 00000100:00100000:2.0:1788890917.651279:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997295744 00000100:00100000:2.0:1788890917.651331:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788890917.651340:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3629:x1875787997295744:12345-0@lo:13: 00002000:00000024:2.0:1788890917.651367:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:2.0:1788890917.651408:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3629:x1875787997295744:12345-0@lo:13: Request processed in 70us (16802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890917.651415:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788890917.651634:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f823e8380 x1875787997295744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890917.651655:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997295744:0@lo:13: 00000100:00100000:3.0:1788890917.653308:0:9804:0:(client.c:2715:ptlrpc_set_wait()) set ffff925087afa180 going to sleep for 11 seconds 00010000:00080000:3.0:1788890917.653348:0:9804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f823ea680 x1875787997295872/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788890933 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890917.653362:0:9804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823ea680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9804:1875787997295872:0@lo:7: 00000004:00080000:3.0:1788890917.653378:0:9804:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788890917.653427:0:9804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9804:1875787997296000:0@lo:5: 00000100:00100000:3.0:1788890917.653480:0:9804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890917.653520:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997296000 00000100:00100000:3.0:1788890917.653551:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997296000 00000100:00100000:3.0:1788890917.653596:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788890917.653606:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9804:x1875787997296000:12345-0@lo:5: 00002000:00080000:3.0:1788890917.653630:0:8411:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788890917.653634:0:8411:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788890917.653959:0:9804:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83109240 going to sleep for 11 seconds 00000001:00100000:3.0:1788890917.664886:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788890917.664898:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788890917.666615:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9800:x1875787997294848:12345-0@lo:700: Request processed in 96189us (96352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890917.666630:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788890917.672038:0:9800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250baa2df80 x1875787997294848/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788890933 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890917.672057:0:9800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9800:1875787997294848:0@lo:700: 00000001:00080000:1.0:1788890917.675378:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1788890917.675663:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9804:x1875787997296000:12345-0@lo:5: Request processed in 22054us (22177us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788890917.675675:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788890917.675877:0:9804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250baa2ea00 x1875787997296000/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788890933 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890917.675890:0:9804:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788890917.675896:0:9804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9804:1875787997296000:0@lo:5: 00000004:00080000:3.0:1788890917.675912:0:9804:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788890917.675957:0:9804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9804:1875787997296128:0@lo:700: 00000100:00100000:3.0:1788890917.676003:0:9804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890917.676351:0:9804:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83109240 going to sleep for 11 seconds 00000100:00100000:3.0:1788890917.680422:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997296256:0@lo:13: 00000100:00100000:3.0:1788890917.680492:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890917.680571:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997296256 00000100:00100000:3.0:1788890917.680578:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997296256 00000100:00100000:3.0:1788890917.680618:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788890917.680626:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997296256:12345-0@lo:13: 00002000:00000024:3.0:1788890917.680646:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:3.0:1788890917.680693:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997296256:12345-0@lo:13: Request processed in 67us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890917.680701:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788890917.680734:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250baa2c000 x1875787997296256/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890917.680753:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997296256:0@lo:13: 00000004:00080000:3.0:1788890917.680771:0:9800:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788890917.680789:0:9800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9800:1875787997296384:0@lo:7: 00000100:00100000:3.0:1788890917.680812:0:9800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890917.680833:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997296384 00000100:00100000:3.0:1788890917.680836:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997296384 00000100:00100000:3.0:1788890917.680858:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788890917.680864:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9800:x1875787997296384:12345-0@lo:7: 00000100:00100000:2.0:1788890917.681269:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997296128 00000100:00100000:2.0:1788890917.681275:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997296128 00000100:00100000:1.0:1788890917.689367:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788890917.689380:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9804:x1875787997296128:12345-0@lo:700: 00000100:00100000:1.0:1788890917.689504:0:9800:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f831099c0 going to sleep for 11 seconds 00002000:00080000:2.0:1788890917.699182:0:8596:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788890917.699197:0:8596:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788890917.699299:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9800:x1875787997296384:12345-0@lo:7: Request processed in 18428us (18479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890917.699311:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788890917.699853:0:9800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250baa2c000 x1875787997296384/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788890933 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890917.699868:0:9800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9800:1875787997296384:0@lo:7: 00000004:00080000:0.0:1788890917.699882:0:9800:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788890917.699921:0:9800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab63480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9800:1875787997296512:0@lo:5: 00000100:00100000:0.0:1788890917.699959:0:9800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890917.700002:0:9800:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509271f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788890917.700268:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997296512 00000100:00100000:3.0:1788890917.700275:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997296512 00000100:00100000:3.0:1788890917.700324:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788890917.700334:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9800:x1875787997296512:12345-0@lo:5: 00002000:00080000:3.0:1788890917.700366:0:8410:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788890917.700416:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9800:x1875787997296512:12345-0@lo:5: Request processed in 84us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890917.700423:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788890917.700495:0:9800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bab63480 x1875787997296512/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788890933 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890917.700505:0:9800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab63480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9800:1875787997296512:0@lo:5: 00000004:00080000:0.0:1788890917.700512:0:9800:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788890917.701280:0:9800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab63480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9800:1875787997296640:0@lo:5: 00000100:00100000:0.0:1788890917.701315:0:9800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890917.701351:0:9800:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509271f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788890917.701436:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997296640 00000100:00100000:2.0:1788890917.701442:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997296640 00000100:00100000:2.0:1788890917.701484:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788890917.701491:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9800:x1875787997296640:12345-0@lo:5: 00002000:00080000:2.0:1788890917.701536:0:8411:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1788890917.705418:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9800:x1875787997296640:12345-0@lo:5: Request processed in 3922us (4096us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788890917.705431:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788890917.705612:0:9800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bab63480 x1875787997296640/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788890933 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890917.705631:0:9800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab63480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9800:1875787997296640:0@lo:5: 00000004:00080000:2.0:1788890917.705647:0:9800:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788890917.705688:0:9800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823ea680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9800:1875787997296768:0@lo:900: 00000100:00100000:2.0:1788890917.705724:0:9800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890917.705758:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997296768 00000100:00100000:2.0:1788890917.705764:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997296768 00000100:00100000:2.0:1788890917.705806:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788890917.705814:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9800:x1875787997296768:12345-0@lo:900: 00000100:00100000:2.0:1788890917.705857:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9800:x1875787997296768:12345-0@lo:900: Request processed in 44us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890917.705864:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788890917.705883:0:9800:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090298f00 going to sleep for 11 seconds 00010000:00080000:2.0:1788890917.705895:0:9800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f823ea680 x1875787997296768/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788890933 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890917.705904:0:9800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823ea680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9800:1875787997296768:0@lo:900: 00000001:00080000:0.0:1788890917.719897:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1788890917.720097:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9804:x1875787997296128:12345-0@lo:700: Request processed in 30713us (44087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890917.720111:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788890917.720222:0:9804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250baa2ea00 x1875787997296128/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788890933 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890917.720249:0:9804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9804:1875787997296128:0@lo:700: 00000004:02000040:3.0:1788890917.721616:0:9804:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1788890917.725167:0:9804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9804:1875787997296896:0@lo:5: 00000100:00100000:3.0:1788890917.725254:0:9804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890917.725298:0:9804:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83109240 going to sleep for 11 seconds 00000100:00100000:2.0:1788890917.725429:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997296896 00000100:00100000:2.0:1788890917.725437:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997296896 00000100:00100000:2.0:1788890917.725500:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788890917.725510:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9804:x1875787997296896:12345-0@lo:5: 00002000:00080000:2.0:1788890917.730939:0:8410:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788890917.730959:0:8410:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1788890917.732454:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9804:x1875787997296896:12345-0@lo:5: Request processed in 6941us (7195us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788890917.732466:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788890917.733335:0:9804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250baa2ea00 x1875787997296896/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788890933 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890917.733355:0:9804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9804:1875787997296896:0@lo:5: 00000004:00080000:3.0:1788890917.733372:0:9804:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1788890917.820640:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788890918.547048:0:9860:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788890918.850498:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788890919.388256:0:9912:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788890919.388470:0:9912:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788890919.551066:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997297024:0@lo:41: 00000100:00100000:1.0:1788890919.551137:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890919.551201:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788890919.551219:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997297152:0@lo:13: 00000100:00100000:1.0:1788890919.551246:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890919.551280:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997297152 00000100:00100000:1.0:1788890919.551287:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997297152 00000100:00100000:1.0:1788890919.551335:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788890919.551345:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997297152:12345-0@lo:13: 00002000:00000024:1.0:1788890919.551373:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788890919.551415:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997297152:12345-0@lo:13: Request processed in 71us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890919.551423:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788890919.551443:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788890919.551468:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f831d8700 x1875787997297152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890919.551485:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997297152:0@lo:13: 00000100:00100000:0.0:1788890919.553851:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997297024 00000100:00100000:0.0:1788890919.553861:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997297024 00000100:00100000:0.0:1788890919.553903:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788890919.553911:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997297024:12345-0@lo:41: 00000004:00000024:0.0:1788890919.553950:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788890919.554033:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997297024:12345-0@lo:41: Request processed in 123us (2896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890919.554040:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788890919.554066:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997297280:0@lo:13: 00000100:00100000:0.0:1788890919.554099:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890919.554182:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997297024:0@lo:41: 00000100:00100000:0.0:1788890919.554206:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997297280 00000100:00100000:0.0:1788890919.554210:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997297280 00000100:00100000:0.0:1788890919.554246:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788890919.554254:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997297280:12345-0@lo:13: 00002000:00000024:0.0:1788890919.554267:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788890919.554301:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997297280:12345-0@lo:13: Request processed in 48us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890919.554307:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788890919.554323:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788890919.554344:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bab60380 x1875787997297280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890919.554359:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997297280:0@lo:13: 00010000:00010000:2.0:1788890919.870823:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788890920.258007:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1788890920.572330:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788890920.572355:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997297408:0@lo:41: 00000100:00100000:1.0:1788890920.572427:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890920.572555:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997297408 00000100:00100000:2.0:1788890920.572562:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997297408 00000100:00100000:2.0:1788890920.572610:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788890920.572620:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997297408:12345-0@lo:41: 00000004:00000024:2.0:1788890920.572653:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788890920.572701:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997297408:12345-0@lo:41: Request processed in 82us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890920.572708:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788890920.572823:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997297408:0@lo:41: 00010000:00010000:1.0:1788890920.891792:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890921.920022:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788890922.380405:0:10013:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788890922.380706:0:10013:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788890922.621292:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997297536:0@lo:400: 00000100:00100000:2.0:1788890922.621393:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890922.621446:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997298048:0@lo:400: 00000100:00100000:2.0:1788890922.621473:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890922.621492:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997298560:0@lo:400: 00000100:00100000:2.0:1788890922.621598:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890922.621633:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997299072:0@lo:400: 00000100:00100000:3.0:1788890922.621754:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997297536 00000100:00100000:3.0:1788890922.621764:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997297536 00000100:00100000:3.0:1788890922.621822:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788890922.621832:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3627:x1875787997297536:12345-0@lo:400: 00000100:00100000:3.0:1788890922.621891:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3627:x1875787997297536:12345-0@lo:400: Request processed in 60us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890922.621911:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788890922.622141:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890922.622196:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997297536:0@lo:400: 00000100:00100000:2.0:1788890922.622214:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788890922.622220:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997297664:0@lo:400: 00000100:00100000:2.0:1788890922.622248:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890922.622311:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997298560 00000100:00100000:3.0:1788890922.622316:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997298560 00000100:00100000:3.0:1788890922.622356:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997299072 00000100:00100000:3.0:1788890922.622360:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997299072 00000100:00100000:3.0:1788890922.622384:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788890922.622391:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997298560:12345-0@lo:400: 00000100:00100000:3.0:1788890922.622426:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997298560:12345-0@lo:400: Request processed in 36us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890922.622433:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788890922.622443:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788890922.622448:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997299072:12345-0@lo:400: 00000100:00100000:3.0:1788890922.622470:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997299072:12345-0@lo:400: Request processed in 22us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890922.622488:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788890922.622505:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788890922.622510:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890922.622579:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997297920:0@lo:400: 00000100:00100000:3.0:1788890922.622617:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997297792:0@lo:400: 00000100:00100000:2.0:1788890922.622749:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997298176:0@lo:400: 00000100:00100000:2.0:1788890922.622775:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890922.622795:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890922.622823:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997298304:0@lo:400: 00000100:00100000:3.0:1788890922.622859:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997298048 00000100:00100000:3.0:1788890922.622864:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997298048 00000100:00100000:3.0:1788890922.622890:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997297792 00000100:00100000:3.0:1788890922.622905:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997297792 00000100:00100000:3.0:1788890922.622922:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788890922.622928:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997298048:12345-0@lo:400: 00000100:00100000:3.0:1788890922.622967:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997298048:12345-0@lo:400: Request processed in 39us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890922.622973:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788890922.622985:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788890922.622991:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997297792:12345-0@lo:400: 00000100:00100000:3.0:1788890922.623022:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997297792:12345-0@lo:400: Request processed in 31us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890922.623028:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788890922.623212:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997298688:0@lo:400: 00000100:00100000:2.0:1788890922.623240:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890922.623280:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997297664 00000100:00100000:1.0:1788890922.623285:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997297664 00000100:00100000:1.0:1788890922.623317:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997298176 00000100:00100000:1.0:1788890922.623320:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997298176 00000100:00100000:1.0:1788890922.623347:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788890922.623354:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997297664:12345-0@lo:400: 00000100:00100000:1.0:1788890922.623390:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997297664:12345-0@lo:400: Request processed in 37us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890922.623407:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788890922.623422:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788890922.623429:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997298176:12345-0@lo:400: 00000100:00100000:1.0:1788890922.623457:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997298176:12345-0@lo:400: Request processed in 29us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890922.623463:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788890922.623604:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997298048:0@lo:400: 00010000:00080000:2.0:1788890922.623619:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf6ce680 x1875787997298560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890922.623631:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997298560:0@lo:400: 00010000:00080000:2.0:1788890922.623710:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf6cdc00 x1875787997299072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890922.623720:0:3627:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788890922.623736:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997299072:0@lo:400: 00010000:00080000:2.0:1788890922.623761:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f823eb100 x1875787997297664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890922.623768:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997297664:0@lo:400: 00010000:00080000:2.0:1788890922.623778:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c12a5f80 x1875787997298176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890922.623797:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997298176:0@lo:400: 00000100:00100000:1.0:1788890922.624754:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997298688 00000100:00100000:1.0:1788890922.624763:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997298688 00000100:00100000:1.0:1788890922.624804:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788890922.624813:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997298688:12345-0@lo:400: 00000100:00100000:1.0:1788890922.624886:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997298688:12345-0@lo:400: Request processed in 75us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890922.624908:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788890922.624956:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf6cfb80 x1875787997298688/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890922.624970:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997298688:0@lo:400: 00000100:00080000:3.0:1788890922.625879:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890922.625908:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890922.627360:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997298432:0@lo:400: 00000100:00100000:3.0:1788890922.627425:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890922.627449:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997298944:0@lo:400: 00000100:00100000:3.0:1788890922.627493:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890922.627555:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997298432 00000100:00100000:3.0:1788890922.627562:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997298432 00000100:00100000:3.0:1788890922.627619:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997298944 00000100:00100000:3.0:1788890922.627623:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997298944 00000100:00100000:3.0:1788890922.627666:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788890922.627676:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997298432:12345-0@lo:400: 00000100:00100000:3.0:1788890922.627731:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997298432:12345-0@lo:400: Request processed in 56us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890922.627739:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788890922.627755:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788890922.627762:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997298944:12345-0@lo:400: 00000100:00100000:3.0:1788890922.627790:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997298944:12345-0@lo:400: Request processed in 29us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890922.627797:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788890922.627821:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788890922.627825:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890922.627851:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890922.629977:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997298816:0@lo:400: 00000100:00100000:3.0:1788890922.630049:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890922.631006:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997297792:0@lo:400: 00000100:00100000:3.0:1788890922.631202:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997298304 00000100:00100000:1.0:1788890922.631202:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997297920 00000100:00100000:3.0:1788890922.631210:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997298304 00000100:00100000:1.0:1788890922.631210:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997297920 00000100:00100000:1.0:1788890922.631256:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997298816 00000100:00100000:1.0:1788890922.631259:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997298816 00000100:00100000:1.0:1788890922.631277:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788890922.631287:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997297920:12345-0@lo:400: 00000100:00100000:1.0:1788890922.631357:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997297920:12345-0@lo:400: Request processed in 66us (5443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890922.631365:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788890922.631412:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788890922.631608:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1262300 x1875787997297920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890922.631621:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997297920:0@lo:400: 00010000:00080000:2.0:1788890922.631635:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf6ced80 x1875787997298432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890922.631723:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997298432:0@lo:400: 00010000:00080000:2.0:1788890922.631743:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf6cf800 x1875787997298944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890922.631751:0:3630:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788890922.631764:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997298944:0@lo:400: 00000100:00100000:2.0:1788890922.631793:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788890922.631802:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997298304:12345-0@lo:400: 00000100:00100000:2.0:1788890922.631847:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997298304:12345-0@lo:400: Request processed in 47us (3995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890922.631853:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788890922.635254:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788890922.635279:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997298816:12345-0@lo:400: 00000100:00100000:2.0:1788890922.635409:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997298816:12345-0@lo:400: Request processed in 139us (5359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890922.635417:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788890922.639099:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf6cf480 x1875787997298304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890922.639122:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997298304:0@lo:400: 00010000:00080000:3.0:1788890922.639140:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf6cea00 x1875787997298816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890922.639158:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997298816:0@lo:400: 00010000:00010000:1.0:1788890922.940772:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890923.132275:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788890923.132313:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997299200:0@lo:13: 00000100:00100000:3.0:1788890923.132408:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890923.132445:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997299200 00000100:00100000:0.0:1788890923.132457:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997299200 00000100:00100000:0.0:1788890923.132556:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788890923.132569:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997299200:12345-0@lo:13: 00002000:00000024:0.0:1788890923.132608:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788890923.132622:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788890923.132647:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997299328:0@lo:13: 00000100:00100000:0.0:1788890923.132676:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997299200:12345-0@lo:13: Request processed in 110us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890923.132680:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890923.132693:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788890923.132710:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997299328 00000100:00100000:0.0:1788890923.132713:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997299328 00000100:00100000:0.0:1788890923.132729:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788890923.132735:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997299328:12345-0@lo:13: 00002000:00000024:0.0:1788890923.132744:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788890923.132783:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997299328:12345-0@lo:13: Request processed in 48us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890923.132789:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788890923.132837:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f831a3100 x1875787997299200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890923.132859:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997299200:0@lo:13: 00010000:00080000:2.0:1788890923.132915:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82e52a00 x1875787997299328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890923.132928:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997299328:0@lo:13: 00000020:00000004:2.0:1788890923.438438:0:10061:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788890923.438448:0:10061:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1788890923.964069:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890924.667792:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997299456:0@lo:13: 00000100:00100000:3.0:1788890924.667876:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890924.668072:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997299456 00000100:00100000:1.0:1788890924.668081:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997299456 00000100:00100000:1.0:1788890924.668139:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788890924.668150:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997299456:12345-0@lo:13: 00002000:00000024:1.0:1788890924.668181:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788890924.668230:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997299456:12345-0@lo:13: Request processed in 83us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890924.668238:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788890924.668276:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f831daa00 x1875787997299456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890924.668295:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997299456:0@lo:13: 00000100:00080000:3.0:1788890924.668357:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890924.670997:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788890924.671019:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997299584:0@lo:41: 00000100:00100000:3.0:1788890924.671084:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890924.671210:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997299584 00000100:00100000:1.0:1788890924.671217:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997299584 00000100:00100000:1.0:1788890924.671263:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788890924.671273:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997299584:12345-0@lo:41: 00000004:00000024:1.0:1788890924.671305:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788890924.671349:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997299584:12345-0@lo:41: Request processed in 78us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890924.671356:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788890924.671435:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997299584:0@lo:41: 00000100:00100000:3.0:1788890924.671590:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997299712:0@lo:13: 00000100:00100000:3.0:1788890924.671617:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890924.672144:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997299712 00000100:00100000:0.0:1788890924.672151:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997299712 00000100:00100000:0.0:1788890924.672209:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788890924.672217:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997299712:12345-0@lo:13: 00002000:00000024:0.0:1788890924.672234:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788890924.673474:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788890924.674955:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997299712:12345-0@lo:13: Request processed in 2730us (3328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890924.674969:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788890924.678555:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82e52a00 x1875787997299712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890924.678583:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997299712:0@lo:13: 00010000:00010000:1.0:1788890924.987927:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890925.011931:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890925.012022:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987812736 00000100:00100000:2.0:1788890925.012033:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987812736 00000100:00100000:2.0:1788890925.012078:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 178 00000100:00100000:2.0:1788890925.012086:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2390:x1875787987812736:12345-192.168.204.26@tcp:250: 00010000:00080000:2.0:1788890925.012111:0:6488:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 006bd3d3-7a27-4ed0-8905-1d0eccd862a9@192.168.204.26@tcp t0 exp 0000000000000000 cur 147 last 0 00000020:00000080:2.0:1788890925.012138:0:6488:0:(genops.c:1385:class_connect()) connect: client 006bd3d3-7a27-4ed0-8905-1d0eccd862a9, cookie 0xa66601b03fd52caa 00000100:00080000:2.0:1788890925.012274:0:6488:0:(import.c:65:import_set_state_nolock()) ffff924f8325a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788890925.012344:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+5:2390:x1875787987812736:12345-192.168.204.26@tcp:250: Request processed in 256us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890925.012351:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 178 00000100:00100000:3.0:1788890925.016205:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890925.016381:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987812608 00000100:00100000:0.0:1788890925.016392:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987812608 00000100:00100000:0.0:1788890925.016449:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 179 00000100:00100000:0.0:1788890925.016459:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+5:6143:x1875787987812608:12345-192.168.204.26@tcp:101: 00010000:00010000:0.0:1788890925.016474:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890925.016497:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae5000/0xa66601b03fd52cb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddc8b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890925.016554:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae5000/0xa66601b03fd52cb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddc8b expref: 6 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890925.016566:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae5000/0xa66601b03fd52cb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddc8b expref: 6 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890925.016576:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5000, rc 0) 00000100:00100000:0.0:1788890925.016647:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+6:6143:x1875787987812608:12345-192.168.204.26@tcp:101: Request processed in 190us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890925.016655:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 179 00000100:00100000:0.0:1788890925.020346:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890925.020500:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987812864 00000100:00100000:3.0:1788890925.020510:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987812864 00000100:00100000:3.0:1788890925.020608:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 180 00000100:00100000:3.0:1788890925.020619:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+6:6143:x1875787987812864:12345-192.168.204.26@tcp:501: 00000100:00100000:3.0:1788890925.020963:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+6:6143:x1875787987812864:12345-192.168.204.26@tcp:501: Request processed in 345us (625us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788890925.021501:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 180 00000100:00100000:1.0:1788890925.033190:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890925.033496:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987812992 00000100:00100000:2.0:1788890925.033505:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987812992 00000100:00100000:2.0:1788890925.033580:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 181 00000100:00100000:2.0:1788890925.033590:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+6:6143:x1875787987812992:12345-192.168.204.26@tcp:101: 00010000:00010000:2.0:1788890925.033615:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890925.033632:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8a000/0xa66601b03fd52cb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddc92 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890925.033662:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8a000/0xa66601b03fd52cb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddc92 expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890925.033688:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8a000/0xa66601b03fd52cb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddc92 expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890925.033697:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8a000, rc 0) 00000100:00100000:2.0:1788890925.033750:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+7:6143:x1875787987812992:12345-192.168.204.26@tcp:101: Request processed in 161us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890925.033757:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 181 00000100:00100000:0.0:1788890925.037037:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890925.037207:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987813120 00000100:00100000:3.0:1788890925.037227:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987813120 00000100:00100000:3.0:1788890925.037281:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 182 00000100:00100000:3.0:1788890925.037291:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+7:6143:x1875787987813120:12345-192.168.204.26@tcp:501: 00000100:00100000:3.0:1788890925.037435:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+8:6143:x1875787987813120:12345-192.168.204.26@tcp:501: Request processed in 145us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890925.037443:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 182 00000100:00100000:2.0:1788890925.041183:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890925.041321:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987813248 00000100:00100000:1.0:1788890925.041331:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987813248 00000100:00100000:1.0:1788890925.041387:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 183 00000100:00100000:1.0:1788890925.041397:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+8:6143:x1875787987813248:12345-192.168.204.26@tcp:503: 00000100:00100000:1.0:1788890925.041590:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+8:6143:x1875787987813248:12345-192.168.204.26@tcp:503: Request processed in 194us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890925.041616:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 183 00000100:00100000:1.0:1788890925.052046:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890925.052224:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987813376 00000100:00100000:2.0:1788890925.052234:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987813376 00000100:00100000:2.0:1788890925.052285:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 184 00000100:00100000:2.0:1788890925.052295:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+8:6162:x1875787987813376:12345-192.168.204.26@tcp:502: 00000100:00100000:2.0:1788890925.052456:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+8:6162:x1875787987813376:12345-192.168.204.26@tcp:502: Request processed in 161us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890925.052464:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 184 00000100:00100000:0.0:1788890925.114108:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890925.114691:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987813504 00000100:00100000:3.0:1788890925.114702:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987813504 00000100:00100000:3.0:1788890925.114760:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 185 00000100:00100000:3.0:1788890925.114770:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+8:6162:x1875787987813504:12345-192.168.204.26@tcp:502: 00000100:00100000:3.0:1788890925.115092:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+8:6162:x1875787987813504:12345-192.168.204.26@tcp:502: Request processed in 323us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890925.115101:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 185 00000100:00100000:0.0:1788890925.121608:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890925.121859:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987813632 00000100:00100000:1.0:1788890925.121868:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987813632 00000100:00100000:2.0:1788890925.122138:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 186 00000100:00100000:2.0:1788890925.122152:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+8:6143:x1875787987813632:12345-192.168.204.26@tcp:101: 00010000:00010000:2.0:1788890925.122168:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890925.122186:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8be00/0xa66601b03fd52cbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddcc3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890925.122226:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8be00/0xa66601b03fd52cbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddcc3 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890925.122237:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8be00/0xa66601b03fd52cbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddcc3 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890925.122264:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8be00, rc 0) 00000100:00100000:2.0:1788890925.122327:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+9:6143:x1875787987813632:12345-192.168.204.26@tcp:101: Request processed in 179us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890925.122333:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 186 00000100:00100000:1.0:1788890925.128276:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890925.128347:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987813760 00000100:00100000:3.0:1788890925.128357:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987813760 00000100:00100000:3.0:1788890925.128410:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 187 00000100:00100000:3.0:1788890925.128419:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+9:6143:x1875787987813760:12345-192.168.204.26@tcp:256: 20000000:01000000:3.0:1788890925.128443:0:6491:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788890925.128466:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788890925.128470:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788890925.128473:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788890925.128475:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788890925.128477:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788890925.132669:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+9:6143:x1875787987813760:12345-192.168.204.26@tcp:256: Request processed in 4238us (4388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890925.132693:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 187 00000100:00100000:0.0:1788890925.136943:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890925.137176:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987813888 00000100:00100000:1.0:1788890925.137186:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987813888 00000100:00100000:1.0:1788890925.137252:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 188 00000100:00100000:1.0:1788890925.137262:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+9:6143:x1875787987813888:12345-192.168.204.26@tcp:101: 00010000:00010000:1.0:1788890925.137279:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890925.137294:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c7a00/0xa66601b03fd52cc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddcca expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890925.137319:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c7a00/0xa66601b03fd52cc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddcca expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890925.137330:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c7a00/0xa66601b03fd52cc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddcca expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890925.137339:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7a00, rc 0) 00000100:00100000:1.0:1788890925.137391:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6143:x1875787987813888:12345-192.168.204.26@tcp:101: Request processed in 130us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890925.137398:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 188 00000100:00100000:1.0:1788890925.147306:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890925.148125:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987814016 00000100:00100000:3.0:1788890925.148135:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987814016 00000100:00100000:3.0:1788890925.148190:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 189 00000100:00100000:3.0:1788890925.148199:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a92a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6143:x1875787987814016:12345-192.168.204.26@tcp:501: 00000100:00100000:3.0:1788890925.148360:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a92a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6143:x1875787987814016:12345-192.168.204.26@tcp:501: Request processed in 161us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890925.148368:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 189 00000100:00100000:0.0:1788890925.150786:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890925.151011:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987814144 00000100:00100000:2.0:1788890925.151028:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987814144 00000100:00100000:2.0:1788890925.151073:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 190 00000100:00100000:2.0:1788890925.151082:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a92a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6143:x1875787987814144:12345-192.168.204.26@tcp:503: 00000100:00100000:2.0:1788890925.151226:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a92a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6143:x1875787987814144:12345-192.168.204.26@tcp:503: Request processed in 144us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890925.151235:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 190 00000100:00100000:2.0:1788890925.154413:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890925.154498:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987814272 00000100:00100000:1.0:1788890925.154507:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987814272 00000100:00100000:1.0:1788890925.154585:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 191 00000100:00100000:1.0:1788890925.154601:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a92ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6168:x1875787987814272:12345-192.168.204.26@tcp:502: 00000100:00100000:1.0:1788890925.154738:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a92ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6168:x1875787987814272:12345-192.168.204.26@tcp:502: Request processed in 145us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890925.154746:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 191 00000100:00100000:1.0:1788890925.157415:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890925.157489:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987814400 00000100:00100000:3.0:1788890925.157496:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987814400 00000100:00100000:3.0:1788890925.157561:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 192 00000100:00100000:3.0:1788890925.157570:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6168:x1875787987814400:12345-192.168.204.26@tcp:502: 00000100:00100000:3.0:1788890925.157710:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6168:x1875787987814400:12345-192.168.204.26@tcp:502: Request processed in 139us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890925.157717:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 192 00000100:00100000:0.0:1788890925.164421:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890925.164457:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890925.164550:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987814528 00000100:00100000:2.0:1788890925.164559:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987814528 00000100:00100000:2.0:1788890925.164606:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987814784 00000100:00100000:2.0:1788890925.164608:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987814784 00000100:00100000:2.0:1788890925.164630:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:2.0:1788890925.164637:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1875787987814528:12345-192.168.204.26@tcp:38: 00010000:00080000:2.0:1788890925.164665:0:6495:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp t0 exp 0000000000000000 cur 147 last 0 00000020:00000080:2.0:1788890925.164713:0:6495:0:(genops.c:1385:class_connect()) connect: client df03475d-d91a-4e91-8125-742ac4d4c589, cookie 0xa66601b03fd52ccd 00000004:00100000:2.0:1788890925.164736:0:6495:0:(mdt_handler.c:7304:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788890925.164973:0:6495:0:(import.c:65:import_set_state_nolock()) ffff924f8325f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788890925.165044:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+6:2390:x1875787987814528:12345-192.168.204.26@tcp:38: Request processed in 406us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890925.165051:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:2.0:1788890925.165078:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:2.0:1788890925.165083:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1875787987814784:12345-192.168.204.26@tcp:38: 00010000:00080000:2.0:1788890925.165097:0:6495:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp t0 exp 0000000000000000 cur 147 last 0 00000020:00000080:2.0:1788890925.165124:0:6495:0:(genops.c:1385:class_connect()) connect: client df03475d-d91a-4e91-8125-742ac4d4c589, cookie 0xa66601b03fd52cd4 00000004:00100000:2.0:1788890925.165133:0:6495:0:(mdt_handler.c:7304:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788890925.165266:0:6495:0:(import.c:65:import_set_state_nolock()) ffff924f81c25000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788890925.165288:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+6:2390:x1875787987814784:12345-192.168.204.26@tcp:38: Request processed in 204us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890925.165294:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:1.0:1788890925.692764:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788890925.692799:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997299840:0@lo:41: 00000100:00100000:1.0:1788890925.692885:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890925.692952:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997299840 00000100:00100000:2.0:1788890925.692962:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997299840 00000100:00100000:2.0:1788890925.693021:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788890925.693032:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997299840:12345-0@lo:41: 00000004:00000024:2.0:1788890925.693066:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788890925.693118:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997299840:12345-0@lo:41: Request processed in 89us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890925.693125:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788890925.693196:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997299840:0@lo:41: 00010000:00010000:3.0:1788890926.011800:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890926.175483:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890926.175576:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987814656 00000100:00100000:1.0:1788890926.175586:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987814656 00000100:00100000:2.0:1788890926.175593:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890926.175720:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987815040 00000100:00100000:0.0:1788890926.175724:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987815040 00000100:00100000:1.0:1788890926.175767:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:1.0:1788890926.175777:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+7:0:x1875787987814656:12345-192.168.204.26@tcp:41: 00000004:00000024:1.0:1788890926.175814:0:6495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788890926.175838:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890926.175868:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987814912 00000100:00100000:2.0:1788890926.175872:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987814912 00000100:00100000:1.0:1788890926.175882:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+7:0:x1875787987814656:12345-192.168.204.26@tcp:41: Request processed in 107us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890926.175890:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:0.0:1788890926.176044:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:0.0:1788890926.176053:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+7:6143:x1875787987815040:12345-192.168.204.26@tcp:41: 00000004:00000024:0.0:1788890926.176066:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788890926.176091:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+7:6143:x1875787987815040:12345-192.168.204.26@tcp:41: Request processed in 40us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890926.176112:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00080000:3.0:1788890926.178321:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788890926.178331:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890926.178470:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890926.178568:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987815168 00000100:00100000:2.0:1788890926.178575:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987815168 00000100:00100000:2.0:1788890926.178601:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:2.0:1788890926.178611:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+6:0:x1875787987814912:12345-192.168.204.26@tcp:41: 00000100:00100000:0.0:1788890926.178614:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:0.0:1788890926.178628:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+7:6143:x1875787987815168:12345-192.168.204.26@tcp:40: 00000004:00000024:2.0:1788890926.178647:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788890926.178695:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+7:6143:x1875787987815168:12345-192.168.204.26@tcp:40: Request processed in 68us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890926.178696:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+6:0:x1875787987814912:12345-192.168.204.26@tcp:41: Request processed in 85us (2855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890926.178710:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:0.0:1788890926.179551:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:0.0:1788890926.181645:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890926.181718:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987815552 00000100:00100000:2.0:1788890926.181727:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987815552 00000100:00100000:2.0:1788890926.181770:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:2.0:1788890926.181780:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:df03475d-d91a-4e91-8125-742ac4d4c589+6:6143:x1875787987815552:12345-192.168.204.26@tcp:900: 00000100:00100000:2.0:1788890926.181864:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:df03475d-d91a-4e91-8125-742ac4d4c589+6:6143:x1875787987815552:12345-192.168.204.26@tcp:900: Request processed in 85us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890926.181872:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:0.0:1788890926.190286:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890926.190331:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890926.190353:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890926.190713:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987815296 00000100:00100000:3.0:1788890926.190722:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987815296 00000100:00100000:3.0:1788890926.190762:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987815424 00000100:00100000:3.0:1788890926.190765:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987815424 00000100:00100000:2.0:1788890926.190766:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987815680 00000100:00100000:2.0:1788890926.190769:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987815680 00000100:00100000:3.0:1788890926.190785:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:3.0:1788890926.190792:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1875787987815296:12345-192.168.204.26@tcp:8: 00000100:00100000:2.0:1788890926.190800:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 193 00000100:00100000:2.0:1788890926.190806:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:2391:x1875787987815680:12345-192.168.204.26@tcp:400: 00010000:00080000:3.0:1788890926.190836:0:8408:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:3.0:1788890926.190865:0:8408:0:(genops.c:1385:class_connect()) connect: client df03475d-d91a-4e91-8125-742ac4d4c589, cookie 0xa66601b03fd52cdb 00000100:00100000:2.0:1788890926.190874:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:2391:x1875787987815680:12345-192.168.204.26@tcp:400: Request processed in 69us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890926.190881:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 193 00002000:00100000:3.0:1788890926.190888:0:8408:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli df03475d-d91a-4e91-8125-742ac4d4c589/ffff924f83102000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788890926.190904:0:8408:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788890926.190926:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:2.0:1788890926.190931:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1875787987815424:12345-192.168.204.26@tcp:8: 00010000:00080000:2.0:1788890926.190946:0:8411:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:2.0:1788890926.190963:0:8411:0:(genops.c:1385:class_connect()) connect: client df03475d-d91a-4e91-8125-742ac4d4c589, cookie 0xa66601b03fd52ce2 00002000:00100000:2.0:1788890926.190968:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli df03475d-d91a-4e91-8125-742ac4d4c589/ffff9250ba8f4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788890926.190979:0:8411:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788890926.191110:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788890926.191138:0:8411:0:(import.c:65:import_set_state_nolock()) ffff924f82c18800 : changing import state from RECOVER to FULL 00002000:00080000:3.0:1788890926.191154:0:8408:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788890926.191168:0:8408:0:(import.c:65:import_set_state_nolock()) ffff924f83102800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788890926.191171:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+6:2390:x1875787987815424:12345-192.168.204.26@tcp:8: Request processed in 238us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890926.191178:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:3.0:1788890926.191187:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+6:2390:x1875787987815296:12345-192.168.204.26@tcp:8: Request processed in 395us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890926.191193:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:2.0:1788890926.195208:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890926.195309:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987815808 00000100:00100000:0.0:1788890926.195319:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987815808 00000100:00100000:0.0:1788890926.195372:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:0.0:1788890926.195383:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+6:6143:x1875787987815808:12345-192.168.204.26@tcp:33: 00000004:00080000:0.0:1788890926.215961:0:6498:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 20499us 00000004:00200000:0.0:1788890926.235955:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788890926.236067:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+6:6143:x1875787987815808:12345-192.168.204.26@tcp:33: Request processed in 40681us (40864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890926.236078:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:1.0:1788890926.396112:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890926.396236:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987815936 00000100:00100000:2.0:1788890926.396249:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987815936 00000100:00100000:2.0:1788890926.396303:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:2.0:1788890926.396314:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+6:6186:x1875787987815936:12345-192.168.204.26@tcp:101: 00010000:00010000:2.0:1788890926.396334:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890926.396390:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd52ce9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddcfb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890926.396455:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd52cf0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890926.396468:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd52cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890926.396482:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd52cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890926.396548:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788890926.396552:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788890926.396568:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd52cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890926.396592:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd52ce9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddcfb expref: 8 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890926.396610:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd52cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddcfb expref: 7 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890926.396630:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e39700) 00010000:00010000:2.0:1788890926.396633:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788890926.396637:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8a600, rc 0) 00000100:00100000:2.0:1788890926.396699:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+7:6186:x1875787987815936:12345-192.168.204.26@tcp:101: Request processed in 387us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890926.396706:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 13 00010000:00010000:1.0:1788890927.037139:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890927.740062:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997300352:0@lo:400: 00000100:00100000:2.0:1788890927.740154:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890927.740269:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788890927.740276:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997299968:0@lo:400: 00000100:00100000:2.0:1788890927.740308:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890927.740329:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997300480:0@lo:400: 00000100:00100000:2.0:1788890927.740352:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890927.740392:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997300224:0@lo:400: 00000100:00100000:2.0:1788890927.740415:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890927.740431:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788890927.740435:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997300096:0@lo:400: 00000100:00100000:2.0:1788890927.740452:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890927.740482:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997300480 00000100:00100000:2.0:1788890927.740490:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997300480 00000100:00100000:2.0:1788890927.740561:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997300224 00000100:00100000:2.0:1788890927.740565:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997300224 00000100:00100000:2.0:1788890927.740585:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788890927.740593:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997300480:12345-0@lo:400: 00000100:00100000:2.0:1788890927.740653:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997300480:12345-0@lo:400: Request processed in 59us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890927.740667:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788890927.740686:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788890927.740692:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997300224:12345-0@lo:400: 00000100:00100000:2.0:1788890927.740727:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997300224:12345-0@lo:400: Request processed in 35us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890927.740734:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788890927.740778:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997300480:0@lo:400: 00000100:00100000:2.0:1788890927.740822:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997300224:0@lo:400: 00000100:00100000:1.0:1788890927.740983:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997300352 00000100:00100000:1.0:1788890927.740988:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997300352 00000100:00100000:1.0:1788890927.741026:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997300096 00000100:00100000:1.0:1788890927.741028:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997300096 00000100:00100000:1.0:1788890927.741048:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788890927.741055:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997300352:12345-0@lo:400: 00000100:00100000:1.0:1788890927.741094:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997300352:12345-0@lo:400: Request processed in 40us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890927.741109:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788890927.741122:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788890927.741127:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997300096:12345-0@lo:400: 00000100:00100000:1.0:1788890927.741174:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997300096:12345-0@lo:400: Request processed in 46us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890927.741180:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788890927.741205:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997300352:0@lo:400: 00000100:00100000:1.0:1788890927.741229:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997300096:0@lo:400: 00000100:00100000:1.0:1788890927.741244:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997299968 00000100:00100000:1.0:1788890927.741258:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997299968 00000100:00100000:1.0:1788890927.741285:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788890927.741291:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3629:x1875787997299968:12345-0@lo:400: 00000100:00100000:1.0:1788890927.741322:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3629:x1875787997299968:12345-0@lo:400: Request processed in 31us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890927.741328:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788890927.741360:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997299968:0@lo:400: 00000100:00100000:3.0:1788890927.742034:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997300992:0@lo:400: 00000100:00100000:3.0:1788890927.742075:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890927.742103:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997301504:0@lo:400: 00000100:00100000:3.0:1788890927.742121:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890927.742140:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788890927.742146:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997300864:0@lo:400: 00000100:00100000:3.0:1788890927.742168:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890927.742185:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997301376:0@lo:400: 00000100:00100000:3.0:1788890927.742220:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890927.742383:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997300992 00000100:00100000:2.0:1788890927.742389:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997300992 00000100:00100000:2.0:1788890927.742424:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997301504 00000100:00100000:2.0:1788890927.742427:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997301504 00000100:00100000:2.0:1788890927.742439:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997300864 00000100:00100000:2.0:1788890927.742441:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997300864 00000100:00100000:2.0:1788890927.742453:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997301376 00000100:00100000:2.0:1788890927.742455:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997301376 00000100:00100000:2.0:1788890927.742469:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788890927.742476:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997300992:12345-0@lo:400: 00000100:00100000:2.0:1788890927.742541:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997300992:12345-0@lo:400: Request processed in 46us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890927.742548:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788890927.742562:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788890927.742568:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997301504:12345-0@lo:400: 00000100:00100000:2.0:1788890927.742597:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997301504:12345-0@lo:400: Request processed in 30us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890927.742602:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788890927.742621:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788890927.742627:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997300864:12345-0@lo:400: 00000100:00100000:2.0:1788890927.742655:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997300864:12345-0@lo:400: Request processed in 28us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890927.742660:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788890927.742670:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788890927.742677:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997301376:12345-0@lo:400: 00000100:00100000:2.0:1788890927.742701:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997301376:12345-0@lo:400: Request processed in 26us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890927.742707:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788890927.742736:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788890927.742741:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788890927.742770:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f831a3480 x1875787997300864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890927.742784:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997300864:0@lo:400: 00010000:00080000:2.0:1788890927.742810:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f831a3b80 x1875787997301376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890927.742819:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997301376:0@lo:400: 00010000:00080000:2.0:1788890927.742830:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f831a2d80 x1875787997300992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890927.742839:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997300992:0@lo:400: 00010000:00080000:2.0:1788890927.742848:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f831a1500 x1875787997301504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890927.742855:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997301504:0@lo:400: 00000100:00100000:0.0:1788890927.743001:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997300608:0@lo:400: 00000100:00100000:0.0:1788890927.743036:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890927.743066:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997301120:0@lo:400: 00000100:00100000:0.0:1788890927.743102:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890927.743137:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788890927.743144:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997300736:0@lo:400: 00000100:00100000:0.0:1788890927.743168:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890927.743185:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997301248:0@lo:400: 00000100:00100000:0.0:1788890927.743206:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890927.743227:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997300608 00000100:00100000:0.0:1788890927.743231:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997300608 00000100:00100000:2.0:1788890927.743381:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997301120 00000100:00100000:2.0:1788890927.743390:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997301120 00000100:00100000:2.0:1788890927.743410:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997300736 00000100:00100000:2.0:1788890927.743412:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997300736 00000100:00100000:2.0:1788890927.743423:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997301248 00000100:00100000:2.0:1788890927.743425:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997301248 00000100:00100000:2.0:1788890927.743436:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788890927.743442:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997301120:12345-0@lo:400: 00000100:00100000:2.0:1788890927.743488:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997301120:12345-0@lo:400: Request processed in 45us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890927.743494:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788890927.743506:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788890927.743512:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997300736:12345-0@lo:400: 00000100:00100000:2.0:1788890927.743560:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997300736:12345-0@lo:400: Request processed in 48us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890927.743567:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788890927.743578:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788890927.743584:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997301248:12345-0@lo:400: 00000100:00100000:2.0:1788890927.743611:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997301248:12345-0@lo:400: Request processed in 27us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890927.743617:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788890927.743646:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788890927.743650:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890927.743734:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788890927.743742:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997300608:12345-0@lo:400: 00000100:00100000:0.0:1788890927.743775:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997300608:12345-0@lo:400: Request processed in 35us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890927.743780:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788890927.743819:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f831a2680 x1875787997300736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890927.743829:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997300736:0@lo:400: 00010000:00080000:0.0:1788890927.743839:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f831a0700 x1875787997301248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890927.743847:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997301248:0@lo:400: 00000100:00100000:0.0:1788890927.743858:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997300608:0@lo:400: 00000100:00100000:0.0:1788890927.743867:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997301120:0@lo:400: 00010000:00010000:3.0:1788890928.060498:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890928.252553:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788890928.252588:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997301632:0@lo:13: 00000100:00100000:1.0:1788890928.252700:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890928.252901:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997301632 00000100:00100000:2.0:1788890928.252912:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997301632 00000100:00100000:2.0:1788890928.252978:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788890928.252989:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997301632:12345-0@lo:13: 00002000:00000024:2.0:1788890928.253029:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788890928.253083:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997301632:12345-0@lo:13: Request processed in 96us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890928.253108:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788890928.253714:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82e51880 x1875787997301632/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890928.253736:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997301632:0@lo:13: 00000100:00100000:1.0:1788890928.255168:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997301760:0@lo:13: 00000100:00100000:1.0:1788890928.255226:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890928.255380:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997301760 00000100:00100000:0.0:1788890928.255386:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997301760 00000100:00100000:0.0:1788890928.255434:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788890928.255444:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997301760:12345-0@lo:13: 00002000:00000024:0.0:1788890928.255462:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788890928.263762:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997301760:12345-0@lo:13: Request processed in 8305us (8520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890928.263797:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788890928.263949:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf6a5500 x1875787997301760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890928.264030:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997301760:0@lo:13: 00000100:00100000:2.0:1788890928.283164:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890928.283289:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987816064 00000100:00100000:0.0:1788890928.283301:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987816064 00000100:00100000:0.0:1788890928.283399:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:0.0:1788890928.283413:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+7:6238:x1875787987816064:12345-192.168.204.26@tcp:41: 00000004:00000024:0.0:1788890928.283468:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788890928.283602:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+7:6238:x1875787987816064:12345-192.168.204.26@tcp:41: Request processed in 192us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890928.283611:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00080000:2.0:1788890928.283678:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890928.285254:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890928.285367:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987816192 00000100:00100000:1.0:1788890928.285376:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987816192 00000100:00100000:1.0:1788890928.285456:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:1.0:1788890928.285467:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+6:6238:x1875787987816192:12345-192.168.204.26@tcp:41: 00000004:00000024:1.0:1788890928.285517:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00080000:2.0:1788890928.285600:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788890928.285633:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+6:6238:x1875787987816192:12345-192.168.204.26@tcp:41: Request processed in 168us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890928.285642:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:3.0:1788890928.289885:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890928.290106:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987816320 00000100:00100000:1.0:1788890928.290117:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987816320 00000100:00100000:1.0:1788890928.290217:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:1.0:1788890928.290231:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df03475d-d91a-4e91-8125-742ac4d4c589+6:6238:x1875787987816320:12345-192.168.204.26@tcp:13: 00002000:00000024:1.0:1788890928.290271:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788890928.290360:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df03475d-d91a-4e91-8125-742ac4d4c589+6:6238:x1875787987816320:12345-192.168.204.26@tcp:13: Request processed in 132us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890928.290368:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00080000:2.0:1788890928.291355:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788890928.291912:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890928.293061:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987816448 00000100:00100000:0.0:1788890928.293073:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987816448 00000100:00100000:0.0:1788890928.293159:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:0.0:1788890928.293171:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df03475d-d91a-4e91-8125-742ac4d4c589+6:6238:x1875787987816448:12345-192.168.204.26@tcp:13: 00000100:00080000:2.0:1788890928.293185:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1788890928.293198:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788890928.293278:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df03475d-d91a-4e91-8125-742ac4d4c589+6:6238:x1875787987816448:12345-192.168.204.26@tcp:13: Request processed in 111us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890928.293285:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 21 00000001:00100000:3.0:1788890928.765804:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df03475d-d91a-4e91-8125-742ac4d4c589 00010000:00010000:1.0:1788890929.085702:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890929.790635:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997302016:0@lo:13: 00000100:00100000:3.0:1788890929.790731:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890929.790852:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788890929.790860:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997301888:0@lo:41: 00000100:00100000:3.0:1788890929.790890:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890929.790943:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997301888 00000100:00100000:3.0:1788890929.790966:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997301888 00000100:00100000:3.0:1788890929.791026:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788890929.791036:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997301888:12345-0@lo:41: 00000004:00000024:3.0:1788890929.791081:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788890929.791140:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997301888:12345-0@lo:41: Request processed in 105us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890929.791148:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788890929.791203:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997301888:0@lo:41: 00000100:00100000:2.0:1788890929.792470:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997302016 00000100:00100000:2.0:1788890929.792481:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997302016 00000100:00100000:2.0:1788890929.792674:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788890929.792686:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997302016:12345-0@lo:13: 00002000:00000024:2.0:1788890929.792719:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788890929.792805:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997302016:12345-0@lo:13: Request processed in 121us (2073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890929.792812:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788890929.792866:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788890929.792906:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82e51880 x1875787997302016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890929.792927:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997302016:0@lo:13: 00000100:00100000:1.0:1788890929.793425:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788890929.793501:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997302144:0@lo:13: 00000100:00100000:1.0:1788890929.793789:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890929.793917:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997302144 00000100:00100000:2.0:1788890929.793924:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997302144 00000100:00100000:2.0:1788890929.794005:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788890929.794013:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997302144:12345-0@lo:13: 00002000:00000024:2.0:1788890929.794029:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788890929.794073:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997302144:12345-0@lo:13: Request processed in 61us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890929.794080:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788890929.794113:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82e52a00 x1875787997302144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890929.794130:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997302144:0@lo:13: 00000100:00080000:3.0:1788890929.794198:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788890930.107853:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788890930.260368:0:10159:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788890930.812302:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997302272:0@lo:41: 00000100:00100000:3.0:1788890930.812369:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890930.812412:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997302272 00000100:00100000:2.0:1788890930.812428:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997302272 00000100:00100000:2.0:1788890930.812571:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788890930.812581:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997302272:12345-0@lo:41: 00000004:00000024:2.0:1788890930.812613:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788890930.812669:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997302272:12345-0@lo:41: Request processed in 89us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890930.812677:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788890930.812785:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997302272:0@lo:41: 00000001:00100000:2.0:1788890930.814951:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of df03475d-d91a-4e91-8125-742ac4d4c589 00000001:00100000:3.0:1788890930.815519:0:7425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of df03475d-d91a-4e91-8125-742ac4d4c589 00010000:00010000:1.0:1788890931.131809:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890931.667033:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890931.667101:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987816576 00000100:00100000:1.0:1788890931.667111:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987816576 00000100:00100000:1.0:1788890931.667176:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 195 00000100:00100000:1.0:1788890931.667187:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:2394:x1875787987816576:12345-192.168.204.26@tcp:400: 00000100:00100000:1.0:1788890931.667262:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:2394:x1875787987816576:12345-192.168.204.26@tcp:400: Request processed in 76us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890931.667269:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 195 00000100:00100000:3.0:1788890931.670558:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890931.670595:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890931.670621:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890931.670643:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890931.670705:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987816960 00000100:00100000:1.0:1788890931.670727:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987816960 00000100:00100000:1.0:1788890931.670802:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987817088 00000100:00100000:1.0:1788890931.670805:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987817088 00000100:00100000:1.0:1788890931.670831:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:1.0:1788890931.670840:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+6:2393:x1875787987816960:12345-192.168.204.26@tcp:400: 00000100:00100000:1.0:1788890931.670910:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+6:2393:x1875787987816960:12345-192.168.204.26@tcp:400: Request processed in 72us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890931.670917:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:1.0:1788890931.670931:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:1.0:1788890931.670936:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987817088:12345-192.168.204.26@tcp:400: 00000100:00100000:1.0:1788890931.670958:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987817088:12345-192.168.204.26@tcp:400: Request processed in 22us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890931.670963:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:1.0:1788890931.670978:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987816704 00000100:00100000:1.0:1788890931.670981:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987816704 00000100:00100000:1.0:1788890931.671002:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987816832 00000100:00100000:1.0:1788890931.671004:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987816832 00000100:00100000:1.0:1788890931.671019:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:1.0:1788890931.671025:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:2394:x1875787987816704:12345-192.168.204.26@tcp:400: 00000100:00100000:1.0:1788890931.671064:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:2394:x1875787987816704:12345-192.168.204.26@tcp:400: Request processed in 38us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890931.671074:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:1.0:1788890931.671085:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 48 00000100:00100000:1.0:1788890931.671090:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987816832:12345-192.168.204.26@tcp:400: 00000100:00100000:1.0:1788890931.671111:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987816832:12345-192.168.204.26@tcp:400: Request processed in 21us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890931.671115:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 48 00000100:00080000:3.0:1788890931.671655:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788890931.671660:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788890931.671663:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788890931.671665:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1788890931.838026:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df03475d-d91a-4e91-8125-742ac4d4c589 00010000:00010000:2.0:1788890932.156774:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788890932.456179:0:10307:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed8fffbf0 20000000:00000080:1.0:1788890932.456196:0:10307:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9250bf6b9c00 uarg=0000000000000000 20000000:01000000:1.0:1788890932.456245:0:10307:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788890932.456247:0:10307:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788890932.456250:0:10307:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788890932.456255:0:10307:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788890932.456260:0:10307:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788890932.456318:0:10307:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788890932.456321:0:10307:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788890932.456848:0:10308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1788890932.457213:0:10307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1788890932.457244:0:10307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1788890932.457261:0:10307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1788890932.457271:0:10307:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788890932.457273:0:10307:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788890932.457572:0:10309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1788890932.457648:0:10307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1788890932.457667:0:10307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1788890932.457681:0:10307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1788890932.457691:0:10307:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788890932.457692:0:10307:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788890932.458053:0:10310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1788890932.458197:0:10307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1788890932.458217:0:10307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1788890932.458230:0:10307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1788890932.458237:0:10307:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788890932.458245:0:10307:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788890932.458806:0:10311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1788890932.458963:0:10307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1788890932.458984:0:10307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1788890932.459000:0:10307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1788890932.459008:0:10307:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788890932.459010:0:10307:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788890932.459550:0:10312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1788890932.459647:0:10307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1788890932.459662:0:10307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1788890932.459669:0:10307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:1.0:1788890932.459680:0:10307:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788890932.459695:0:10307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52cf7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.459727:0:10307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925081522e00/0xa66601b03fd52b92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52b8b expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.459744:0:10307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250813ede00/0xa66601b03fd52bbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52bb5 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.459751:0:10307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52bf4 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.459757:0:10307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925081522800/0xa66601b03fd52c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52c02 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.459764:0:10307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925091a8ae00/0xa66601b03fd52c17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52c10 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.459774:0:10307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925091a8bc00/0xa66601b03fd52c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52c2c expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.459781:0:10307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250b69c6200/0xa66601b03fd52c5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52c56 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.459795:0:10307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250b69c7400/0xa66601b03fd52c79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52c72 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.459802:0:10307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250813ece00/0xa66601b03fd52c9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52c95 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.459812:0:10307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250baae5000/0xa66601b03fd52cb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddc8b expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.459819:0:10307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925091a8a000/0xa66601b03fd52cb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddc92 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.459826:0:10307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52cf7 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.459865:0:10307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925091a8a000/0xa66601b03fd52cb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddc92 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.459877:0:10307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff925091a8a000/0xa66601b03fd52cb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddc92 expref: 9 pid: 6488 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890932.459889:0:10307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997302400:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788890932.460000:0:10307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250baae5000/0xa66601b03fd52cb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddc8b expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.460009:0:10307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250baae5000/0xa66601b03fd52cb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddc8b expref: 9 pid: 6490 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890932.460017:0:10307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997302528:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788890932.460057:0:10307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250813ece00/0xa66601b03fd52c9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52c95 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.460065:0:10307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250813ece00/0xa66601b03fd52c9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52c95 expref: 23 pid: 6490 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890932.460073:0:10307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997302656:0@lo:104: 00000100:00100000:1.0:1788890932.460105:0:10307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788890932.460141:0:10307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250b69c7400/0xa66601b03fd52c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52c72 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.460180:0:10307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250b69c7400/0xa66601b03fd52c79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52c72 expref: 23 pid: 6490 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890932.460200:0:10307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997302784:0@lo:104: 00000100:00100000:1.0:1788890932.460229:0:10307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890932.460249:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997302656 00000100:00100000:2.0:1788890932.460256:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997302656 00010000:00010000:1.0:1788890932.460259:0:10307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250b69c6200/0xa66601b03fd52c5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52c56 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.460267:0:10307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250b69c6200/0xa66601b03fd52c5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52c56 expref: 23 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890932.460275:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997302784 00000100:00100000:1.0:1788890932.460276:0:10307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997302912:0@lo:104: 00000100:00100000:0.0:1788890932.460283:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997302784 00000100:00100000:2.0:1788890932.460292:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788890932.460299:0:10307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890932.460304:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090312680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:10307:x1875787997302656:12345-0@lo:104: 00000100:00100000:0.0:1788890932.460313:0:6479:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:2.0:1788890932.460316:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925091a8b800/0xa66601b03fd52c95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52c9c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.460319:0:10307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925091a8bc00/0xa66601b03fd52c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52c2c expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890932.460323:0:6479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1788890932.460331:0:10307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925091a8bc00/0xa66601b03fd52c33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52c2c expref: 23 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890932.460352:0:10307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997303040:0@lo:104: 00010000:00010000:2.0:1788890932.460376:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788890932.460382:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090312680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:10307:x1875787997302656:12345-0@lo:104: Request processed in 81us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890932.460389:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788890932.460410:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997302912 00000100:00100000:2.0:1788890932.460414:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997302912 00000100:00100000:2.0:1788890932.460438:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788890932.460445:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:10307:x1875787997302784:12345-0@lo:104: 00010000:00010000:2.0:1788890932.460459:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250b69c7800/0xa66601b03fd52c72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52c79 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.460514:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788890932.460540:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8b800/0xa66601b03fd52c95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52c9c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.460562:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b800 already unused, calling callback (ffffffffc13fbc20) 00000100:00100000:1.0:1788890932.460568:0:10307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1788890932.460568:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8b800/0xa66601b03fd52c95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52c9c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.460571:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788890932.460582:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:10307:x1875787997302784:12345-0@lo:104: Request processed in 136us (351us total) trans 0 rc 0/0 00010000:00010000:0.0:1788890932.460584:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8b800/0xa66601b03fd52c95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52c9c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890932.460593:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 10000000:00010000:0.0:1788890932.460598:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8b800/0xa66601b03fd52c95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52c9c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.460600:0:10307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925091a8ae00/0xa66601b03fd52c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52c10 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890932.460611:0:6480:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 10000000:01000000:0.0:1788890932.460615:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788890932.460619:0:10307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925091a8ae00/0xa66601b03fd52c17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52c10 expref: 23 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890932.460620:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997303040 00000100:00100000:2.0:1788890932.460624:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997303040 00000100:00100000:1.0:1788890932.460629:0:10307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997303168:0@lo:104: 00000100:00100000:2.0:1788890932.460640:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788890932.460647:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:10307:x1875787997302912:12345-0@lo:104: 00010000:00010000:0.0:1788890932.460651:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925091a8b800/0xa66601b03fd52c95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52c9c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.460655:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250b69c6c00/0xa66601b03fd52c56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52c5d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890932.460660:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788890932.460667:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788890932.460683:0:10307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788890932.460723:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1788890932.460725:0:10307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925081522800/0xa66601b03fd52c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52c02 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890932.460730:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:10307:x1875787997302912:12345-0@lo:104: Request processed in 83us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890932.460737:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788890932.460742:0:10307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925081522800/0xa66601b03fd52c09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52c02 expref: 23 pid: 6488 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890932.460747:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997303168 00000100:00100000:2.0:1788890932.460751:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997303168 00000100:00100000:1.0:1788890932.460752:0:10307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e77b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997303424:0@lo:104: 00000100:00100000:2.0:1788890932.460773:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788890932.460784:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:10307:x1875787997303040:12345-0@lo:104: 00010000:00010000:2.0:1788890932.460792:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925091a8ac00/0xa66601b03fd52c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52c33 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890932.460796:0:10307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788890932.460819:0:10307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52bf4 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.460821:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788890932.460828:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:10307:x1875787997303040:12345-0@lo:104: Request processed in 47us (262us total) trans 0 rc 0/0 00010000:00010000:1.0:1788890932.460828:0:10307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52bfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52bf4 expref: 23 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890932.460837:0:10307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997303552:0@lo:104: 00000100:00100000:2.0:1788890932.460839:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788890932.460860:0:10307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890932.460870:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997303424 00000100:00100000:2.0:1788890932.460874:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997303424 00010000:00010000:1.0:1788890932.460878:0:10307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250813ede00/0xa66601b03fd52bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52bb5 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890932.460885:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997303552 00000100:00100000:2.0:1788890932.460887:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997303552 00010000:00010000:3.0:1788890932.460896:0:10314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788890932.460898:0:10307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250813ede00/0xa66601b03fd52bbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52bb5 expref: 23 pid: 6488 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890932.460903:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1788890932.460909:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250b69c7800/0xa66601b03fd52c72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52c79 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890932.460910:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+5:10307:x1875787997303168:12345-0@lo:104: 00000100:00100000:1.0:1788890932.460910:0:10307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997303680:0@lo:104: 00010000:00010000:2.0:1788890932.460927:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd52c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52c17 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890932.460933:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7800 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:3.0:1788890932.460940:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c7800/0xa66601b03fd52c72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52c79 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890932.460951:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250b69c7800/0xa66601b03fd52c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52c79 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.460958:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788890932.460959:0:10307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890932.460974:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+5:10307:x1875787997303168:12345-0@lo:104: Request processed in 61us (289us total) trans 0 rc 0/0 10000000:00010000:3.0:1788890932.460978:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c7800/0xa66601b03fd52c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52c79 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.460984:0:10307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925081522e00/0xa66601b03fd52b92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52b8b expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890932.460989:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788890932.461002:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997303680 00000100:00100000:2.0:1788890932.461010:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997303680 10000000:01000000:3.0:1788890932.461014:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788890932.461020:0:10307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925081522e00/0xa66601b03fd52b92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52b8b expref: 23 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890932.461028:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788890932.461033:0:10307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997303808:0@lo:104: 00000100:00100000:2.0:1788890932.461035:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+5:10307:x1875787997303424:12345-0@lo:104: 00010000:00010000:2.0:1788890932.461042:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52c02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52c09 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890932.461061:0:10307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788890932.461066:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250b69c7800/0xa66601b03fd52c72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52c79 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.461068:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788890932.461072:0:10307:0:(client.c:2715:ptlrpc_set_wait()) set ffff925086312b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788890932.461082:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+5:10307:x1875787997303424:12345-0@lo:104: Request processed in 48us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890932.461096:0:10307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997302656:0@lo:104: 00010000:00010000:3.0:1788890932.461099:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788890932.461106:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788890932.461106:0:10307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997302784:0@lo:104: 00000100:00100000:1.0:1788890932.461116:0:10307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997302912:0@lo:104: 00000100:00100000:2.0:1788890932.461118:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997303808 00000100:00100000:2.0:1788890932.461120:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997303808 00000100:00100000:1.0:1788890932.461123:0:10307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997303040:0@lo:104: 00000100:00100000:1.0:1788890932.461129:0:10307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997303168:0@lo:104: 00000100:00100000:2.0:1788890932.461132:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788890932.461136:0:10307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e77b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997303424:0@lo:104: 00000100:00100000:2.0:1788890932.461223:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+5:10307:x1875787997303552:12345-0@lo:104: 00010000:00010000:2.0:1788890932.461232:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925091a8b600/0xa66601b03fd52bf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52bfb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.461270:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788890932.461275:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+5:10307:x1875787997303552:12345-0@lo:104: Request processed in 56us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890932.461281:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788890932.461293:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788890932.461298:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:10307:x1875787997303680:12345-0@lo:104: 00010000:00010000:2.0:1788890932.461305:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250b69c6600/0xa66601b03fd52bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52bbc expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.461330:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788890932.461334:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:10307:x1875787997303680:12345-0@lo:104: Request processed in 37us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890932.461339:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788890932.461351:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788890932.461356:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:10307:x1875787997303808:12345-0@lo:104: 00010000:00010000:2.0:1788890932.461363:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52b92 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.461388:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788890932.461392:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:10307:x1875787997303808:12345-0@lo:104: Request processed in 37us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890932.461397:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788890932.461482:0:10307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997303552:0@lo:104: 00000100:00100000:1.0:1788890932.461490:0:10307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997303680:0@lo:104: 00000100:00100000:1.0:1788890932.461496:0:10307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997303808:0@lo:104: 00010000:00010000:0.0:1788890932.461757:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8b800/0xa66601b03fd52c95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52c9c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.461767:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8b800/0xa66601b03fd52c95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52c9c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.461783:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788890932.461787:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8ac00/0xa66601b03fd52c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52c33 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.461793:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8ac00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:0.0:1788890932.461797:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8ac00/0xa66601b03fd52c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52c33 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.461816:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8ac00/0xa66601b03fd52c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52c33 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890932.461823:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8ac00/0xa66601b03fd52c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52c33 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890932.461829:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788890932.461854:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925091a8ac00/0xa66601b03fd52c2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52c33 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.461861:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890932.461888:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8ac00/0xa66601b03fd52c2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52c33 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.461896:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8ac00/0xa66601b03fd52c2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52c33 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.461907:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788890932.461910:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd52c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52c17 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.461916:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522a00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:0.0:1788890932.461919:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd52c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52c17 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.461925:0:10315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788890932.461926:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd52c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52c17 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890932.461935:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd52c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52c17 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.461941:0:10314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250b69c6c00/0xa66601b03fd52c56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52c5d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.461961:0:10314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6c00 already unused, calling callback (ffffffffc13fbc20) 10000000:01000000:0.0:1788890932.461961:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:2.0:1788890932.461967:0:10314:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c6c00/0xa66601b03fd52c56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52c5d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.461977:0:10314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250b69c6c00/0xa66601b03fd52c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52c5d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.461983:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd52c10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52c17 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890932.461985:0:10314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c6c00/0xa66601b03fd52c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52c5d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890932.462001:0:10314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788890932.462002:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890932.462014:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd52c10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52c17 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.462023:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925081522a00/0xa66601b03fd52c10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52c17 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.462026:0:10314:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250b69c6c00/0xa66601b03fd52c56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52c5d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.462035:0:10314:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890932.462041:0:10314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250b69c6c00/0xa66601b03fd52c56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52c5d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.462041:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788890932.462048:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8b600/0xa66601b03fd52bf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52bfb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.462051:0:10314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250b69c6c00/0xa66601b03fd52c56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52c5d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.462063:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b600 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:0.0:1788890932.462068:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8b600/0xa66601b03fd52bf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52bfb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.462073:0:10314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788890932.462077:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8b600/0xa66601b03fd52bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52bfb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.462078:0:10314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250b69c6600/0xa66601b03fd52bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52bbc expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890932.462084:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250b69c7800/0xa66601b03fd52c72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52c79 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.462109:0:10314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6600 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:0.0:1788890932.462111:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8b600/0xa66601b03fd52bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52bfb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890932.462123:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788890932.462124:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250b69c7800/0xa66601b03fd52c72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52c79 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890932.462125:0:10314:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c6600/0xa66601b03fd52bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52bbc expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.462153:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925091a8b600/0xa66601b03fd52bf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52bfb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890932.462155:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788890932.462165:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52b92 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.462194:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890932.462196:0:10314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250b69c6600/0xa66601b03fd52bb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52bbc expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890932.462199:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed600 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890932.462208:0:10314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c6600/0xa66601b03fd52bb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52bbc expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.462210:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8b600/0xa66601b03fd52bf4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52bfb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788890932.462224:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52b92 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890932.462227:0:10314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788890932.462241:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8b600/0xa66601b03fd52bf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52bfb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890932.462250:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52b92 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.462257:0:10314:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250b69c6600/0xa66601b03fd52bb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52bbc expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.462259:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1788890932.462262:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52b92 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.462265:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890932.462269:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890932.462281:0:10314:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1788890932.462288:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890932.462290:0:10314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250b69c6600/0xa66601b03fd52bb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52bbc expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890932.462292:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997303296:0@lo:103: 00010000:00010000:2.0:1788890932.462309:0:10314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250b69c6600/0xa66601b03fd52bb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52bbc expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.462320:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890932.462323:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890932.462326:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890932.462327:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52b8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52b92 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890932.462336:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788890932.462345:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52b8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52b92 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890932.462354:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52b8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52b92 expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890932.462356:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788890932.462375:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890932.462378:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890932.462382:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890932.462389:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997304064:0@lo:103: 00000100:00100000:0.0:1788890932.462425:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997304320:0@lo:103: 00000100:00100000:1.0:1788890932.462438:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890932.462466:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890932.462470:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997304576:0@lo:103: 00000100:00100000:1.0:1788890932.462501:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890932.462506:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788890932.462518:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997303936:0@lo:103: 00000100:00100000:0.0:1788890932.462592:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890932.462607:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997303296 00000100:00100000:2.0:1788890932.462613:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997303296 00010000:00010000:2.0:1788890932.462636:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250813ece00/0xa66601b03fd52c9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52c95 expref: 24 pid: 6490 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890932.462652:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997304064 00000100:00100000:2.0:1788890932.462655:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997304064 00010000:00010000:2.0:1788890932.462665:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925091a8bc00/0xa66601b03fd52c33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52c2c expref: 25 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890932.462675:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997304320 00000100:00100000:2.0:1788890932.462686:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997304320 00010000:00010000:2.0:1788890932.462711:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250b69c6200/0xa66601b03fd52c5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52c56 expref: 26 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890932.462723:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997304576 00000100:00100000:2.0:1788890932.462726:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997304576 00010000:00010000:2.0:1788890932.462738:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250813ede00/0xa66601b03fd52bbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52bb5 expref: 27 pid: 6488 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890932.462748:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997303936 00000100:00100000:2.0:1788890932.462751:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997303936 00010000:00010000:2.0:1788890932.462766:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250b69c7400/0xa66601b03fd52c79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52c72 expref: 28 pid: 6490 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890932.462781:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788890932.462790:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090432050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+28:3629:x1875787997303296:12345-0@lo:103: 00010000:00010000:2.0:1788890932.462802:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890932.462809:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250813ece00/0xa66601b03fd52c9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52c95 expref: 28 pid: 6490 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.462820:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250813ece00/0xa66601b03fd52c9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52c95 expref: 28 pid: 6490 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.462839:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813ece00/0xa66601b03fd52c9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52c95 expref: 28 pid: 6490 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.462854:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890932.462886:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090432050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+27:3629:x1875787997303296:12345-0@lo:103: Request processed in 99us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890932.462892:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788890932.462927:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788890932.462940:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+26:3627:x1875787997304064:12345-0@lo:103: 00010000:00010000:2.0:1788890932.462947:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890932.462952:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925091a8bc00/0xa66601b03fd52c33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52c2c expref: 26 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.462960:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925091a8bc00/0xa66601b03fd52c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52c2c expref: 26 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.462970:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8bc00/0xa66601b03fd52c33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52c2c expref: 26 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.462979:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890932.463011:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+25:3627:x1875787997304064:12345-0@lo:103: Request processed in 71us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890932.463018:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788890932.463035:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788890932.463044:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83166d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3629:x1875787997304320:12345-0@lo:103: 00010000:00010000:2.0:1788890932.463051:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890932.463055:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250b69c6200/0xa66601b03fd52c5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52c56 expref: 24 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.463064:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250b69c6200/0xa66601b03fd52c5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52c56 expref: 24 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.463075:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c6200/0xa66601b03fd52c5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52c56 expref: 24 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.463083:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788890932.463109:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890932.463120:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83166d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:3629:x1875787997304320:12345-0@lo:103: Request processed in 74us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890932.463137:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788890932.463149:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987817216 00000100:00100000:2.0:1788890932.463153:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987817216 00000100:00100000:1.0:1788890932.463373:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997304064:0@lo:103: 00000100:00100000:1.0:1788890932.463387:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788890932.463393:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997304192:0@lo:103: 00000100:00100000:1.0:1788890932.463423:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890932.463437:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997304704:0@lo:103: 00000100:00100000:1.0:1788890932.463455:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890932.463620:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997304192 00000100:00100000:1.0:1788890932.463624:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997304192 00010000:00010000:1.0:1788890932.463640:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925091a8ae00/0xa66601b03fd52c17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52c10 expref: 23 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890932.463655:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997304704 00000100:00100000:1.0:1788890932.463657:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997304704 00010000:00010000:1.0:1788890932.463671:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925081522e00/0xa66601b03fd52b92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52b8b expref: 24 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890932.463688:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788890932.463708:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3627:x1875787997304576:12345-0@lo:103: 00000100:00100000:3.0:1788890932.463721:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:1.0:1788890932.463726:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890932.463734:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250813ede00/0xa66601b03fd52bbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52bb5 expref: 24 pid: 6488 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.463746:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250813ede00/0xa66601b03fd52bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52bb5 expref: 24 pid: 6488 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.463769:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813ede00/0xa66601b03fd52bbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52bb5 expref: 24 pid: 6488 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.463781:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890932.463824:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:3627:x1875787997304576:12345-0@lo:103: Request processed in 129us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890932.463830:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788890932.463843:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987817344 00000100:00100000:1.0:1788890932.463846:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987817344 00010000:00010000:1.0:1788890932.463860:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250baae5000/0xa66601b03fd52cb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddc8b expref: 11 pid: 6490 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890932.463873:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788890932.463879:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83167800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:3629:x1875787997303936:12345-0@lo:103: 00010000:00010000:1.0:1788890932.463885:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890932.463889:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250b69c7400/0xa66601b03fd52c79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52c72 expref: 22 pid: 6490 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.463896:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250b69c7400/0xa66601b03fd52c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52c72 expref: 22 pid: 6490 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.463905:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c7400/0xa66601b03fd52c79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52c72 expref: 22 pid: 6490 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.463914:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890932.463939:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83167800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:3629:x1875787997303936:12345-0@lo:103: Request processed in 61us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890932.463945:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788890932.463969:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788890932.463978:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:3627:x1875787997304192:12345-0@lo:103: 00010000:00010000:1.0:1788890932.463986:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890932.463991:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925091a8ae00/0xa66601b03fd52c17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52c10 expref: 20 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.463999:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925091a8ae00/0xa66601b03fd52c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52c10 expref: 20 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890932.464004:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997304576:0@lo:103: 00010000:00010000:1.0:1788890932.464031:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8ae00/0xa66601b03fd52c17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52c10 expref: 20 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.464043:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890932.464084:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:3627:x1875787997304192:12345-0@lo:103: Request processed in 106us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890932.464089:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788890932.464103:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788890932.464109:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090431450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:3627:x1875787997304704:12345-0@lo:103: 00010000:00010000:1.0:1788890932.464116:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890932.464121:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925081522e00/0xa66601b03fd52b92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52b8b expref: 18 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.464129:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925081522e00/0xa66601b03fd52b92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52b8b expref: 18 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.464155:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925081522e00/0xa66601b03fd52b92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52b8b expref: 18 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.464169:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890932.464197:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090431450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:3627:x1875787997304704:12345-0@lo:103: Request processed in 88us (740us total) trans 0 rc 0/0 00010000:00010000:2.0:1788890932.464204:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925091a8a000/0xa66601b03fd52cb8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddc92 expref: 11 pid: 6488 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890932.464205:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997303936:0@lo:103: 00000100:00100000:1.0:1788890932.464220:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788890932.464228:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997304448:0@lo:103: 00000100:00100000:2.0:1788890932.464240:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:2.0:1788890932.464252:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:2393:x1875787987817344:12345-192.168.204.26@tcp:103: 00000100:00100000:1.0:1788890932.464258:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:0.0:1788890932.464264:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788890932.464266:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890932.464276:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250baae5000/0xa66601b03fd52cb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddc8b expref: 11 pid: 6490 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890932.464282:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:2394:x1875787987817216:12345-192.168.204.26@tcp:103: 00010000:00010000:1.0:1788890932.464297:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788890932.464304:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997304192:0@lo:103: 00010000:00010000:1.0:1788890932.464307:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925091a8a000/0xa66601b03fd52cb8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddc92 expref: 11 pid: 6488 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890932.464313:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997303296:0@lo:103: 00000100:00100000:3.0:1788890932.464336:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997304704:0@lo:103: 00000100:00100000:0.0:1788890932.464343:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997304320:0@lo:103: 00010000:00010000:2.0:1788890932.464350:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250baae5000/0xa66601b03fd52cb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddc8b expref: 11 pid: 6490 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890932.464397:0:7436:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788890932.464404:0:7436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:1.0:1788890932.464482:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925091a8a000/0xa66601b03fd52cb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddc92 expref: 11 pid: 6488 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890932.464505:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788890932.464506:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890932.464584:0:6481:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788890932.464604:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997304448 00000100:00100000:0.0:1788890932.464608:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997304448 00010000:00010000:0.0:1788890932.464625:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52bfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52bf4 expref: 17 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890932.464653:0:6481:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788890932.464662:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788890932.464671:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:3629:x1875787997304448:12345-0@lo:103: 00010000:00010000:0.0:1788890932.464680:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890932.464685:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52bfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52bf4 expref: 17 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.464694:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52bf4 expref: 17 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.464722:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52bfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52bf4 expref: 17 pid: 6491 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.464734:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890932.464851:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:2394:x1875787987817216:12345-192.168.204.26@tcp:103: Request processed in 581us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890932.464862:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:2393:x1875787987817344:12345-192.168.204.26@tcp:103: Request processed in 608us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890932.464863:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:0.0:1788890932.464875:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:3629:x1875787997304448:12345-0@lo:103: Request processed in 206us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890932.464882:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788890932.464895:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:0.0:1788890932.464915:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997304448:0@lo:103: 00010000:00010000:1.0:1788890932.464986:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890932.464996:0:10315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52c02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52c09 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.465005:0:10315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a200 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788890932.465010:0:10315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52c02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52c09 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.465019:0:10315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52c09 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.465027:0:10307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8a000/0xa66601b03fd52cb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddc92 expref: 9 pid: 6488 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788890932.465028:0:10315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52c09 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890932.465053:0:10307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997302400:192.168.204.26@tcp:104: 10000000:01000000:1.0:1788890932.465064:0:10315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788890932.465077:0:10307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae5000/0xa66601b03fd52cb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddc8b expref: 8 pid: 6490 timeout: 254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890932.465096:0:10307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10307:1875787997302528:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788890932.465101:0:10315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52c02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52c09 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.465110:0:10315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890932.465149:0:10307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52cf7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890932.465242:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997304832:0@lo:103: 00010000:00010000:1.0:1788890932.465269:0:10315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52c02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52c09 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.465279:0:10315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52c02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52c09 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.465294:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890932.465296:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890932.465298:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890932.465304:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890932.465306:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890932.465363:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890932.465442:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997304832 00000100:00100000:0.0:1788890932.465448:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997304832 00010000:00010000:0.0:1788890932.465558:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925081522800/0xa66601b03fd52c09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52c02 expref: 16 pid: 6488 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890932.465597:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788890932.465607:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:3629:x1875787997304832:12345-0@lo:103: 00010000:00010000:1.0:1788890932.465617:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890932.465623:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925081522800/0xa66601b03fd52c09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52c02 expref: 16 pid: 6488 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.465634:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925081522800/0xa66601b03fd52c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52c02 expref: 16 pid: 6488 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.465646:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925081522800/0xa66601b03fd52c09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52c02 expref: 16 pid: 6488 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.465661:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52cf7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.465675:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52cf7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.465688:0:6482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52cf7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.465695:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52cf7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.465713:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52cf7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.465718:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52cf7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.465723:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6a00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788890932.465726:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52cf7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.465732:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52cf7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.465748:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52cf7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.465756:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788890932.465768:0:10307:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52cf7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.465778:0:10307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52cf7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890932.465785:0:10307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52cf7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890932.465810:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:3629:x1875787997304832:12345-0@lo:103: Request processed in 205us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890932.465818:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788890932.465893:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997304832:0@lo:103: 00000100:00100000:3.0:1788890932.815203:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890932.815899:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987817472 00000100:00100000:1.0:1788890932.816028:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987817472 00000100:00100000:1.0:1788890932.816153:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 196 00000100:00100000:1.0:1788890932.816164:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+8:6157:x1875787987817472:12345-192.168.204.26@tcp:101: 00010000:00010000:1.0:1788890932.816182:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890932.816200:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c6000/0xa66601b03fd52cfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddd02 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.816226:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c6000/0xa66601b03fd52cfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd02 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.816238:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c6000/0xa66601b03fd52cfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd02 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890932.816252:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6000, rc 0) 00000100:00100000:1.0:1788890932.816309:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+9:6157:x1875787987817472:12345-192.168.204.26@tcp:101: Request processed in 147us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890932.816316:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 196 00000100:00100000:3.0:1788890932.819011:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890932.821783:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987817600 00000100:00100000:2.0:1788890932.821796:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987817600 00000100:00100000:2.0:1788890932.821869:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 197 00000100:00100000:2.0:1788890932.821880:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+9:6157:x1875787987817600:12345-192.168.204.26@tcp:501: 00000100:00100000:2.0:1788890932.822046:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+9:6157:x1875787987817600:12345-192.168.204.26@tcp:501: Request processed in 166us (3043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890932.822053:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 197 00000100:00100000:3.0:1788890932.823898:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890932.824039:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987817728 00000100:00100000:1.0:1788890932.824050:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987817728 00000100:00100000:1.0:1788890932.824112:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 198 00000100:00100000:1.0:1788890932.824124:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+9:6157:x1875787987817728:12345-192.168.204.26@tcp:503: 00000100:00100000:1.0:1788890932.824326:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+9:6157:x1875787987817728:12345-192.168.204.26@tcp:503: Request processed in 203us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890932.824336:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 198 00000100:00100000:0.0:1788890932.827396:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890932.827476:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987817856 00000100:00100000:3.0:1788890932.827486:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987817856 00000100:00100000:3.0:1788890932.827613:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 199 00000100:00100000:3.0:1788890932.827624:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+9:6632:x1875787987817856:12345-192.168.204.26@tcp:502: 00000100:00100000:3.0:1788890932.827787:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+9:6632:x1875787987817856:12345-192.168.204.26@tcp:502: Request processed in 164us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890932.827794:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 199 00000100:00100000:0.0:1788890932.830430:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890932.830518:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987817984 00000100:00100000:1.0:1788890932.830540:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987817984 00000100:00100000:1.0:1788890932.830628:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 200 00000100:00100000:1.0:1788890932.830639:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+9:6632:x1875787987817984:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788890932.830793:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+9:6632:x1875787987817984:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 155us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890932.830801:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 200 00000100:00100000:0.0:1788890932.835328:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890932.835413:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987818112 00000100:00100000:3.0:1788890932.835422:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987818112 00000100:00100000:3.0:1788890932.835477:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 201 00000100:00100000:3.0:1788890932.835486:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+9:6157:x1875787987818112:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788890932.835501:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890932.835518:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250813ed200/0xa66601b03fd52d05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddd09 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890932.835568:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813ed200/0xa66601b03fd52d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd09 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890932.835579:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250813ed200/0xa66601b03fd52d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd09 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890932.835587:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ed200, rc 0) 00000100:00100000:3.0:1788890932.835654:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6157:x1875787987818112:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 169us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890932.835661:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 201 00000100:00100000:0.0:1788890932.837646:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890932.837804:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987818240 00000100:00100000:1.0:1788890932.837812:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987818240 00000100:00100000:1.0:1788890932.837861:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 202 00000100:00100000:1.0:1788890932.837871:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6157:x1875787987818240:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890932.837973:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6157:x1875787987818240:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 103us (333us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788890932.837981:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 202 00000100:00100000:3.0:1788890932.860636:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788890932.861387:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997305216:0@lo:400: 00000100:00100000:0.0:1788890932.861389:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997305088:0@lo:400: 00000100:00100000:0.0:1788890932.861825:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890932.861881:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997305600:0@lo:400: 00000100:00100000:0.0:1788890932.861906:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890932.861928:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997306112:0@lo:400: 00000100:00100000:0.0:1788890932.861946:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890932.861965:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788890932.861970:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997305728:0@lo:400: 00000100:00100000:0.0:1788890932.861989:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890932.862012:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997306240:0@lo:400: 00000100:00100000:0.0:1788890932.862031:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890932.862059:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997305088 00000100:00100000:0.0:1788890932.862065:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997305088 00000100:00100000:0.0:1788890932.862099:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997305600 00000100:00100000:0.0:1788890932.862101:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997305600 00000100:00100000:0.0:1788890932.862122:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997306112 00000100:00100000:0.0:1788890932.862124:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997306112 00000100:00100000:0.0:1788890932.862135:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997305728 00000100:00100000:0.0:1788890932.862137:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997305728 00000100:00100000:0.0:1788890932.862147:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997306240 00000100:00100000:0.0:1788890932.862149:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997306240 00000100:00100000:0.0:1788890932.862166:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788890932.862174:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997305088:12345-0@lo:400: 00000100:00100000:0.0:1788890932.862223:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997305088:12345-0@lo:400: Request processed in 50us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890932.862231:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788890932.862246:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788890932.862253:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997305600:12345-0@lo:400: 00000100:00100000:0.0:1788890932.862278:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997305600:12345-0@lo:400: Request processed in 26us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890932.862283:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788890932.862293:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788890932.862298:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997306112:12345-0@lo:400: 00000100:00100000:0.0:1788890932.862318:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997306112:12345-0@lo:400: Request processed in 20us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890932.862323:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788890932.862332:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788890932.862344:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997305728:12345-0@lo:400: 00000100:00100000:0.0:1788890932.862385:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997305728:12345-0@lo:400: Request processed in 41us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890932.862391:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788890932.862402:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788890932.862407:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997306240:12345-0@lo:400: 00000100:00100000:0.0:1788890932.862428:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997306240:12345-0@lo:400: Request processed in 21us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890932.862435:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788890932.862468:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83149c00 x1875787997305728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890932.862481:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997305728:0@lo:400: 00010000:00080000:0.0:1788890932.862490:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f8314b800 x1875787997306240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890932.862498:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997306240:0@lo:400: 00000100:00100000:0.0:1788890932.862506:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997305600:0@lo:400: 00000100:00100000:0.0:1788890932.862513:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997306112:0@lo:400: 00000100:00100000:0.0:1788890932.862540:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997305088:0@lo:400: 00000100:00100000:2.0:1788890932.862565:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890932.862594:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997305216 00000100:00100000:0.0:1788890932.862599:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997305216 00000100:00100000:0.0:1788890932.862625:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788890932.862630:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997305216:12345-0@lo:400: 00000100:00080000:2.0:1788890932.862859:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788890932.862864:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890932.863380:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997305344:0@lo:400: 00000100:00100000:3.0:1788890932.863619:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890932.863748:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997304960:0@lo:400: 00000100:00100000:2.0:1788890932.863761:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997305344 00000100:00100000:2.0:1788890932.863768:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997305344 00000100:00100000:3.0:1788890932.863782:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890932.863809:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788890932.863819:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997305344:12345-0@lo:400: 00000100:00100000:3.0:1788890932.863823:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997305856:0@lo:400: 00000100:00100000:3.0:1788890932.863857:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890932.863875:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997305344:12345-0@lo:400: Request processed in 55us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890932.863883:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997306368:0@lo:400: 00000100:00100000:2.0:1788890932.863885:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788890932.863912:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890932.863918:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997304960 00000100:00100000:2.0:1788890932.863923:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997304960 00000100:00100000:3.0:1788890932.863948:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997305344:0@lo:400: 00000100:00100000:2.0:1788890932.863964:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788890932.863973:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:3629:x1875787997304960:12345-0@lo:400: 00000100:00100000:3.0:1788890932.863980:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997305856 00000100:00100000:3.0:1788890932.863985:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997305856 00000100:00100000:3.0:1788890932.864024:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997306368 00000100:00100000:3.0:1788890932.864028:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997306368 00000100:00100000:2.0:1788890932.864035:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:3629:x1875787997304960:12345-0@lo:400: Request processed in 62us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890932.864043:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788890932.864056:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788890932.864067:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997305856:12345-0@lo:400: 00000100:00080000:2.0:1788890932.864074:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788890932.864079:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788890932.864093:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788890932.864103:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997306368:12345-0@lo:400: 00000100:00100000:3.0:1788890932.864110:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997305856:12345-0@lo:400: Request processed in 44us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890932.864135:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788890932.864143:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997306368:12345-0@lo:400: Request processed in 41us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890932.864150:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788890932.864178:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83148a80 x1875787997305856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890932.864190:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997305856:0@lo:400: 00010000:00080000:3.0:1788890932.864199:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f8314b480 x1875787997306368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890932.864216:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997306368:0@lo:400: 00000100:00100000:3.0:1788890932.864224:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997304960:0@lo:400: 00000100:00100000:0.0:1788890932.865796:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997305216:12345-0@lo:400: Request processed in 3157us (4326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890932.865823:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788890932.866494:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997305216:0@lo:400: 00000100:00100000:1.0:1788890932.867026:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997305472:0@lo:400: 00000100:00100000:1.0:1788890932.867086:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890932.867358:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997305984:0@lo:400: 00000100:00100000:1.0:1788890932.867387:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890932.867764:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997305472 00000100:00100000:2.0:1788890932.867772:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997305472 00000100:00100000:2.0:1788890932.867835:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788890932.867843:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997305472:12345-0@lo:400: 00000100:00100000:2.0:1788890932.867893:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997305472:12345-0@lo:400: Request processed in 51us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890932.867900:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788890932.867981:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997306496:0@lo:400: 00000100:00100000:1.0:1788890932.868007:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890932.868052:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997305472:0@lo:400: 00000100:00100000:0.0:1788890932.868089:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997305984 00000100:00100000:0.0:1788890932.868094:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997305984 00000100:00100000:0.0:1788890932.868145:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997306496 00000100:00100000:0.0:1788890932.868149:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997306496 00000100:00100000:3.0:1788890932.868153:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788890932.868166:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997305984:12345-0@lo:400: 00000100:00100000:0.0:1788890932.868172:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788890932.868183:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997306496:12345-0@lo:400: 00000100:00100000:3.0:1788890932.868213:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997305984:12345-0@lo:400: Request processed in 50us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890932.868222:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788890932.868235:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997306496:12345-0@lo:400: Request processed in 54us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890932.868242:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788890932.868392:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83149f80 x1875787997305984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890932.868577:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997305984:0@lo:400: 00000100:00080000:2.0:1788890932.868665:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788890932.868669:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788890932.868717:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83149180 x1875787997306496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890932.868727:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997306496:0@lo:400: 00010000:00010000:0.0:1788890933.179697:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890933.372756:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997306624:0@lo:13: 00000100:00100000:0.0:1788890933.372833:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890933.372967:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997306624 00000100:00100000:3.0:1788890933.372975:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997306624 00000100:00100000:3.0:1788890933.373034:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788890933.373044:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997306624:12345-0@lo:13: 00002000:00000024:3.0:1788890933.373072:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788890933.373126:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997306624:12345-0@lo:13: Request processed in 84us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890933.373134:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788890933.373215:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf6a5880 x1875787997306624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890933.373233:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997306624:0@lo:13: 00000100:00100000:1.0:1788890933.375507:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997306752:0@lo:13: 00000100:00100000:1.0:1788890933.375591:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890933.376241:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997306752 00000100:00100000:3.0:1788890933.376250:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997306752 00000100:00100000:3.0:1788890933.376303:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788890933.376312:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997306752:12345-0@lo:13: 00002000:00000024:3.0:1788890933.376332:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788890933.378653:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997306752:12345-0@lo:13: Request processed in 2335us (3055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890933.378668:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788890933.380481:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82e51880 x1875787997306752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890933.380506:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997306752:0@lo:13: 00000020:00000080:1.0:1788890934.029397:0:10365:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8d5818e0 20000000:00000080:1.0:1788890934.029414:0:10365:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9250bf6b9400 uarg=0000000000000000 20000000:01000000:1.0:1788890934.029467:0:10365:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788890934.029472:0:10365:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788890934.029477:0:10365:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788890934.030175:0:10366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788890934.030319:0:10365:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788890934.034295:0:10365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788890934.034332:0:10365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788890934.034346:0:10365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788890934.034361:0:10365:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788890934.034381:0:10365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52d0c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.034399:0:10365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250c214a200/0xa66601b03fd52a26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52a1f expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.034407:0:10365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925091a8ba00/0xa66601b03fd52a34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52a2d expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.034414:0:10365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925080030a00/0xa66601b03fd52a88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52a81 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.034420:0:10365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925091a8b200/0xa66601b03fd52bae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52ba7 expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.034447:0:10365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250b69c7a00/0xa66601b03fd52cc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddcca expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.034454:0:10365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52d0c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.034495:0:10365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250b69c7a00/0xa66601b03fd52cc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddcca expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.034513:0:10365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250b69c7a00/0xa66601b03fd52cc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddcca expref: 9 pid: 6490 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890934.034704:0:10365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10365:1875787997306880:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788890934.034822:0:10365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925091a8b200/0xa66601b03fd52bae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52ba7 expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.034830:0:10365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925091a8b200/0xa66601b03fd52bae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52ba7 expref: 14 pid: 6491 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890934.034840:0:10365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10365:1875787997307008:0@lo:104: 00000100:00100000:1.0:1788890934.034879:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788890934.034914:0:10365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925080030a00/0xa66601b03fd52a88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52a81 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.034922:0:10365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925080030a00/0xa66601b03fd52a88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52a81 expref: 14 pid: 6490 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890934.034930:0:10365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10365:1875787997307136:0@lo:104: 00000100:00100000:1.0:1788890934.034977:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.035013:0:6479:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788890934.035031:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997307008 00000100:00100000:1.0:1788890934.035038:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997307008 00000100:00100000:1.0:1788890934.035084:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997307136 00000100:00100000:1.0:1788890934.035088:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997307136 00000100:00100000:1.0:1788890934.035106:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788890934.035114:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:10365:x1875787997307008:12345-0@lo:104: 00010000:00010000:1.0:1788890934.035129:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd52ba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52bae expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890934.035139:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788890934.035153:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250ba9c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:10365:x1875787997307136:12345-0@lo:104: 00010000:00010000:3.0:1788890934.035171:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925080031800/0xa66601b03fd52a81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52a88 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.035184:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788890934.035192:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:10365:x1875787997307008:12345-0@lo:104: Request processed in 78us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.035199:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1788890934.035234:0:10365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925091a8ba00/0xa66601b03fd52a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52a2d expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.035242:0:10365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff925091a8ba00/0xa66601b03fd52a34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52a2d expref: 14 pid: 6491 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890934.035250:0:10365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10365:1875787997307264:0@lo:104: 00000100:00100000:1.0:1788890934.035273:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.035291:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997307264 00000100:00100000:1.0:1788890934.035294:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997307264 00000100:00100000:1.0:1788890934.035310:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788890934.035316:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:10365:x1875787997307264:12345-0@lo:104: 00010000:00010000:1.0:1788890934.035323:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250c214ae00/0xa66601b03fd52a2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52a34 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.035393:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788890934.035399:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250ba9c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:10365:x1875787997307136:12345-0@lo:104: Request processed in 252us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.035406:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1788890934.035686:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788890934.035693:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:10365:x1875787997307264:12345-0@lo:104: Request processed in 376us (418us total) trans 0 rc 0/0 00010000:00010000:3.0:1788890934.035696:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1788890934.035704:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1788890934.035706:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd52ba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52bae expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.035716:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081523800 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:3.0:1788890934.035720:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd52ba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52bae expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.035729:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd52ba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52bae expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788890934.035737:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd52ba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52bae expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.035742:0:10365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250c214a200/0xa66601b03fd52a26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52a1f expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890934.035747:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788890934.035758:0:10365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250c214a200/0xa66601b03fd52a26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52a1f expref: 14 pid: 6488 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890934.035769:0:10365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10365:1875787997307392:0@lo:104: 00010000:00010000:3.0:1788890934.035789:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd52ba7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52bae expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.035797:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788890934.035813:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788890934.035821:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd52ba7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52bae expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890934.035836:0:10365:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c0a14540 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.035857:0:10365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10365:1875787997307008:0@lo:104: 00000100:00100000:1.0:1788890934.035865:0:10365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10365:1875787997307136:0@lo:104: 00000100:00100000:1.0:1788890934.035870:0:10365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10365:1875787997307264:0@lo:104: 00010000:00010000:2.0:1788890934.036113:0:10314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788890934.036119:0:10314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925080031800/0xa66601b03fd52a81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52a88 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.036125:0:10314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080031800 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890934.036128:0:10314:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925080031800/0xa66601b03fd52a81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52a88 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.036134:0:10314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925080031800/0xa66601b03fd52a81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52a88 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890934.036141:0:10314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925080031800/0xa66601b03fd52a81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52a88 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890934.036145:0:10314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788890934.036164:0:10314:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925080031800/0xa66601b03fd52a81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52a88 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.036171:0:10314:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890934.036177:0:10314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925080031800/0xa66601b03fd52a81 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52a88 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.036183:0:10314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925080031800/0xa66601b03fd52a81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52a88 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.036210:0:10314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788890934.036214:0:10314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250c214ae00/0xa66601b03fd52a2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52a34 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.036219:0:10314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250c214ae00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890934.036222:0:10314:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250c214ae00/0xa66601b03fd52a2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52a34 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.036228:0:10314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250c214ae00/0xa66601b03fd52a2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52a34 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890934.036234:0:10314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250c214ae00/0xa66601b03fd52a2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52a34 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890934.036239:0:10314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788890934.036255:0:10314:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250c214ae00/0xa66601b03fd52a2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52a34 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.036261:0:10314:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890934.036278:0:10314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250c214ae00/0xa66601b03fd52a2d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52a34 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.036284:0:10314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250c214ae00/0xa66601b03fd52a2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52a34 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.036293:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890934.036295:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890934.036297:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890934.036305:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788890934.036321:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997307776:0@lo:103: 00000100:00100000:2.0:1788890934.036353:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890934.036381:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997307776 00000100:00100000:2.0:1788890934.036386:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997307776 00010000:00010000:2.0:1788890934.036406:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925091a8ba00/0xa66601b03fd52a34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52a2d expref: 15 pid: 6491 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890934.036429:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788890934.036436:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:3628:x1875787997307776:12345-0@lo:103: 00010000:00010000:2.0:1788890934.036447:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890934.036451:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925091a8ba00/0xa66601b03fd52a34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52a2d expref: 15 pid: 6491 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.036460:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925091a8ba00/0xa66601b03fd52a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52a2d expref: 15 pid: 6491 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.036474:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8ba00/0xa66601b03fd52a34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52a2d expref: 15 pid: 6491 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.036486:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890934.036516:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:3628:x1875787997307776:12345-0@lo:103: Request processed in 81us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890934.036546:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788890934.036576:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997307776:0@lo:103: 00010000:00010000:0.0:1788890934.036903:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890934.037044:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd52ba7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52bae expref: -99 pid: 9487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.037130:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890934.037132:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890934.037133:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890934.037155:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997307520:0@lo:103: 00000100:00100000:3.0:1788890934.037366:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.037635:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788890934.037645:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997307648:0@lo:103: 00000100:00100000:2.0:1788890934.037683:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997307520 00000100:00100000:3.0:1788890934.037688:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890934.037691:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997307520 00010000:00010000:2.0:1788890934.037717:0:10317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925091a8b200/0xa66601b03fd52bae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52ba7 expref: 14 pid: 6491 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890934.037731:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997307392 00000100:00100000:3.0:1788890934.037737:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997307392 00000100:00100000:3.0:1788890934.037770:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788890934.037778:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:10365:x1875787997307392:12345-0@lo:104: 00010000:00010000:3.0:1788890934.037788:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd52a1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52a26 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890934.037793:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997307648 00000100:00100000:2.0:1788890934.037804:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997307648 00010000:00010000:2.0:1788890934.037821:0:10317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925080030a00/0xa66601b03fd52a88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52a81 expref: 15 pid: 6490 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890934.037852:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788890934.037861:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:3629:x1875787997307520:12345-0@lo:103: 00010000:00010000:1.0:1788890934.037870:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890934.037874:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925091a8b200/0xa66601b03fd52bae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52ba7 expref: 15 pid: 6491 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.037884:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925091a8b200/0xa66601b03fd52bae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52ba7 expref: 15 pid: 6491 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.037897:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8b200/0xa66601b03fd52bae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52ba7 expref: 15 pid: 6491 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.037918:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890934.037956:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:3629:x1875787997307520:12345-0@lo:103: Request processed in 97us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.037963:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788890934.037978:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788890934.037984:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:3629:x1875787997307648:12345-0@lo:103: 00010000:00010000:1.0:1788890934.037991:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890934.037995:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925080030a00/0xa66601b03fd52a88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52a81 expref: 13 pid: 6490 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.038004:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925080030a00/0xa66601b03fd52a88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52a81 expref: 13 pid: 6490 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.038013:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925080030a00/0xa66601b03fd52a88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52a81 expref: 13 pid: 6490 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.038022:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890934.038043:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:3629:x1875787997307648:12345-0@lo:103: Request processed in 59us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.038048:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788890934.038082:0:10365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10365:1875787997307392:0@lo:104: 00010000:00010000:3.0:1788890934.038868:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788890934.038876:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:10365:x1875787997307392:12345-0@lo:104: Request processed in 1099us (3062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.038884:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1788890934.038916:0:10316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788890934.038922:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997307648:0@lo:103: 00010000:00010000:1.0:1788890934.038924:0:10316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd52a1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52a26 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890934.038935:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997307520:0@lo:103: 00010000:00010000:1.0:1788890934.039023:0:10316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030200 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788890934.039029:0:10316:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd52a1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52a26 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.039046:0:10316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd52a1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52a26 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788890934.039053:0:10316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd52a1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52a26 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890934.039059:0:10316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788890934.039099:0:10316:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd52a1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52a26 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.039115:0:10316:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788890934.039160:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997307904:0@lo:103: 00000100:00100000:2.0:1788890934.039200:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890934.039230:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890934.039257:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997307904 00000100:00100000:0.0:1788890934.039262:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997307904 00010000:00010000:0.0:1788890934.039284:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250c214a200/0xa66601b03fd52a26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52a1f expref: 12 pid: 6488 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890934.039317:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987818368 00000100:00100000:0.0:1788890934.039320:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987818368 00010000:00010000:0.0:1788890934.039330:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250b69c7a00/0xa66601b03fd52cc6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddcca expref: 10 pid: 6490 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.039358:0:10316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd52a1f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52a26 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890934.039365:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1788890934.039371:0:10316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd52a1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52a26 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890934.039376:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:3628:x1875787997307904:12345-0@lo:103: 00010000:00010000:0.0:1788890934.039390:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890934.039395:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890934.039396:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250c214a200/0xa66601b03fd52a26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52a1f expref: 12 pid: 6488 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.039400:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890934.039404:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890934.039412:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250c214a200/0xa66601b03fd52a26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52a1f expref: 12 pid: 6488 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.039426:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250c214a200/0xa66601b03fd52a26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52a1f expref: 12 pid: 6488 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890934.039434:0:10365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10365:1875787997306880:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788890934.039437:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788890934.039465:0:10365:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52d0c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890934.039562:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:3.0:1788890934.039572:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090432c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:2393:x1875787987818368:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788890934.039580:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890934.039590:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250b69c7a00/0xa66601b03fd52cc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddcca expref: 10 pid: 6490 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.039616:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250b69c7a00/0xa66601b03fd52cc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddcca expref: 10 pid: 6490 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.039628:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c7a00/0xa66601b03fd52cc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddcca expref: 10 pid: 6490 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.039642:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52d0c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.039650:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52d0c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.040236:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52d0c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.040246:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52d0c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.040252:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52d0c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.040259:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52d0c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.040264:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7e00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788890934.040268:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52d0c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.040275:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52d0c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.040302:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52d0c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.040311:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788890934.040363:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090432c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+9:2393:x1875787987818368:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 792us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.040373:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 39 00010000:00010000:1.0:1788890934.040376:0:10365:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52d0c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.040385:0:10365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52d0c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.040403:0:10365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52d0c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890934.040775:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+11:3628:x1875787997307904:12345-0@lo:103: Request processed in 1399us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.040784:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788890934.041655:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997307904:0@lo:103: 00010000:00010000:0.0:1788890934.203662:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890934.368032:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890934.368105:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987818496 00000100:00100000:1.0:1788890934.368116:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987818496 00000100:00100000:1.0:1788890934.368174:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 204 00000100:00100000:1.0:1788890934.368185:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+9:6157:x1875787987818496:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890934.368203:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890934.368223:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c6400/0xa66601b03fd52d13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddd10 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.368251:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c6400/0xa66601b03fd52d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd10 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.368263:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c6400/0xa66601b03fd52d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd10 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.368271:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6400, rc 0) 00000100:00100000:1.0:1788890934.368355:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6157:x1875787987818496:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 172us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.368360:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 204 00000100:00100000:3.0:1788890934.371250:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890934.371351:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987818624 00000100:00100000:0.0:1788890934.371366:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987818624 00000100:00100000:0.0:1788890934.371437:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 205 00000100:00100000:0.0:1788890934.371448:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6157:x1875787987818624:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890934.371695:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6157:x1875787987818624:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 247us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.371703:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 205 00000100:00100000:0.0:1788890934.378478:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890934.378566:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987818752 00000100:00100000:2.0:1788890934.378582:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987818752 00000100:00100000:2.0:1788890934.378655:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 206 00000100:00100000:2.0:1788890934.378680:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6157:x1875787987818752:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890934.379683:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6157:x1875787987818752:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 1015us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890934.379694:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 206 00000100:00100000:3.0:1788890934.384778:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890934.384851:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987818880 00000100:00100000:0.0:1788890934.384865:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987818880 00000100:00100000:0.0:1788890934.384992:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 207 00000100:00100000:0.0:1788890934.385005:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6689:x1875787987818880:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788890934.385242:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6689:x1875787987818880:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 240us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.385252:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 207 00000100:00100000:3.0:1788890934.387792:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890934.388036:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987819008 00000100:00100000:2.0:1788890934.388051:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987819008 00000100:00100000:2.0:1788890934.388135:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 208 00000100:00100000:2.0:1788890934.388147:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6689:x1875787987819008:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788890934.388325:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:6689:x1875787987819008:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 179us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890934.388347:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 208 10000000:01000000:3.0:1788890934.451628:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788890934.451640:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9250c12de800 from 48 10000000:01000000:3.0:1788890934.451714:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788890934.451774:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52d1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.451788:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52d1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.451802:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52d1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890934.451969:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997308032:0@lo:101: 00000100:00100000:3.0:1788890934.452065:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.452135:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.452145:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997308032 00000100:00100000:0.0:1788890934.452299:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997308032 00000100:00100000:0.0:1788890934.452365:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788890934.452376:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+11:6493:x1875787997308032:12345-0@lo:101: 00010000:00010000:0.0:1788890934.452394:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890934.452411:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae4600/0xa66601b03fd52d21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52d1a expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.452438:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae4600/0xa66601b03fd52d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52d1a expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.452450:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae4600/0xa66601b03fd52d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52d1a expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.452462:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4600, rc 0) 00000100:00100000:0.0:1788890934.452516:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6493:x1875787997308032:12345-0@lo:101: Request processed in 141us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.452564:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788890934.452569:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997308032:0@lo:101: 00010000:00010000:3.0:1788890934.452589:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52d1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.452611:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52d1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890934.452704:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997308160:0@lo:501: 00000100:00100000:3.0:1788890934.452734:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.452779:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.452827:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997308160 00000100:00100000:0.0:1788890934.452833:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997308160 00000100:00100000:0.0:1788890934.452934:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788890934.452941:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6493:x1875787997308160:12345-0@lo:501: 00000100:00100000:0.0:1788890934.453413:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6493:x1875787997308160:12345-0@lo:501: Request processed in 471us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.453422:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788890934.453487:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997308160:0@lo:501: 00000100:00100000:2.0:1788890934.453543:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997308288:0@lo:503: 00000100:00100000:2.0:1788890934.453593:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890934.453638:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab18d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.453649:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997308288 00000100:00100000:0.0:1788890934.453655:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997308288 00000100:00100000:0.0:1788890934.453704:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788890934.453712:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6493:x1875787997308288:12345-0@lo:503: 00000100:00100000:0.0:1788890934.453818:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6493:x1875787997308288:12345-0@lo:503: Request processed in 105us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.453825:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788890934.454390:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997308288:0@lo:503: 00000100:00100000:2.0:1788890934.454993:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10386:1875787997308416:0@lo:502: 00000100:00100000:2.0:1788890934.455054:0:10386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890934.455090:0:10386:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8221c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.455150:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997308416 00000100:00100000:0.0:1788890934.455157:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997308416 00000100:00100000:0.0:1788890934.455198:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788890934.455207:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:10386:x1875787997308416:12345-0@lo:502: 00000100:00100000:0.0:1788890934.455326:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:10386:x1875787997308416:12345-0@lo:502: Request processed in 120us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.455334:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788890934.455412:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10386:1875787997308416:0@lo:502: 00000100:00100000:2.0:1788890934.455449:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10386:1875787997308544:0@lo:502: 00000100:00100000:2.0:1788890934.455515:0:10386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890934.455605:0:10386:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8221c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.455818:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997308544 00000100:00100000:0.0:1788890934.455823:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997308544 00000100:00100000:0.0:1788890934.455860:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788890934.455867:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:10386:x1875787997308544:12345-0@lo:502: 00000100:00100000:0.0:1788890934.455952:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:10386:x1875787997308544:12345-0@lo:502: Request processed in 85us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.455959:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788890934.457144:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10386:1875787997308544:0@lo:502: 00000040:00080000:1.0:1788890934.457202:0:10386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788890934.457307:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788890934.457397:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788890934.457411:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52d1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.457491:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52d1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890934.457503:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788890934.457506:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788890934.457509:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788890934.457567:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd52d28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.457574:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd52d28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.457582:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd52d28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890934.457598:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997308672:0@lo:101: 00000100:00100000:3.0:1788890934.457657:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.457780:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6480 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.457825:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997308672 00000100:00100000:0.0:1788890934.457833:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997308672 00000100:00100000:0.0:1788890934.457914:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788890934.457931:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+12:6493:x1875787997308672:12345-0@lo:101: 00010000:00010000:0.0:1788890934.457945:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890934.457961:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae5e00/0xa66601b03fd52d2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52d28 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.457995:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae5e00/0xa66601b03fd52d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52d28 expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.458008:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae5e00/0xa66601b03fd52d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52d28 expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.458019:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5e00, rc 0) 00000100:00100000:0.0:1788890934.458067:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:6493:x1875787997308672:12345-0@lo:101: Request processed in 138us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.458075:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788890934.458175:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997308672:0@lo:101: 00010000:00010000:3.0:1788890934.458191:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd52d28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.458202:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd52d28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890934.458275:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997308800:0@lo:501: 00000100:00100000:3.0:1788890934.458309:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.458336:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6480 going to sleep for 11 seconds 00000100:00100000:2.0:1788890934.458644:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997308800 00000100:00100000:2.0:1788890934.458649:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997308800 00000100:00100000:2.0:1788890934.458692:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788890934.458701:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:6493:x1875787997308800:12345-0@lo:501: 00000100:00100000:2.0:1788890934.458840:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:6493:x1875787997308800:12345-0@lo:501: Request processed in 141us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890934.458848:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788890934.458959:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997308800:0@lo:501: 00000100:00100000:3.0:1788890934.458989:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997308928:0@lo:503: 00000100:00100000:3.0:1788890934.459027:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.459056:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6480 going to sleep for 11 seconds 00000100:00100000:2.0:1788890934.459160:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997308928 00000100:00100000:2.0:1788890934.459164:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997308928 00000100:00100000:2.0:1788890934.459222:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788890934.459237:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:6493:x1875787997308928:12345-0@lo:503: 00000100:00100000:2.0:1788890934.459339:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:6493:x1875787997308928:12345-0@lo:503: Request processed in 110us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890934.459346:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788890934.459427:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997308928:0@lo:503: 00000100:00100000:0.0:1788890934.459843:0:10387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83165c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10387:1875787997309056:0@lo:502: 00000100:00100000:0.0:1788890934.459887:0:10387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890934.460002:0:10387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baab2240 going to sleep for 11 seconds 00000100:00100000:3.0:1788890934.460034:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997309056 00000100:00100000:3.0:1788890934.460040:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997309056 00000100:00100000:3.0:1788890934.460075:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788890934.460083:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:10387:x1875787997309056:12345-0@lo:502: 00000100:00100000:3.0:1788890934.460244:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:10387:x1875787997309056:12345-0@lo:502: Request processed in 161us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.460252:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788890934.460331:0:10387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83165c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10387:1875787997309056:0@lo:502: 00000020:01000000:0.0:1788890934.460357:0:10387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788890934.460368:0:10387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890934.460371:0:10387:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788890934.460377:0:10387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788890934.460401:0:10387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83165c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10387:1875787997309184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890934.460504:0:10387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890934.460600:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997309184 00000100:00100000:2.0:1788890934.460605:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997309184 00000100:00100000:0.0:1788890934.460697:0:10387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baab2240 going to sleep for 11 seconds 00000100:00100000:2.0:1788890934.460748:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788890934.460757:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:10387:x1875787997309184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788890934.460886:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:10387:x1875787997309184:12345-0@lo:502:llog_process_th.0 Request processed in 130us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890934.460894:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788890934.460959:0:10387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83165c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10387:1875787997309184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788890934.460976:0:10387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788890934.460979:0:10387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890934.460980:0:10387:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788890934.460983:0:10387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1788890934.461058:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788890934.461079:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788890934.461091:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd52d28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.461102:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd52d28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890934.461113:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788890934.461116:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9250c12de800 from 4 10000000:01000000:2.0:1788890934.461119:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788890934.461222:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd52d36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.461231:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd52d36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.461241:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd52d36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890934.461256:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997309312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788890934.461287:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890934.461312:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8221c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788890934.461364:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997309312 00000100:00100000:3.0:1788890934.461370:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997309312 00000100:00100000:3.0:1788890934.461501:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788890934.461511:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+13:6493:x1875787997309312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788890934.461545:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890934.461568:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250813ec600/0xa66601b03fd52d3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52d36 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.461596:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813ec600/0xa66601b03fd52d3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52d36 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.461610:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250813ec600/0xa66601b03fd52d3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52d36 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.461620:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ec600, rc 0) 00000100:00100000:3.0:1788890934.461675:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:6493:x1875787997309312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.461683:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788890934.461822:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997309312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890934.461838:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd52d36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d3d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.461848:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd52d36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52d3d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890934.461917:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83165c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997309440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890934.461952:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890934.462026:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baab2240 going to sleep for 11 seconds 00000100:00100000:2.0:1788890934.462057:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997309440 00000100:00100000:2.0:1788890934.462062:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997309440 00000100:00100000:2.0:1788890934.462097:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788890934.462113:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:6493:x1875787997309440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890934.462280:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:6493:x1875787997309440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890934.462287:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788890934.462342:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83165c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997309440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890934.462373:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83165c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997309568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890934.462484:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890934.462568:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baab2240 going to sleep for 11 seconds 00000100:00100000:2.0:1788890934.462619:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997309568 00000100:00100000:2.0:1788890934.462623:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997309568 00000100:00100000:2.0:1788890934.463671:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788890934.463685:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:6493:x1875787997309568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890934.463819:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:6493:x1875787997309568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890934.463826:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788890934.464254:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83165c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997309568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890934.464995:0:10389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10389:1875787997309696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788890934.465069:0:10389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890934.465145:0:10389:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508a7da540 going to sleep for 11 seconds 00000100:00100000:3.0:1788890934.465210:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997309696 00000100:00100000:3.0:1788890934.465219:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997309696 00000100:00100000:3.0:1788890934.465297:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788890934.465311:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:10389:x1875787997309696:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788890934.465701:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:10389:x1875787997309696:12345-0@lo:502:llog_process_th.0 Request processed in 393us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.465711:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788890934.465828:0:10389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10389:1875787997309696:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788890934.465863:0:10389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788890934.465873:0:10389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890934.465876:0:10389:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788890934.465884:0:10389:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9250c12de800 00000020:00000080:2.0:1788890934.465887:0:10389:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788890934.465983:0:10389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10389:1875787997309824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788890934.466033:0:10389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890934.466071:0:10389:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508a7da540 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.466202:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997309824 00000100:00100000:1.0:1788890934.466208:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997309824 00000100:00100000:1.0:1788890934.466251:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788890934.466260:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:10389:x1875787997309824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890934.466346:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:10389:x1875787997309824:12345-0@lo:502:llog_process_th.0 Request processed in 87us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.466355:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788890934.466804:0:10389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10389:1875787997309824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788890934.466833:0:10389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788890934.466846:0:10389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890934.466849:0:10389:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788890934.467249:0:10389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788890934.467356:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788890934.467395:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788890934.467408:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd52d36 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d3d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.467421:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd52d36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d3d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890934.467434:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788890934.467438:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9250ba9ab800 from 48 10000000:01000000:1.0:1788890934.467442:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788890934.467473:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7a00/0xa66601b03fd52d44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.467482:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250b69c7a00/0xa66601b03fd52d44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.467492:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250b69c7a00/0xa66601b03fd52d44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890934.467511:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997309952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.467592:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.467633:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788890934.469890:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997309952 00000100:00100000:3.0:1788890934.469903:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997309952 00000100:00100000:3.0:1788890934.469972:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788890934.469984:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+14:6493:x1875787997309952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788890934.470001:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890934.470021:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250813ec400/0xa66601b03fd52d4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52d44 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.470052:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813ec400/0xa66601b03fd52d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52d44 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.470074:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250813ec400/0xa66601b03fd52d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52d44 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.470086:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ec400, rc 0) 00000100:00100000:3.0:1788890934.470191:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:6493:x1875787997309952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (2596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.470199:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788890934.470301:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997309952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890934.470346:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250b69c7a00/0xa66601b03fd52d44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d4b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.470360:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250b69c7a00/0xa66601b03fd52d44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52d4b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890934.470566:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997310080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.470639:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.470735:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788890934.470804:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997310080 00000100:00100000:3.0:1788890934.470811:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997310080 00000100:00100000:3.0:1788890934.470855:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788890934.470863:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:6493:x1875787997310080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788890934.471004:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:6493:x1875787997310080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.471012:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788890934.471059:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997310080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788890934.471113:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997310208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788890934.471166:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.471189:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788890934.471204:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997310208 00000100:00100000:3.0:1788890934.471208:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997310208 00000100:00100000:3.0:1788890934.471230:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788890934.471237:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:6493:x1875787997310208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788890934.471318:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:6493:x1875787997310208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.471325:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788890934.471388:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997310208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788890934.471682:0:10392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10392:1875787997310336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788890934.471723:0:10392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.471758:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997310336 00000100:00100000:3.0:1788890934.471762:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997310336 00000100:00100000:3.0:1788890934.471785:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788890934.471791:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:10392:x1875787997310336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788890934.471881:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:10392:x1875787997310336:12345-0@lo:502:llog_process_th.0 Request processed in 90us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.471889:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788890934.471920:0:10392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788890934.471931:0:10392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10392:1875787997310336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788890934.471966:0:10392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10392:1875787997310464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788890934.472001:0:10392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.472022:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997310464 00000100:00100000:3.0:1788890934.472025:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997310464 00000100:00100000:3.0:1788890934.472047:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788890934.472055:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:10392:x1875787997310464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788890934.472121:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:10392:x1875787997310464:12345-0@lo:502:llog_process_th.0 Request processed in 66us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.472128:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788890934.472158:0:10392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788890934.472171:0:10392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10392:1875787997310464:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788890934.472191:0:10392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788890934.472244:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788890934.472265:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788890934.472275:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7a00/0xa66601b03fd52d44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d4b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.472284:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250b69c7a00/0xa66601b03fd52d44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d4b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890934.472294:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788890934.472296:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788890934.472299:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788890934.472322:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52d52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.472330:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52d52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.472338:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52d52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890934.472350:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997310592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788890934.472380:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.472394:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788890934.472407:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997310592 00000100:00100000:3.0:1788890934.472410:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997310592 00000100:00100000:3.0:1788890934.472431:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788890934.472437:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+15:6493:x1875787997310592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788890934.472444:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890934.472455:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250813ece00/0xa66601b03fd52d59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52d52 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.472487:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813ece00/0xa66601b03fd52d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52d52 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.472496:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250813ece00/0xa66601b03fd52d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52d52 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.472504:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ece00, rc 0) 00000100:00100000:3.0:1788890934.472564:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997310592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.472571:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788890934.472619:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997310592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788890934.472635:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52d52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d59 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.472645:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52d52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52d59 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890934.472700:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997310720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788890934.472731:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.472750:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788890934.472766:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997310720 00000100:00100000:3.0:1788890934.472770:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997310720 00000100:00100000:3.0:1788890934.472796:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788890934.472805:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997310720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788890934.473225:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997310720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 421us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.473241:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788890934.473381:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997310720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.473416:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997310848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.473460:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.473566:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788890934.473622:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997310848 00000100:00100000:3.0:1788890934.473699:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997310848 00000100:00100000:3.0:1788890934.473833:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788890934.473843:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997310848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788890934.473938:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997310848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.473945:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788890934.474037:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997310848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.474330:0:10393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10393:1875787997310976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890934.474376:0:10393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.474437:0:10393:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788890934.474470:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997310976 00000100:00100000:3.0:1788890934.474476:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997310976 00000100:00100000:3.0:1788890934.474577:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788890934.474586:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:10393:x1875787997310976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788890934.474694:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:10393:x1875787997310976:12345-0@lo:502:llog_process_th.0 Request processed in 110us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.474702:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788890934.474943:0:10393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10393:1875787997310976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788890934.474966:0:10393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788890934.474975:0:10393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890934.474977:0:10393:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788890934.474983:0:10393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788890934.475005:0:10393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10393:1875787997311104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788890934.475039:0:10393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.475104:0:10393:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.475142:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997311104 00000100:00100000:1.0:1788890934.475148:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997311104 00000100:00100000:1.0:1788890934.475217:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788890934.475228:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:10393:x1875787997311104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890934.475323:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:10393:x1875787997311104:12345-0@lo:502:llog_process_th.0 Request processed in 98us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.475330:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788890934.475401:0:10393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10393:1875787997311104:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788890934.475437:0:10393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788890934.475442:0:10393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890934.475445:0:10393:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788890934.475449:0:10393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1788890934.475578:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788890934.475612:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788890934.475621:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52d52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d59 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.475642:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52d52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d59 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890934.475652:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788890934.475655:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9250ba9ab800 from 4 10000000:01000000:3.0:1788890934.475666:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788890934.475692:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd52d60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.475701:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd52d60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.475711:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd52d60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890934.475726:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997311232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788890934.475869:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.475894:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.475968:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997311232 00000100:00100000:0.0:1788890934.475981:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997311232 00000100:00100000:0.0:1788890934.476039:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788890934.476051:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+16:6493:x1875787997311232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890934.476068:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890934.476088:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae4400/0xa66601b03fd52d67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52d60 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.476135:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae4400/0xa66601b03fd52d67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52d60 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.476148:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae4400/0xa66601b03fd52d67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52d60 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.476159:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4400, rc 0) 00000100:00100000:0.0:1788890934.476238:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997311232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.476249:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788890934.476274:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997311232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788890934.476297:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd52d60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d67 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.476316:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd52d60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52d67 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890934.476372:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997311360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788890934.476404:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.476435:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.476456:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997311360 00000100:00100000:0.0:1788890934.476462:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997311360 00000100:00100000:0.0:1788890934.476493:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788890934.476500:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997311360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890934.476765:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997311360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.476773:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788890934.476856:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997311360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788890934.476910:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997311488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788890934.476969:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.477047:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.477139:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997311488 00000100:00100000:0.0:1788890934.477148:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997311488 00000100:00100000:0.0:1788890934.477179:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788890934.477186:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997311488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890934.477277:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997311488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.477283:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788890934.479244:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997311488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788890934.479930:0:10396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10396:1875787997311616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788890934.480001:0:10396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.480084:0:10396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.480124:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997311616 00000100:00100000:0.0:1788890934.480130:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997311616 00000100:00100000:0.0:1788890934.480220:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788890934.480232:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:10396:x1875787997311616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890934.480363:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:10396:x1875787997311616:12345-0@lo:502:llog_process_th.0 Request processed in 133us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.480371:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788890934.480657:0:10396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10396:1875787997311616:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788890934.480692:0:10396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788890934.480703:0:10396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890934.480706:0:10396:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788890934.480713:0:10396:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9250ba9ab800 00000020:00000080:3.0:1788890934.480715:0:10396:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788890934.481308:0:10396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10396:1875787997311744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788890934.481356:0:10396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.481392:0:10396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.481457:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997311744 00000100:00100000:0.0:1788890934.481463:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997311744 00000100:00100000:0.0:1788890934.481813:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788890934.481822:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:10396:x1875787997311744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890934.482012:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:10396:x1875787997311744:12345-0@lo:502:llog_process_th.0 Request processed in 191us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.482018:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788890934.482138:0:10396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10396:1875787997311744:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788890934.482165:0:10396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788890934.482171:0:10396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890934.482173:0:10396:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788890934.482176:0:10396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788890934.482324:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788890934.482345:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788890934.482355:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd52d60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d67 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.482367:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd52d60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d67 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890934.482377:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788890934.482380:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92508475e000 from 48 10000000:01000000:0.0:1788890934.482383:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788890934.482410:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd52d6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.482419:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd52d6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.482439:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd52d6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890934.482456:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83164a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997311872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788890934.482490:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890934.482604:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baab2300 going to sleep for 11 seconds 00000100:00100000:3.0:1788890934.482705:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997311872 00000100:00100000:3.0:1788890934.482711:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997311872 00000100:00100000:3.0:1788890934.482909:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788890934.482923:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+17:6493:x1875787997311872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788890934.482934:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890934.482948:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8ba00/0xa66601b03fd52d75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52d6e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.482971:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8ba00/0xa66601b03fd52d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52d6e expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.482982:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8ba00/0xa66601b03fd52d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52d6e expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.482991:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8ba00, rc 0) 00000100:00100000:3.0:1788890934.483026:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997311872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.483032:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788890934.483109:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83164a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997311872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788890934.483124:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd52d6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d75 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.483135:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd52d6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52d75 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890934.483219:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997312000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788890934.483263:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.483322:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.483355:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997312000 00000100:00100000:0.0:1788890934.483360:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997312000 00000100:00100000:0.0:1788890934.483423:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788890934.483432:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997312000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890934.483573:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997312000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.483581:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788890934.483819:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997312000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788890934.483925:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997312128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788890934.483967:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.483991:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788890934.484003:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997312128 00000100:00100000:3.0:1788890934.484007:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997312128 00000100:00100000:3.0:1788890934.484029:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788890934.484035:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997312128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788890934.484125:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997312128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.484134:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788890934.484186:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997312128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788890934.484796:0:10397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10397:1875787997312256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788890934.484912:0:10397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.484976:0:10397:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090298c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.485009:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997312256 00000100:00100000:0.0:1788890934.485014:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997312256 00000100:00100000:0.0:1788890934.485074:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788890934.485084:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:10397:x1875787997312256:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890934.485178:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:10397:x1875787997312256:12345-0@lo:502:llog_process_th.0 Request processed in 96us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.485188:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788890934.485231:0:10397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10397:1875787997312256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890934.485315:0:10397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10397:1875787997312384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890934.485393:0:10397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.485421:0:10397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.485702:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997312384 00000100:00100000:1.0:1788890934.485709:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997312384 00000100:00100000:1.0:1788890934.485760:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788890934.485773:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:10397:x1875787997312384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890934.485899:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:10397:x1875787997312384:12345-0@lo:502:llog_process_th.0 Request processed in 129us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.485908:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788890934.485942:0:10397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10397:1875787997312384:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788890934.485978:0:10397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788890934.489625:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788890934.489742:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788890934.489759:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd52d6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d75 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.489775:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd52d6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d75 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890934.489789:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788890934.489793:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1788890934.489796:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788890934.489849:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7c00/0xa66601b03fd52d7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.489857:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250b69c7c00/0xa66601b03fd52d7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.489870:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250b69c7c00/0xa66601b03fd52d7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890934.489904:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997312512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.490227:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.490314:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.490913:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997312512 00000100:00100000:0.0:1788890934.490926:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997312512 00000100:00100000:0.0:1788890934.490980:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788890934.490990:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+18:6493:x1875787997312512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890934.491008:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890934.491033:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae4000/0xa66601b03fd52d83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52d7c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.491062:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae4000/0xa66601b03fd52d83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52d7c expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.491074:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae4000/0xa66601b03fd52d83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52d7c expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.491083:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4000, rc 0) 00000100:00100000:0.0:1788890934.491169:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:6493:x1875787997312512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.491177:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788890934.491975:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997312512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890934.491997:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250b69c7c00/0xa66601b03fd52d7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d83 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.492008:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250b69c7c00/0xa66601b03fd52d7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52d83 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890934.492083:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997312640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.492125:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.492157:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.492175:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997312640 00000100:00100000:1.0:1788890934.492180:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997312640 00000100:00100000:1.0:1788890934.492207:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788890934.492214:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:6493:x1875787997312640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.492332:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:6493:x1875787997312640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.492339:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788890934.492366:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997312640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.492390:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997312768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.492426:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.492437:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.492896:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997312768 00000100:00100000:0.0:1788890934.492903:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997312768 00000100:00100000:0.0:1788890934.492943:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788890934.492952:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:6493:x1875787997312768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890934.493055:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:6493:x1875787997312768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.493062:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997312768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890934.493064:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788890934.493985:0:10399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10399:1875787997312896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890934.494034:0:10399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.494067:0:10399:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.494076:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997312896 00000100:00100000:0.0:1788890934.494083:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997312896 00000100:00100000:0.0:1788890934.494125:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788890934.494135:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:10399:x1875787997312896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890934.494242:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:10399:x1875787997312896:12345-0@lo:502:llog_process_th.0 Request processed in 109us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.494249:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788890934.494458:0:10399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10399:1875787997312896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788890934.494485:0:10399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890934.494501:0:10399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890934.494504:0:10399:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788890934.494514:0:10399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788890934.494552:0:10399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10399:1875787997313024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890934.494590:0:10399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890934.495075:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997313024 00000100:00100000:1.0:1788890934.495082:0:10399:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.495087:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997313024 00000100:00100000:0.0:1788890934.495133:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788890934.495142:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:10399:x1875787997313024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890934.495244:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:10399:x1875787997313024:12345-0@lo:502:llog_process_th.0 Request processed in 103us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.495251:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788890934.495464:0:10399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10399:1875787997313024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788890934.495489:0:10399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890934.495495:0:10399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890934.495497:0:10399:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788890934.495503:0:10399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1788890934.495615:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1788890934.495637:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788890934.495648:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7c00/0xa66601b03fd52d7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d83 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.495673:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250b69c7c00/0xa66601b03fd52d7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d83 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890934.495683:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788890934.495686:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92508475e000 from 4 10000000:01000000:0.0:1788890934.495689:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788890934.495724:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52d8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.495732:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52d8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.495740:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52d8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890934.495758:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83165f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997313152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788890934.495794:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890934.495827:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.495917:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997313152 00000100:00100000:1.0:1788890934.495923:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997313152 00000100:00100000:1.0:1788890934.495960:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788890934.495968:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:6493:x1875787997313152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890934.495977:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890934.495992:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52d91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52d8a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.496015:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52d91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52d8a expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.496027:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52d91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52d8a expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.496047:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6a00, rc 0) 00000100:00100000:1.0:1788890934.496086:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997313152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.496093:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788890934.496127:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83165f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997313152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890934.496141:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52d8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.496150:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52d8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52d91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890934.496205:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997313280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.496232:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.496248:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.496262:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997313280 00000100:00100000:1.0:1788890934.496265:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997313280 00000100:00100000:1.0:1788890934.496291:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788890934.496299:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997313280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.496400:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997313280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.496407:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788890934.496440:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997313280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.496468:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997313408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.496508:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.496588:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.496615:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997313408 00000100:00100000:1.0:1788890934.496620:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997313408 00000100:00100000:1.0:1788890934.496674:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788890934.496682:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997313408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.496778:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997313408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.496787:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788890934.496914:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997313408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.497091:0:10401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10401:1875787997313536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890934.497126:0:10401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.497146:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997313536 00000100:00100000:1.0:1788890934.497150:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997313536 00000100:00100000:1.0:1788890934.497172:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788890934.497179:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:10401:x1875787997313536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890934.497251:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:10401:x1875787997313536:12345-0@lo:502:llog_process_th.0 Request processed in 72us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.497257:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788890934.497288:0:10401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.497300:0:10401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10401:1875787997313536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788890934.497325:0:10401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890934.497333:0:10401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890934.497335:0:10401:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788890934.497346:0:10401:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92508475e000 00000020:00000080:1.0:1788890934.497349:0:10401:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788890934.497433:0:10401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10401:1875787997313664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890934.497476:0:10401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.497494:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997313664 00000100:00100000:1.0:1788890934.497497:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997313664 00000100:00100000:1.0:1788890934.497519:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788890934.497552:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a92a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:10401:x1875787997313664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890934.497615:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a92a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:10401:x1875787997313664:12345-0@lo:502:llog_process_th.0 Request processed in 64us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.497621:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788890934.497656:0:10401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.497684:0:10401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10401:1875787997313664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788890934.497702:0:10401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890934.497707:0:10401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890934.497708:0:10401:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788890934.497713:0:10401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788890934.497755:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788890934.497773:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788890934.497781:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52d8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.497791:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52d8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890934.497799:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788890934.497802:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92509099a000 from 48 10000000:01000000:1.0:1788890934.497804:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788890934.497826:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd52d98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.498097:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd52d98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.498113:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd52d98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890934.498125:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997313792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.498153:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.498210:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788890934.500815:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997313792 00000100:00100000:3.0:1788890934.500906:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997313792 00000100:00100000:3.0:1788890934.501950:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788890934.501971:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a92a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997313792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788890934.501990:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890934.502008:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8b200/0xa66601b03fd52d9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52d98 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.502039:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8b200/0xa66601b03fd52d9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52d98 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.502050:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8b200/0xa66601b03fd52d9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52d98 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.502059:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8b200, rc 0) 00000100:00100000:3.0:1788890934.502146:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a92a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997313792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (3991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.502153:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788890934.504086:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997313792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890934.504113:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd52d98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.504126:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd52d98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52d9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890934.504210:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997313920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.504264:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.504302:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.504318:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997313920 00000100:00100000:1.0:1788890934.504324:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997313920 00000100:00100000:1.0:1788890934.504357:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788890934.504366:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a92ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997313920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.504490:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a92ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997313920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.504497:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788890934.504556:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997313920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.504581:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997314048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.504627:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.505920:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.505980:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997314048 00000100:00100000:0.0:1788890934.505988:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997314048 00000100:00100000:0.0:1788890934.506034:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788890934.506043:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997314048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890934.506155:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997314048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.506163:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788890934.506718:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997314048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890934.509006:0:10402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83164700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10402:1875787997314176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890934.509080:0:10402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.509558:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997314176 00000100:00100000:1.0:1788890934.509567:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997314176 00000100:00100000:0.0:1788890934.509578:0:10402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.509625:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788890934.509648:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:10402:x1875787997314176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890934.510867:0:10402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83164700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10402:1875787997314176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890934.510929:0:10402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83164700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10402:1875787997314304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890934.510945:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:10402:x1875787997314176:12345-0@lo:502:llog_process_th.0 Request processed in 1187us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.510957:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788890934.510978:0:10402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890934.511010:0:10402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.511386:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997314304 00000100:00100000:1.0:1788890934.511392:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997314304 00000100:00100000:1.0:1788890934.511431:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788890934.511439:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:10402:x1875787997314304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890934.511519:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:10402:x1875787997314304:12345-0@lo:502:llog_process_th.0 Request processed in 80us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.511548:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788890934.512271:0:10402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83164700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10402:1875787997314304:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788890934.512298:0:10402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788890934.514445:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788890934.514482:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788890934.514494:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd52d98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.514507:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd52d98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890934.514517:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788890934.514545:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1788890934.514554:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788890934.514590:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c6200/0xa66601b03fd52da6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.514600:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250b69c6200/0xa66601b03fd52da6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.514611:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250b69c6200/0xa66601b03fd52da6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890934.514905:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997314432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.514969:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.515045:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788890934.516067:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997314432 00000100:00100000:3.0:1788890934.516077:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997314432 00000100:00100000:3.0:1788890934.516126:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788890934.516136:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997314432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788890934.516151:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890934.516168:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8bc00/0xa66601b03fd52dad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52da6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.516194:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8bc00/0xa66601b03fd52dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52da6 expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.516205:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8bc00/0xa66601b03fd52dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52da6 expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890934.516226:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8bc00, rc 0) 00000100:00100000:3.0:1788890934.516283:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997314432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.516291:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788890934.517196:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997314432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890934.517216:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250b69c6200/0xa66601b03fd52da6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52dad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.517228:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250b69c6200/0xa66601b03fd52da6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52dad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890934.517294:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997314560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.517333:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.517366:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.517383:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997314560 00000100:00100000:1.0:1788890934.517388:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997314560 00000100:00100000:1.0:1788890934.517416:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788890934.517423:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997314560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.517562:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997314560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.517575:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788890934.517613:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997314560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.519579:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997314688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.519713:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.519802:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.519887:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997314688 00000100:00100000:1.0:1788890934.519893:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997314688 00000100:00100000:1.0:1788890934.519934:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788890934.519942:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997314688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.520049:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997314688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.520058:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788890934.520114:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997314688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.520437:0:10404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10404:1875787997314816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890934.520473:0:10404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.520494:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997314816 00000100:00100000:1.0:1788890934.520498:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997314816 00000100:00100000:1.0:1788890934.520545:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788890934.520553:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:10404:x1875787997314816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890934.521374:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:10404:x1875787997314816:12345-0@lo:502:llog_process_th.0 Request processed in 76us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.521387:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788890934.521438:0:10404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.521456:0:10404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10404:1875787997314816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788890934.521488:0:10404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890934.521497:0:10404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890934.521500:0:10404:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788890934.521509:0:10404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788890934.521555:0:10404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10404:1875787997314944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890934.521596:0:10404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.521749:0:10404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890934.525807:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997314944 00000100:00100000:2.0:1788890934.525818:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997314944 00000100:00100000:0.0:1788890934.525993:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788890934.526004:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:10404:x1875787997314944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890934.526722:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:10404:x1875787997314944:12345-0@lo:502:llog_process_th.0 Request processed in 718us (5123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.526798:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788890934.527280:0:10404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10404:1875787997314944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788890934.527317:0:10404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788890934.527324:0:10404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890934.527326:0:10404:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788890934.527331:0:10404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788890934.527505:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1788890934.529207:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788890934.529221:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c6200/0xa66601b03fd52da6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52dad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.529245:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250b69c6200/0xa66601b03fd52da6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52dad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890934.529471:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788890934.529475:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92509099a000 from 4 10000000:01000000:0.0:1788890934.529478:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788890934.529514:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52db4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.529537:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52db4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.529605:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52db4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890934.529631:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83164700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997315072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788890934.529711:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890934.529753:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.530196:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997315072 00000100:00100000:1.0:1788890934.530203:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997315072 00000100:00100000:1.0:1788890934.530259:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788890934.530269:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997315072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890934.530283:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890934.530296:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c6600/0xa66601b03fd52dbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52db4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.530320:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c6600/0xa66601b03fd52dbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52db4 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.530331:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c6600/0xa66601b03fd52dbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52db4 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890934.530340:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6600, rc 0) 00000100:00100000:1.0:1788890934.530395:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997315072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.530402:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788890934.530596:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83164700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997315072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788890934.530611:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52db4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52dbb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.530621:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52db4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52dbb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890934.530699:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997315200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890934.530729:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890934.530762:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508a7daa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.530809:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997315200 00000100:00100000:1.0:1788890934.530813:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997315200 00000100:00100000:1.0:1788890934.531482:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788890934.531492:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997315200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.531795:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997315200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.531802:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788890934.533010:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997315200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890934.533070:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997315328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890934.533126:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890934.533163:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508a7daa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.533270:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997315328 00000100:00100000:1.0:1788890934.533276:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997315328 00000100:00100000:1.0:1788890934.533316:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788890934.533324:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997315328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890934.533418:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997315328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.533425:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788890934.533506:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997315328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890934.534703:0:10405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83165500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10405:1875787997315456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890934.534763:0:10405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890934.534792:0:10405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788890934.535139:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997315456 00000100:00100000:1.0:1788890934.535145:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997315456 00000100:00100000:1.0:1788890934.535184:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788890934.535192:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:10405:x1875787997315456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890934.535298:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:10405:x1875787997315456:12345-0@lo:502:llog_process_th.0 Request processed in 106us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.535305:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788890934.535509:0:10405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83165500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10405:1875787997315456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788890934.535596:0:10405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788890934.535604:0:10405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890934.535606:0:10405:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788890934.535614:0:10405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92509099a000 00000020:00000080:0.0:1788890934.535615:0:10405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788890934.535694:0:10405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83165500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10405:1875787997315584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890934.535725:0:10405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890934.535746:0:10405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c1126480 going to sleep for 11 seconds 00000100:00100000:2.0:1788890934.536091:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997315584 00000100:00100000:2.0:1788890934.536096:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997315584 00000100:00100000:2.0:1788890934.536131:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788890934.536140:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:10405:x1875787997315584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788890934.536220:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:10405:x1875787997315584:12345-0@lo:502:llog_process_th.0 Request processed in 81us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890934.536237:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788890934.536242:0:10405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83165500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:10405:1875787997315584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788890934.536270:0:10405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788890934.536274:0:10405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890934.536275:0:10405:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788890934.536279:0:10405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788890934.536341:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788890934.536367:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788890934.536377:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52db4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52dbb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.536389:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52db4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52dbb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890934.536399:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788890934.536402:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff925091ac8000 from 1 10000000:01000000:2.0:1788890934.536404:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788890934.536431:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82311a00/0xa66601b03fd52dc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.536439:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff924f82311a00/0xa66601b03fd52dc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890934.536449:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff924f82311a00/0xa66601b03fd52dc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890934.536463:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997315712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788890934.536492:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890934.536516:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508a7dad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.536620:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997315712 00000100:00100000:0.0:1788890934.536624:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997315712 00000100:00100000:0.0:1788890934.536645:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788890934.536650:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997315712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890934.536656:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890934.536679:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae5400/0xa66601b03fd52dc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52dc2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.536697:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae5400/0xa66601b03fd52dc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52dc2 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.536705:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae5400/0xa66601b03fd52dc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52dc2 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.536712:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5400, rc 0) 00000100:00100000:0.0:1788890934.536741:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:6493:x1875787997315712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.536746:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788890934.536772:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997315712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890934.536782:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff924f82311a00/0xa66601b03fd52dc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52dc9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.536797:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff924f82311a00/0xa66601b03fd52dc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52dc9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890934.536845:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83165500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997315840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890934.536869:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890934.536886:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c1126480 going to sleep for 11 seconds 00000100:00100000:0.0:1788890934.536895:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997315840 00000100:00100000:0.0:1788890934.536897:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997315840 00000100:00100000:0.0:1788890934.536913:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788890934.536917:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:6493:x1875787997315840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890934.536979:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:6493:x1875787997315840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (108us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788890934.536984:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788890934.537007:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83165500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997315840:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788890934.537030:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788890934.537033:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82311a00/0xa66601b03fd52dc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52dc9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890934.537038:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff924f82311a00/0xa66601b03fd52dc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52dc9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890934.907833:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997315968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788890934.907900:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.907986:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997315968 00000100:00100000:3.0:1788890934.907993:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997315968 00000100:00100000:3.0:1788890934.908045:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788890934.908054:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997315968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788890934.908085:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788890934.908125:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997315968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.908131:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788890934.908170:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997315968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788890934.908597:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997316096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788890934.908627:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890934.908740:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997316096 00000100:00100000:0.0:1788890934.908745:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997316096 00000100:00100000:0.0:1788890934.908818:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788890934.908825:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997316096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788890934.908859:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788890934.908900:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997316096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890934.908906:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788890934.908985:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788890934.909007:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83165500 x1875787997316096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890934.909032:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83165500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997316096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788890934.909207:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997316224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788890934.909237:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890934.909357:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997316224 00000100:00100000:1.0:1788890934.909362:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997316224 00000100:00080000:2.0:1788890934.909377:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788890934.909390:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788890934.909397:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997316224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788890934.909409:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788890934.909548:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997316224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 150us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890934.909555:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788890934.909588:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250baa2dc00 x1875787997316224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890934.909600:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997316224:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788890935.228950:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890935.933020:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997316352:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788890935.933097:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890935.933219:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997316352 00000100:00100000:2.0:1788890935.933228:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997316352 00000100:00100000:2.0:1788890935.933292:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788890935.933312:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997316352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788890935.933354:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788890935.933405:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997316352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890935.933413:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788890935.933460:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997316352:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788890936.251661:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890936.787494:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890936.787600:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890936.787646:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890936.787680:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890936.787716:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890936.787757:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987819648 00000100:00100000:3.0:1788890936.787770:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987819648 00000100:00100000:3.0:1788890936.787858:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987819520 00000100:00100000:3.0:1788890936.787862:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987819520 00000100:00100000:3.0:1788890936.787899:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:3.0:1788890936.787911:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+5:2391:x1875787987819648:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890936.788011:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+5:2391:x1875787987819648:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 102us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890936.788021:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:3.0:1788890936.788042:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:3.0:1788890936.788050:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+5:2391:x1875787987819520:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890936.788082:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+5:2391:x1875787987819520:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 33us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890936.788090:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:3.0:1788890936.788115:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987819392 00000100:00100000:3.0:1788890936.788120:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987819392 00000100:00100000:3.0:1788890936.788164:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987819264 00000100:00100000:3.0:1788890936.788168:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987819264 00000100:00100000:3.0:1788890936.788202:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00100000:3.0:1788890936.788227:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+5:2391:x1875787987819392:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890936.788266:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+5:2391:x1875787987819392:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 42us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890936.788273:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00100000:3.0:1788890936.788288:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 56 00000100:00100000:3.0:1788890936.788297:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+6:2391:x1875787987819264:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890936.788348:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+6:2391:x1875787987819264:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 53us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890936.788355:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 56 00000100:00080000:3.0:1788890936.788372:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788890936.788377:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788890936.788380:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788890936.788383:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788890936.788896:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987819136 00000100:00100000:0.0:1788890936.788913:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987819136 00000100:00100000:0.0:1788890936.788984:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 271 00000100:00100000:0.0:1788890936.788994:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:2391:x1875787987819136:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788890936.789089:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:2391:x1875787987819136:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 95us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890936.789097:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 271 00010000:00010000:3.0:1788890937.275676:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890937.980687:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997316480:0@lo:400:kworker.0 00000100:00100000:1.0:1788890937.980762:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997316736:0@lo:400:kworker.0 00000100:00100000:2.0:1788890937.980823:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997316608:0@lo:400:kworker.0 00000100:00100000:3.0:1788890937.980851:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890937.981087:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890937.981144:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997317248:0@lo:400:kworker.0 00000100:00100000:1.0:1788890937.981189:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890937.981219:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997317760:0@lo:400:kworker.0 00000100:00100000:1.0:1788890937.981242:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890937.981275:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788890937.981281:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997316864:0@lo:400:kworker.0 00000100:00100000:1.0:1788890937.981303:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890937.981321:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997317376:0@lo:400:kworker.0 00000100:00100000:1.0:1788890937.981343:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890937.981380:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997317888:0@lo:400:kworker.0 00000100:00100000:1.0:1788890937.981403:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890937.981802:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997316480 00000100:00100000:0.0:1788890937.981812:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997316480 00000100:00100000:0.0:1788890937.981871:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788890937.981882:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3629:x1875787997316480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890937.981942:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3629:x1875787997316480:12345-0@lo:400:kworker.0 Request processed in 63us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890937.981956:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788890937.982311:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890937.982350:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1875787997317120:0@lo:400:kworker.0 00000100:00100000:2.0:1788890937.982377:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890937.982390:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1875787997317632:0@lo:400:kworker.0 00000100:00100000:2.0:1788890937.982410:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890937.982426:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788890937.982432:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997316992:0@lo:400:kworker.0 00000100:00100000:2.0:1788890937.982459:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890937.982482:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997317504:0@lo:400:kworker.0 00000100:00100000:2.0:1788890937.982506:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890937.982625:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997318016:0@lo:400:kworker.0 00000100:00100000:2.0:1788890937.982654:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890937.982692:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997316736 00000100:00100000:2.0:1788890937.982696:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997316736 00000100:00100000:2.0:1788890937.982725:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997316992 00000100:00100000:2.0:1788890937.982729:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997316992 00000100:00100000:2.0:1788890937.982744:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788890937.982751:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997316736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890937.982888:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997317248 00000100:00100000:0.0:1788890937.982893:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997317248 00000100:00100000:0.0:1788890937.982926:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997317760 00000100:00100000:0.0:1788890937.982930:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997317760 00000100:00100000:2.0:1788890937.982931:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997316736:12345-0@lo:400:kworker.0 Request processed in 179us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890937.982943:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788890937.982944:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997316864 00000100:00100000:0.0:1788890937.982946:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997316864 00000100:00100000:0.0:1788890937.982955:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997316608 00000100:00100000:2.0:1788890937.982957:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788890937.982957:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997316608 00000100:00100000:2.0:1788890937.982963:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997316992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890937.982967:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997317120 00000100:00100000:0.0:1788890937.982968:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997317120 00000100:00100000:0.0:1788890937.982978:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997317632 00000100:00100000:0.0:1788890937.982981:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997317632 00000100:00100000:0.0:1788890937.982993:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788890937.982996:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997316992:12345-0@lo:400:kworker.0 Request processed in 34us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890937.982999:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997317248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890937.983002:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788890937.983018:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997317376 00000100:00100000:2.0:1788890937.983021:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997317376 00000100:00100000:0.0:1788890937.983030:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997317248:12345-0@lo:400:kworker.0 Request processed in 32us (1841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890937.983036:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788890937.983039:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997317888 00000100:00100000:2.0:1788890937.983042:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997317888 00000100:00100000:0.0:1788890937.983046:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788890937.983051:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997317760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890937.983053:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997317504 00000100:00100000:2.0:1788890937.983055:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997317504 00000100:00100000:2.0:1788890937.983065:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997318016 00000100:00100000:2.0:1788890937.983067:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997318016 00000100:00100000:0.0:1788890937.983075:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997317760:12345-0@lo:400:kworker.0 Request processed in 25us (1833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890937.983080:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788890937.983081:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788890937.983085:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997317376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890937.983089:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788890937.983094:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997316864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890937.983113:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997317376:12345-0@lo:400:kworker.0 Request processed in 28us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890937.983115:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997316864:12345-0@lo:400:kworker.0 Request processed in 21us (1812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890937.983119:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788890937.983120:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788890937.983130:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788890937.983135:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997317888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890937.983135:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788890937.983140:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997316608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890937.983159:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997317888:12345-0@lo:400:kworker.0 Request processed in 24us (1756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890937.983161:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997316608:12345-0@lo:400:kworker.0 Request processed in 21us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890937.983165:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788890937.983167:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788890937.983175:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788890937.983175:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788890937.983181:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997317504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890937.983181:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875787997317120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890937.983204:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875787997317120:12345-0@lo:400:kworker.0 Request processed in 24us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890937.983210:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997317504:12345-0@lo:400:kworker.0 Request processed in 31us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890937.983210:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788890937.983216:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788890937.983221:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788890937.983226:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875787997317632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890937.983227:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788890937.983232:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997318016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890937.983249:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875787997317632:12345-0@lo:400:kworker.0 Request processed in 24us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890937.983251:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997318016:12345-0@lo:400:kworker.0 Request processed in 20us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890937.983255:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788890937.983256:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788890937.983273:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788890937.983278:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788890937.983281:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788890937.983283:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788890937.984154:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997316480:0@lo:400:kworker.0 00000100:00100000:2.0:1788890937.984154:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997316864:0@lo:400:kworker.0 00010000:00080000:2.0:1788890937.984172:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83149500 x1875787997317376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890937.984182:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997317376:0@lo:400:kworker.0 00010000:00080000:2.0:1788890937.984194:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f8314b480 x1875787997317888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890937.984203:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997317888:0@lo:400:kworker.0 00000100:00100000:2.0:1788890937.984215:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997316736:0@lo:400:kworker.0 00010000:00080000:2.0:1788890937.984227:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f8314b800 x1875787997317248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890937.984235:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997317248:0@lo:400:kworker.0 00010000:00080000:2.0:1788890937.984246:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f8314ad80 x1875787997317760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890937.984253:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997317760:0@lo:400:kworker.0 00000100:00100000:3.0:1788890937.984258:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997316992:0@lo:400:kworker.0 00010000:00080000:3.0:1788890937.984269:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f8314aa00 x1875787997317504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890937.984277:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997317504:0@lo:400:kworker.0 00010000:00080000:3.0:1788890937.984286:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bab61500 x1875787997318016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890937.984294:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997318016:0@lo:400:kworker.0 00000100:00100000:3.0:1788890937.984313:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997316608:0@lo:400:kworker.0 00000100:00100000:3.0:1788890937.984393:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1875787997317120:0@lo:400:kworker.0 00000100:00100000:3.0:1788890937.984413:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1875787997317632:0@lo:400:kworker.0 00000001:02000400:1.0:1788890938.028409:0:10673:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788890938.299887:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890938.493210:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788890938.493236:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997318144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788890938.493309:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890938.493369:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997318144 00000100:00100000:0.0:1788890938.493376:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997318144 00000100:00100000:0.0:1788890938.493425:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788890938.493434:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997318144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788890938.493465:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788890938.493552:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997318144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890938.493560:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788890938.494364:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83165180 x1875787997318144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890938.494387:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997318144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788890938.496116:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997318272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788890938.496209:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890938.496314:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997318272 00000100:00100000:1.0:1788890938.496323:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997318272 00000100:00100000:1.0:1788890938.496377:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788890938.496386:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997318272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788890938.496411:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788890938.497059:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997318272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 670us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890938.497068:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788890938.497142:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e74000 x1875787997318272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890938.497165:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997318272:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788890939.324512:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890940.027744:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788890940.027770:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997318400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788890940.027847:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890940.027911:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997318400 00000100:00100000:3.0:1788890940.027923:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997318400 00000100:00100000:3.0:1788890940.027965:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788890940.027973:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997318400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788890940.028008:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788890940.028054:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997318400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890940.028061:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788890940.028101:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997318400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788890940.028249:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788890940.028348:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997318656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788890940.028378:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890940.028514:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997318528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788890940.028688:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890940.028940:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997318656 00000100:00100000:3.0:1788890940.028945:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997318656 00000100:00100000:3.0:1788890940.028979:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997318528 00000100:00100000:3.0:1788890940.028981:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997318528 00000100:00100000:3.0:1788890940.028995:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788890940.029001:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997318656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788890940.029030:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788890940.029066:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997318656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890940.029072:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788890940.029084:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788890940.029090:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997318528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788890940.029098:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788890940.029117:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997318528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 27us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890940.029122:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788890940.029135:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788890940.029327:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e75c00 x1875787997318656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890940.029342:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997318656:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788890940.029353:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e74700 x1875787997318528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890940.029363:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997318528:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788890940.347651:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788890940.897361:0:10917:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing yml_node 00000100:00100000:0.0:1788890941.051762:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788890941.051788:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997318784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788890941.051875:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890941.051925:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997318784 00000100:00100000:3.0:1788890941.051936:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997318784 00000100:00100000:3.0:1788890941.052003:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788890941.052014:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997318784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788890941.052056:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788890941.052450:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997318784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 291us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890941.052460:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788890941.052997:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997318784:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788890941.379888:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890941.902993:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890941.903125:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890941.903417:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987819776 00000100:00100000:0.0:1788890941.903429:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987819776 00000100:00100000:0.0:1788890941.903497:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 273 00000100:00100000:0.0:1788890941.903509:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:2392:x1875787987819776:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890941.903711:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987820032 00000100:00100000:1.0:1788890941.903716:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987820032 00000100:00100000:1.0:1788890941.903775:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:1.0:1788890941.903783:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987820032:12345-192.168.204.26@tcp:400:kworker.0 00000100:00080000:2.0:1788890941.903911:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788890941.904047:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:2392:x1875787987819776:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 540us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890941.904057:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 273 00000100:00100000:1.0:1788890941.904130:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987820032:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 347us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890941.904138:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:3.0:1788890941.904463:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890941.904643:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890941.904748:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890941.904783:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987819904 00000100:00100000:0.0:1788890941.904790:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987819904 00000100:00100000:0.0:1788890941.904843:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:0.0:1788890941.904851:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+6:2392:x1875787987819904:12345-192.168.204.26@tcp:400:kworker.0 00000100:00080000:1.0:1788890941.904937:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890941.905029:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+6:2392:x1875787987819904:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 178us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890941.905036:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:2.0:1788890941.905476:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987820288 00000100:00100000:2.0:1788890941.905482:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987820288 00000100:00100000:1.0:1788890941.905574:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987820160 00000100:00100000:1.0:1788890941.905580:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987820160 00000100:00100000:2.0:1788890941.905662:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:2.0:1788890941.905676:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987820288:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788890941.905731:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987820288:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 58us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890941.905738:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00080000:0.0:1788890941.905768:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788890941.905773:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788890941.906163:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:1.0:1788890941.906173:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987820160:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890941.906224:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987820160:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 53us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890941.906231:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 30 00010000:00010000:3.0:1788890942.395809:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890943.104617:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997318912:0@lo:400:kworker.0 00000100:00100000:3.0:1788890943.104668:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997319040:0@lo:400:kworker.0 00000100:00100000:0.0:1788890943.105575:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997319168:0@lo:400:kworker.0 00000100:00100000:1.0:1788890943.105785:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997319296:0@lo:400:kworker.0 00000100:00100000:3.0:1788890943.107340:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890943.107340:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890943.107414:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997319040 00000100:00100000:0.0:1788890943.107421:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890943.107422:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997319040 00000100:00100000:0.0:1788890943.107461:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997319168 00000100:00100000:0.0:1788890943.107467:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997319168 00000100:00100000:2.0:1788890943.107477:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788890943.107500:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997319040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890943.107514:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788890943.107571:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997319040:12345-0@lo:400:kworker.0 Request processed in 86us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890943.107579:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788890943.107602:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997319168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890943.107604:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997318912 00000100:00100000:2.0:1788890943.107610:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997318912 00000100:00100000:2.0:1788890943.107637:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788890943.107644:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3628:x1875787997318912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890943.107656:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997319168:12345-0@lo:400:kworker.0 Request processed in 133us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890943.107665:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788890943.107685:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3628:x1875787997318912:12345-0@lo:400:kworker.0 Request processed in 41us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890943.107691:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788890943.107831:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997319040:0@lo:400:kworker.0 00000100:00100000:3.0:1788890943.107859:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997319552:0@lo:400:kworker.0 00000100:00100000:2.0:1788890943.107887:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997318912:0@lo:400:kworker.0 00000100:00100000:2.0:1788890943.107904:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997319424:0@lo:400:kworker.0 00000100:00100000:3.0:1788890943.108630:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890943.108638:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890943.108665:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997320064:0@lo:400:kworker.0 00000100:00100000:2.0:1788890943.108668:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997319936:0@lo:400:kworker.0 00000100:00100000:3.0:1788890943.108704:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890943.108710:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890943.108739:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997320448:0@lo:400:kworker.0 00000100:00100000:3.0:1788890943.108741:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788890943.108756:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997319680:0@lo:400:kworker.0 00000100:00100000:1.0:1788890943.108759:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890943.108796:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890943.108827:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997319808:0@lo:400:kworker.0 00000100:00100000:2.0:1788890943.108844:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890943.108904:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997319424 00000100:00100000:1.0:1788890943.108904:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890943.108913:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997319424 00000100:00100000:0.0:1788890943.108929:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997319168:0@lo:400:kworker.0 00000100:00100000:1.0:1788890943.108942:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997320320:0@lo:400:kworker.0 00000100:00100000:2.0:1788890943.108951:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788890943.108964:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997319424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890943.108979:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997319552 00000100:00100000:1.0:1788890943.108987:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890943.108988:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997319552 00000100:00100000:0.0:1788890943.109035:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997320064 00000100:00100000:0.0:1788890943.109039:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997320064 00000100:00100000:1.0:1788890943.109059:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997319936 00000100:00100000:0.0:1788890943.109063:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997319296 00000100:00100000:0.0:1788890943.109068:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997319296 00000100:00100000:1.0:1788890943.109069:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997319936 00000100:00100000:0.0:1788890943.109084:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997319680 00000100:00100000:0.0:1788890943.109089:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997319680 00000100:00100000:1.0:1788890943.109115:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997320448 00000100:00100000:1.0:1788890943.109121:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997320448 00000100:00100000:1.0:1788890943.109138:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997319808 00000100:00100000:1.0:1788890943.109141:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997319808 00000100:00100000:1.0:1788890943.109155:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997320320 00000100:00100000:1.0:1788890943.109157:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997320320 00000100:00100000:1.0:1788890943.109172:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788890943.109179:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997319936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890943.109243:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997319424:12345-0@lo:400:kworker.0 Request processed in 283us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890943.109251:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788890943.109275:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788890943.109282:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997320192:0@lo:400:kworker.0 00000100:00100000:2.0:1788890943.109286:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997320448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890943.109333:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997319936:12345-0@lo:400:kworker.0 Request processed in 150us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890943.109350:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788890943.109356:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890943.109361:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997320448:12345-0@lo:400:kworker.0 Request processed in 70us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890943.109370:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788890943.109393:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788890943.109403:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788890943.109411:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997320192 00000100:00100000:1.0:1788890943.109412:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997319808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890943.109419:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997320192 00000100:00100000:2.0:1788890943.109419:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b6b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997320320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890943.109454:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788890943.109461:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b6b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997320320:12345-0@lo:400:kworker.0 Request processed in 48us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890943.109467:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997319552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890943.109471:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788890943.109634:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997319424:0@lo:400:kworker.0 00000100:00100000:0.0:1788890943.109644:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788890943.109656:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997320064:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788890943.109666:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82ff4e00 x1875787997319936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890943.109677:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997319936:0@lo:400:kworker.0 00010000:00080000:2.0:1788890943.109686:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83840700 x1875787997320448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890943.109693:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997320448:0@lo:400:kworker.0 00000100:00100000:1.0:1788890943.109788:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997319808:12345-0@lo:400:kworker.0 Request processed in 383us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890943.109790:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997320064:12345-0@lo:400:kworker.0 Request processed in 134us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890943.109819:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788890943.109836:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788890943.109854:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788890943.109865:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997319296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890943.109925:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997319296:12345-0@lo:400:kworker.0 Request processed in 65us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890943.109936:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788890943.109964:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788890943.109974:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997320192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890943.110033:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997320192:12345-0@lo:400:kworker.0 Request processed in 62us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890943.110046:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788890943.110069:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788890943.110079:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997319680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890943.110152:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997319296:0@lo:400:kworker.0 00010000:00080000:1.0:1788890943.110168:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82ff7100 x1875787997319808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890943.110179:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997319808:0@lo:400:kworker.0 00010000:00080000:1.0:1788890943.110208:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83841f80 x1875787997320320/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890943.110218:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997320320:0@lo:400:kworker.0 00000100:00080000:1.0:1788890943.110361:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788890943.110371:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788890943.110374:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788890943.110377:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890943.110472:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997319552:12345-0@lo:400:kworker.0 Request processed in 1007us (1840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890943.110480:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:3.0:1788890943.110632:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82ff4000 x1875787997320192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890943.110645:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997320192:0@lo:400:kworker.0 00000100:00100000:3.0:1788890943.110659:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997319552:0@lo:400:kworker.0 00000100:00100000:3.0:1788890943.110671:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997320064:0@lo:400:kworker.0 00000100:00100000:0.0:1788890943.110976:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997319680:12345-0@lo:400:kworker.0 Request processed in 899us (2182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890943.110983:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1788890943.111116:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82ff6300 x1875787997319680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890943.111128:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997319680:0@lo:400:kworker.0 00010000:00010000:1.0:1788890943.420976:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788890943.518078:0:11100:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.103 00000100:00100000:1.0:1788890943.611889:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997320576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788890943.612169:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890943.612403:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997320576 00000100:00100000:3.0:1788890943.612414:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997320576 00000100:00100000:3.0:1788890943.612661:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788890943.612676:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997320576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788890943.612718:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788890943.612799:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997320576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890943.612938:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788890943.612993:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83148e00 x1875787997320576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890943.613019:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997320576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788890943.613606:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788890943.613621:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997320704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788890943.613669:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890943.614145:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997320704 00000100:00100000:2.0:1788890943.614153:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997320704 00000100:00100000:2.0:1788890943.614206:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788890943.614216:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997320704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788890943.614236:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788890943.614301:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997320704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890943.614313:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788890943.614391:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e75c00 x1875787997320704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890943.614411:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997320704:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788890944.443833:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788890945.057266:0:11197:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.103 00000100:00100000:2.0:1788890945.148436:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997320960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788890945.148483:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997320832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788890945.148543:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890945.148553:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890945.148622:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997321088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788890945.148627:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997320832 00000100:00100000:3.0:1788890945.148635:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997320832 00000100:00100000:2.0:1788890945.148651:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890945.148687:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788890945.148693:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997320960 00000100:00100000:3.0:1788890945.148699:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997320832:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788890945.148712:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997320960 00000100:00100000:2.0:1788890945.148752:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997321088 00000100:00100000:2.0:1788890945.148755:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997321088 00000100:00100000:2.0:1788890945.148775:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788890945.148783:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997320960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788890945.148828:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:3.0:1788890945.148888:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788890945.148895:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997320960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890945.148903:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788890945.148923:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788890945.148932:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997321088:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788890945.148939:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997320832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 240us (384us total) trans 0 rc 0/0 00002000:00000024:2.0:1788890945.148944:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788890945.148958:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788890945.148980:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997321088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890945.148999:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788890945.149006:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997320832:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788890945.149026:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788890945.149065:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e74000 x1875787997320960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890945.149082:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997320960:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788890945.149106:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e75c00 x1875787997321088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890945.149681:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997321088:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788890945.473168:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890946.171820:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788890946.174142:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997321216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788890946.174216:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890946.176776:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997321216 00000100:00100000:2.0:1788890946.176791:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997321216 00000100:00100000:2.0:1788890946.176853:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788890946.176865:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997321216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788890946.176900:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788890946.176979:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997321216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (2762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890946.176987:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788890946.177042:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997321216:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788890946.492465:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788890946.496464:0:11295:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.103 00000100:00100000:0.0:1788890947.024427:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890947.024483:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890947.024515:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890947.024574:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987820928 00000100:00100000:0.0:1788890947.024575:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890947.024588:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987820928 00000100:00100000:0.0:1788890947.024610:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890947.024639:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987820672 00000100:00100000:0.0:1788890947.024644:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987820672 00000100:00100000:3.0:1788890947.024674:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987820800 00000100:00100000:3.0:1788890947.024679:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987820800 00000100:00100000:0.0:1788890947.024687:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987820544 00000100:00100000:0.0:1788890947.024692:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987820544 00000100:00100000:3.0:1788890947.024726:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:1.0:1788890947.024729:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987820416 00000100:00100000:0.0:1788890947.024730:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 71 00000100:00100000:1.0:1788890947.024737:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987820416 00000100:00100000:3.0:1788890947.024746:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2394:x1875787987820928:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788890947.024747:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2394:x1875787987820672:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890947.024777:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 275 00000100:00100000:1.0:1788890947.024788:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:2394:x1875787987820416:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788890947.024838:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2394:x1875787987820672:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 98us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890947.024847:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 71 00000100:00100000:0.0:1788890947.024865:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 72 00000100:00100000:0.0:1788890947.024873:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:2394:x1875787987820544:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890947.025224:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2394:x1875787987820928:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 484us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890947.025232:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:3.0:1788890947.025250:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:3.0:1788890947.025257:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83166d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2394:x1875787987820800:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890947.025284:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83166d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2394:x1875787987820800:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 28us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890947.025290:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00080000:3.0:1788890947.025309:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788890947.025315:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788890947.025318:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788890947.025321:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788890947.025383:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:2394:x1875787987820544:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 510us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890947.025395:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:2394:x1875787987820416:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 606us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890947.025395:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 72 00000100:00100000:1.0:1788890947.025409:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 275 00000001:02000400:1.0:1788890947.443902:0:11343:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 14:09:06 EDT 2026 00010000:00010000:3.0:1788890947.516239:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890948.220762:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997321600:0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.220829:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890948.220883:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997322112:0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.220909:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890948.220942:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997322624:0@lo:400:kworker.0 00000100:00100000:3.0:1788890948.220950:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997321344:0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.220963:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890948.220988:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788890948.220995:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997321728:0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.221015:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890948.221033:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997322240:0@lo:400:kworker.0 00000100:00100000:3.0:1788890948.221035:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890948.221057:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890948.221060:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997321856:0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.221073:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997322752:0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.221089:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890948.221090:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890948.221104:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997322368:0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.221119:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997321600 00000100:00100000:3.0:1788890948.221123:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890948.221125:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997321600 00000100:00100000:3.0:1788890948.221138:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997322880:0@lo:400:kworker.0 00000100:00100000:3.0:1788890948.221156:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890948.221162:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997321856 00000100:00100000:1.0:1788890948.221164:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997321856 00000100:00100000:3.0:1788890948.221171:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788890948.221176:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997321472:0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.221180:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788890948.221187:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997321600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890948.221194:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890948.221209:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997321984:0@lo:400:kworker.0 00000100:00100000:3.0:1788890948.221225:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890948.221234:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997322496:0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.221234:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997321600:12345-0@lo:400:kworker.0 Request processed in 47us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890948.221243:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788890948.221251:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890948.221259:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788890948.221265:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997321856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890948.221269:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997321344 00000100:00100000:3.0:1788890948.221272:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997321344 00000100:00100000:3.0:1788890948.221295:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788890948.221295:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997321856:12345-0@lo:400:kworker.0 Request processed in 31us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890948.221301:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788890948.221302:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3627:x1875787997321344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.221316:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997322112 00000100:00100000:1.0:1788890948.221319:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997322112 00000100:00100000:3.0:1788890948.221330:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3627:x1875787997321344:12345-0@lo:400:kworker.0 Request processed in 29us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890948.221337:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788890948.221344:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997322624 00000100:00100000:1.0:1788890948.221346:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997322624 00000100:00100000:3.0:1788890948.221366:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997322240 00000100:00100000:3.0:1788890948.221369:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997322240 00000100:00100000:1.0:1788890948.221381:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997321728 00000100:00100000:1.0:1788890948.221383:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997321728 00000100:00100000:3.0:1788890948.221384:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997322752 00000100:00100000:3.0:1788890948.221386:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997322752 00000100:00100000:1.0:1788890948.221405:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997321472 00000100:00100000:1.0:1788890948.221408:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997321472 00000100:00100000:3.0:1788890948.221409:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997322368 00000100:00100000:3.0:1788890948.221411:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997322368 00000100:00100000:1.0:1788890948.221417:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997321984 00000100:00100000:1.0:1788890948.221419:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997321984 00000100:00100000:3.0:1788890948.221421:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997322880 00000100:00100000:3.0:1788890948.221423:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997322880 00000100:00100000:1.0:1788890948.221431:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997322496 00000100:00100000:1.0:1788890948.221434:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997322496 00000100:00100000:3.0:1788890948.221443:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788890948.221444:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788890948.221449:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090311180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997322240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.221449:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997322112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.221478:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997322112:12345-0@lo:400:kworker.0 Request processed in 29us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890948.221484:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788890948.221650:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090311180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997322240:12345-0@lo:400:kworker.0 Request processed in 199us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890948.221657:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788890948.221672:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788890948.221679:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997322752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.221705:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788890948.221708:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997322752:12345-0@lo:400:kworker.0 Request processed in 30us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890948.221712:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997322624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890948.221714:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788890948.221725:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788890948.221730:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997322368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.221739:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997322624:12345-0@lo:400:kworker.0 Request processed in 29us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890948.221745:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788890948.221752:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997322368:12345-0@lo:400:kworker.0 Request processed in 22us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890948.221756:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788890948.221758:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788890948.221760:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997321728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890948.221766:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788890948.221772:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997322880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.221782:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997321728:12345-0@lo:400:kworker.0 Request processed in 22us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890948.221788:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788890948.221792:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997322880:12345-0@lo:400:kworker.0 Request processed in 22us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890948.221797:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788890948.221798:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788890948.221802:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997321472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890948.221817:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788890948.221824:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997321984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.221826:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997321472:12345-0@lo:400:kworker.0 Request processed in 25us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890948.221840:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788890948.221849:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997321984:12345-0@lo:400:kworker.0 Request processed in 26us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890948.221851:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788890948.221856:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788890948.221857:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997322496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.221882:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997322496:12345-0@lo:400:kworker.0 Request processed in 25us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890948.221888:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1788890948.221923:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788890948.221929:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788890948.221931:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788890948.221934:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788890948.221970:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997321472:0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.221983:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997321984:0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.221993:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997322496:0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.222002:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997321344:0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.222012:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997321856:0@lo:400:kworker.0 00010000:00080000:1.0:1788890948.222024:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83843100 x1875787997322368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890948.222035:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997322368:0@lo:400:kworker.0 00010000:00080000:1.0:1788890948.222046:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83841c00 x1875787997322880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890948.222053:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997322880:0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.222094:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997321728:0@lo:400:kworker.0 00010000:00080000:1.0:1788890948.222111:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83842300 x1875787997322240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890948.222118:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997322240:0@lo:400:kworker.0 00010000:00080000:1.0:1788890948.222126:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83840000 x1875787997322752/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890948.222132:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997322752:0@lo:400:kworker.0 00000100:00100000:1.0:1788890948.222140:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997321600:0@lo:400:kworker.0 00010000:00080000:1.0:1788890948.222148:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83840380 x1875787997322112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890948.222154:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997322112:0@lo:400:kworker.0 00010000:00080000:1.0:1788890948.222162:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83841880 x1875787997322624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890948.222168:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997322624:0@lo:400:kworker.0 00010000:00010000:1.0:1788890948.543838:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890948.731913:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788890948.731937:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997323008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788890948.732074:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890948.732161:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997323008 00000100:00100000:2.0:1788890948.732169:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997323008 00000100:00100000:2.0:1788890948.732217:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788890948.732226:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997323008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788890948.732257:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788890948.732319:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997323008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890948.732325:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788890948.732577:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250baa2e300 x1875787997323008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890948.732750:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997323008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788890948.736109:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997323136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788890948.736178:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890948.736299:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997323136 00000100:00100000:2.0:1788890948.736307:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997323136 00000100:00100000:2.0:1788890948.736400:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788890948.736410:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997323136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788890948.736431:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788890948.736480:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997323136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890948.736488:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788890948.736578:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e75c00 x1875787997323136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890948.736718:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997323136:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788890949.563666:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890950.267878:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997323392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788890950.267952:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890950.268017:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788890950.268023:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997323520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788890950.268046:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890950.268079:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997323520 00000100:00100000:3.0:1788890950.268086:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997323520 00000100:00100000:0.0:1788890950.268117:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997323392 00000100:00100000:0.0:1788890950.268123:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997323392 00000100:00100000:3.0:1788890950.268136:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788890950.268147:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997323520:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788890950.268165:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788890950.268176:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997323392:12345-0@lo:13:osp-pre-0-0.0 00000004:00000024:3.0:1788890950.268182:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00002000:00000024:0.0:1788890950.268198:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788890950.268236:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997323520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890950.268244:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788890950.268290:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997323520:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1788890950.268303:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82ff5880 x1875787997323392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890950.268316:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997323392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788890950.268394:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997323264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788890950.268396:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997323392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 222us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890950.268422:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788890950.268436:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788890950.268483:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788890950.268495:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997323264 00000100:00100000:1.0:1788890950.268499:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997323264 00000100:00100000:1.0:1788890950.268565:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788890950.268573:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997323264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788890950.268586:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788890950.268620:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997323264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890950.268627:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788890950.268665:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83167800 x1875787997323264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890950.268678:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997323264:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788890950.268781:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788890950.588579:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890951.291878:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997323648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788890951.291979:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890951.292094:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997323648 00000100:00100000:1.0:1788890951.292105:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997323648 00000100:00100000:1.0:1788890951.292169:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788890951.292187:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997323648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788890951.292236:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788890951.293829:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997323648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1637us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890951.293861:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788890951.293950:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997323648:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788890951.613756:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890952.143406:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890952.143659:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987821056 00000100:00100000:1.0:1788890952.143670:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987821056 00000100:00100000:1.0:1788890952.143730:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 277 00000100:00100000:1.0:1788890952.143740:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:2393:x1875787987821056:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890952.143817:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:2393:x1875787987821056:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 78us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890952.143825:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 277 00000100:00100000:3.0:1788890952.144270:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890952.144297:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890952.144334:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987821312 00000100:00100000:3.0:1788890952.144338:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987821312 00000100:00100000:3.0:1788890952.144378:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987821184 00000100:00100000:3.0:1788890952.144381:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987821184 00000100:00100000:3.0:1788890952.144403:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 79 00000100:00100000:3.0:1788890952.144411:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987821312:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890952.144462:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987821312:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 51us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890952.144470:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 79 00000100:00100000:3.0:1788890952.144485:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 80 00000100:00100000:3.0:1788890952.144492:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:2393:x1875787987821184:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890952.144518:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:2393:x1875787987821184:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 27us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890952.145178:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 80 00000100:00080000:3.0:1788890952.145198:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788890952.145202:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788890952.154434:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890952.154474:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890952.154553:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987821440 00000100:00100000:2.0:1788890952.154570:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987821440 00000100:00100000:3.0:1788890952.154577:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987821568 00000100:00100000:3.0:1788890952.154588:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987821568 00000100:00100000:2.0:1788890952.154742:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:2.0:1788890952.154758:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+5:2390:x1875787987821440:12345-192.168.204.26@tcp:9:kworker.0 00000020:00000080:2.0:1788890952.154808:0:8408:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52cdb 00000100:00080000:2.0:1788890952.154824:0:8408:0:(import.c:65:import_set_state_nolock()) ffff924f83102800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788890952.154887:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788890952.155104:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+2:2390:x1875787987821440:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 350us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890952.155130:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:3.0:1788890952.155880:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:3.0:1788890952.155894:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+5:2390:x1875787987821568:12345-192.168.204.26@tcp:9:kworker.0 00000020:00000080:3.0:1788890952.155924:0:8411:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52ce2 00000100:00080000:3.0:1788890952.155934:0:8411:0:(import.c:65:import_set_state_nolock()) ffff924f82c18800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788890952.155977:0:8411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788890952.156120:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+2:2390:x1875787987821568:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 229us (1645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890952.156129:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 19 00010000:00010000:3.0:1788890952.156186:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890952.156294:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788890952.156425:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788890952.156430:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788890952.635717:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890953.339743:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788890953.339896:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788890953.339916:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997324160:0@lo:400:kworker.0 00000100:00100000:0.0:1788890953.339987:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890953.340117:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997323776:0@lo:400:kworker.0 00000100:00100000:1.0:1788890953.340154:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890953.340241:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997324160 00000100:00100000:1.0:1788890953.340258:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997324160 00000100:00100000:1.0:1788890953.340318:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788890953.340328:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997324160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890953.340381:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997324160:12345-0@lo:400:kworker.0 Request processed in 55us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890953.340389:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788890953.340432:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997324160:0@lo:400:kworker.0 00000100:00100000:1.0:1788890953.340947:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997324288:0@lo:400:kworker.0 00000100:00100000:1.0:1788890953.341001:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890953.341119:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997323776 00000100:00100000:0.0:1788890953.341124:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997323776 00000100:00100000:0.0:1788890953.341161:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788890953.341169:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3629:x1875787997323776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890953.341219:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3629:x1875787997323776:12345-0@lo:400:kworker.0 Request processed in 51us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890953.341225:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788890953.341379:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788890953.341386:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997324672:0@lo:400:kworker.0 00000100:00100000:1.0:1788890953.341424:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890953.341583:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997323904:0@lo:400:kworker.0 00000100:00100000:3.0:1788890953.341613:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890953.341636:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997324416:0@lo:400:kworker.0 00000100:00100000:3.0:1788890953.341668:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890953.341683:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997324928:0@lo:400:kworker.0 00000100:00100000:3.0:1788890953.341700:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890953.341902:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997324800:0@lo:400:kworker.0 00000100:00100000:1.0:1788890953.341933:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890953.341962:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788890953.341970:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997324032:0@lo:400:kworker.0 00000100:00100000:3.0:1788890953.341998:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890953.342018:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997324544:0@lo:400:kworker.0 00000100:00100000:3.0:1788890953.342051:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890953.342071:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997325056:0@lo:400:kworker.0 00000100:00100000:3.0:1788890953.342091:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890953.342114:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997324288 00000100:00100000:3.0:1788890953.342119:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997324288 00000100:00100000:3.0:1788890953.342146:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997324032 00000100:00100000:3.0:1788890953.342149:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997324032 00000100:00100000:3.0:1788890953.342162:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788890953.342169:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997324288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890953.342224:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997324288:12345-0@lo:400:kworker.0 Request processed in 55us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890953.342231:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788890953.342245:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788890953.342263:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997324032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890953.342304:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997324032:12345-0@lo:400:kworker.0 Request processed in 42us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890953.342311:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788890953.342328:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997323904 00000100:00100000:3.0:1788890953.342332:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997323904 00000100:00100000:3.0:1788890953.342358:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997324416 00000100:00100000:3.0:1788890953.342361:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997324416 00000100:00100000:3.0:1788890953.342388:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997324928 00000100:00100000:3.0:1788890953.342392:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997324928 00000100:00100000:3.0:1788890953.342409:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997324544 00000100:00100000:3.0:1788890953.342412:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997324544 00000100:00100000:2.0:1788890953.342434:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997325056 00000100:00100000:2.0:1788890953.342440:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997325056 00000100:00100000:3.0:1788890953.342444:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788890953.342455:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997323904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890953.342476:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788890953.342486:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997324416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890953.342494:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997323904:12345-0@lo:400:kworker.0 Request processed in 41us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890953.342501:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788890953.342515:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788890953.342551:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997324928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890953.342724:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997324928:12345-0@lo:400:kworker.0 Request processed in 188us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890953.342731:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788890953.342745:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788890953.342750:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997324416:12345-0@lo:400:kworker.0 Request processed in 264us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890953.342756:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997324544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890953.342763:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788890953.342783:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788890953.342791:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997324544:12345-0@lo:400:kworker.0 Request processed in 37us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890953.342795:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997325056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890953.342831:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997325056:12345-0@lo:400:kworker.0 Request processed in 41us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890953.342836:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788890953.342861:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997325184:0@lo:400:kworker.0 00000100:00100000:3.0:1788890953.342889:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788890953.342918:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788890953.342923:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788890953.342924:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997324032:0@lo:400:kworker.0 00010000:00080000:2.0:1788890953.342942:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82ff6680 x1875787997324544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890953.342952:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997324544:0@lo:400:kworker.0 00010000:00080000:2.0:1788890953.342962:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bab63800 x1875787997325056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890953.342970:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997325056:0@lo:400:kworker.0 00000100:00100000:2.0:1788890953.342980:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997323904:0@lo:400:kworker.0 00000100:00100000:2.0:1788890953.343063:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997324416:0@lo:400:kworker.0 00000100:00100000:2.0:1788890953.343074:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997324928:0@lo:400:kworker.0 00000100:00100000:1.0:1788890953.343304:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997325312:0@lo:400:kworker.0 00000100:00100000:1.0:1788890953.343331:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890953.343382:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997324672 00000100:00100000:0.0:1788890953.343388:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997324672 00000100:00100000:3.0:1788890953.343676:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997324800 00000100:00100000:3.0:1788890953.343681:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997324800 00000100:00100000:1.0:1788890953.345339:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997324288:0@lo:400:kworker.0 00000100:00100000:1.0:1788890953.345390:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890953.345414:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997323776:0@lo:400:kworker.0 00000100:00100000:2.0:1788890953.345563:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997325312 00000100:00100000:2.0:1788890953.345570:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997325312 00000100:00100000:3.0:1788890953.347002:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788890953.347128:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788890953.347143:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997324800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890953.347240:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997324672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890953.347384:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997324672:12345-0@lo:400:kworker.0 Request processed in 148us (5958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890953.347398:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788890953.347406:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997325184 00000100:00100000:2.0:1788890953.347413:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997325184 00000100:00100000:3.0:1788890953.347425:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788890953.347434:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997325312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890953.347447:0:8410:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788890953.347455:0:8410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788890953.347474:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997325312:12345-0@lo:400:kworker.0 Request processed in 42us (4142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890953.347481:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788890953.347496:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788890953.347502:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997325184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890953.347548:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997324800:12345-0@lo:400:kworker.0 Request processed in 409us (5614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890953.347556:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788890953.347663:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997325184:12345-0@lo:400:kworker.0 Request processed in 160us (2272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890953.347678:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788890953.347707:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82ff5880 x1875787997324800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890953.347722:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997324800:0@lo:400:kworker.0 00010000:00080000:3.0:1788890953.347739:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bab61c00 x1875787997325184/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788890953.347745:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bab60000 x1875787997325312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890953.347759:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997325184:0@lo:400:kworker.0 00000100:00100000:2.0:1788890953.347763:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997325312:0@lo:400:kworker.0 00010000:00080000:2.0:1788890953.347779:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82ff7800 x1875787997324672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890953.347794:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997324672:0@lo:400:kworker.0 00000100:00080000:0.0:1788890953.348057:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788890953.348063:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788890953.660723:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890953.852824:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997325440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788890953.852893:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890953.852949:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788890953.852955:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997325568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788890953.852979:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890953.853013:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997325440 00000100:00100000:2.0:1788890953.853019:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997325440 00000100:00100000:2.0:1788890953.853065:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997325568 00000100:00100000:2.0:1788890953.853068:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997325568 00000100:00100000:2.0:1788890953.853084:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788890953.853092:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997325440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788890953.853120:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788890953.853163:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997325440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890953.853171:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788890953.853187:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788890953.853194:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997325568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788890953.853203:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788890953.853228:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997325568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890953.853234:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788890953.853271:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83843480 x1875787997325568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890953.855782:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997325568:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788890953.855813:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83842300 x1875787997325440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890953.855828:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997325440:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788890954.683675:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890955.389622:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997325696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788890955.389703:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890955.389784:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997325696 00000100:00100000:3.0:1788890955.389792:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997325696 00000100:00100000:3.0:1788890955.389850:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788890955.389860:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997325696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788890955.389891:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788890955.389946:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997325696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890955.389965:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788890955.389991:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890955.390006:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997325824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788890955.390033:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890955.390073:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997325824 00000100:00100000:2.0:1788890955.390078:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997325824 00010000:00080000:3.0:1788890955.390105:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf738000 x1875787997325696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890955.390128:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997325696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788890955.390143:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1788890955.390149:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788890955.390154:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997325824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788890955.390173:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788890955.390209:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997325824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890955.390215:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788890955.390219:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e75880 x1875787997325824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890955.390232:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997325824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788890955.390448:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788890955.390458:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997325952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788890955.390487:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890955.390598:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997325952 00000100:00100000:1.0:1788890955.390604:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997325952 00000100:00100000:1.0:1788890955.390642:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788890955.390649:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997325952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788890955.390672:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788890955.390718:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997325952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890955.390725:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788890955.390752:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997325952:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788890955.592993:0:11972:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 14:09:14 (1788890954) === 00010000:00010000:3.0:1788890955.708746:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890955.809090:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890955.810431:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987821696 00000100:00100000:0.0:1788890955.810445:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987821696 00000100:00100000:0.0:1788890955.810594:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 279 00000100:00100000:0.0:1788890955.810607:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:8701:x1875787987821696:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788890955.810624:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890955.810642:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae4200/0xa66601b03fd52dd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddd17 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890955.810668:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae4200/0xa66601b03fd52dd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd17 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890955.810680:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae4200/0xa66601b03fd52dd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd17 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890955.810689:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4200, rc 0) 00000100:00100000:0.0:1788890955.810753:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:8701:x1875787987821696:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 149us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890955.810760:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 279 00000100:00100000:3.0:1788890955.818181:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890955.818312:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987821824 00000100:00100000:1.0:1788890955.818323:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987821824 00000100:00100000:1.0:1788890955.818380:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 280 00000100:00100000:1.0:1788890955.818391:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:8701:x1875787987821824:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788890955.819302:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:8701:x1875787987821824:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 201us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890955.819316:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 280 00000100:00100000:1.0:1788890955.824673:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890955.825126:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987821952 00000100:00100000:0.0:1788890955.825137:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987821952 00000100:00100000:0.0:1788890955.825204:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 281 00000100:00100000:0.0:1788890955.825215:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:8701:x1875787987821952:12345-192.168.204.26@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788890955.825382:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:8701:x1875787987821952:12345-192.168.204.26@tcp:503:mount.lustre.0 Request processed in 169us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890955.825391:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 281 00000100:00100000:0.0:1788890955.828683:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890955.828940:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987822080 00000100:00100000:1.0:1788890955.828950:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987822080 00000100:00100000:1.0:1788890955.829007:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 282 00000100:00100000:1.0:1788890955.829017:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:8705:x1875787987822080:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788890955.829311:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:8705:x1875787987822080:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 295us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890955.829321:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 282 00000100:00100000:3.0:1788890955.841313:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890955.842326:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987822208 00000100:00100000:0.0:1788890955.842338:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987822208 00000100:00100000:0.0:1788890955.842409:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 283 00000100:00100000:0.0:1788890955.842427:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:8705:x1875787987822208:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788890955.842637:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:8705:x1875787987822208:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 210us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890955.842646:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 283 00000100:00100000:0.0:1788890955.844886:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890955.845600:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987822336 00000100:00100000:1.0:1788890955.845610:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987822336 00000100:00100000:1.0:1788890955.845704:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 284 00000100:00100000:1.0:1788890955.845714:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:8705:x1875787987822336:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788890955.845866:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:8705:x1875787987822336:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 153us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890955.845872:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 284 00000100:00100000:1.0:1788890955.850710:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890955.852325:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987822464 00000100:00100000:3.0:1788890955.852335:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987822464 00000100:00100000:3.0:1788890955.852397:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 285 00000100:00100000:3.0:1788890955.852404:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:8701:x1875787987822464:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788890955.852419:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890955.852434:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8ae00/0xa66601b03fd52dd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddd48 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890955.853611:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8ae00/0xa66601b03fd52dd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd48 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890955.853625:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8ae00/0xa66601b03fd52dd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd48 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890955.853635:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8ae00, rc 0) 00000100:00100000:2.0:1788890955.853702:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:8701:x1875787987822464:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 1296us (3000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890955.853710:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 285 00000100:00100000:3.0:1788890955.856155:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890955.856340:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987822592 00000100:00100000:1.0:1788890955.856350:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987822592 00000100:00100000:1.0:1788890955.856404:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 286 00000100:00100000:1.0:1788890955.856416:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:8701:x1875787987822592:12345-192.168.204.26@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788890955.856442:0:6488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788890955.856464:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788890955.856468:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788890955.856471:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788890955.856474:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788890955.856476:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788890955.857810:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:8701:x1875787987822592:12345-192.168.204.26@tcp:256:mount.lustre.0 Request processed in 1392us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890955.857820:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 286 00000100:00100000:0.0:1788890955.860605:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890955.860709:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987822720 00000100:00100000:2.0:1788890955.860721:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987822720 00000100:00100000:2.0:1788890955.860817:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 287 00000100:00100000:2.0:1788890955.860827:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:8701:x1875787987822720:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788890955.860845:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890955.860861:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924f82310000/0xa66601b03fd52dde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddd4f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890955.860888:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924f82310000/0xa66601b03fd52dde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd4f expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890955.860899:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924f82310000/0xa66601b03fd52dde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd4f expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890955.860924:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310000, rc 0) 00000100:00100000:2.0:1788890955.860982:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:8701:x1875787987822720:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 156us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890955.860989:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 287 00000100:00100000:0.0:1788890955.862946:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890955.863003:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987822848 00000100:00100000:1.0:1788890955.863012:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987822848 00000100:00100000:1.0:1788890955.863167:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 288 00000100:00100000:1.0:1788890955.863178:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:8701:x1875787987822848:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788890955.863334:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:8701:x1875787987822848:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 157us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890955.863342:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 288 00000100:00100000:1.0:1788890955.864682:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890955.864746:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987822976 00000100:00100000:2.0:1788890955.864758:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987822976 00000100:00100000:2.0:1788890955.864843:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 289 00000100:00100000:2.0:1788890955.864852:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:8701:x1875787987822976:12345-192.168.204.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788890955.864989:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:8701:x1875787987822976:12345-192.168.204.26@tcp:503:mount.lustre.0 Request processed in 137us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890955.864996:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 289 00000100:00100000:0.0:1788890955.869280:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890955.869363:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987823104 00000100:00100000:1.0:1788890955.869374:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987823104 00000100:00100000:1.0:1788890955.869430:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 290 00000100:00100000:1.0:1788890955.869505:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:8710:x1875787987823104:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788890955.869699:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:8710:x1875787987823104:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 258us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890955.869708:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 290 00000100:00100000:3.0:1788890955.872133:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890955.872230:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987823232 00000100:00100000:2.0:1788890955.872250:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987823232 00000100:00100000:2.0:1788890955.872304:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 291 00000100:00100000:2.0:1788890955.872314:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:8710:x1875787987823232:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788890955.872472:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:8710:x1875787987823232:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 159us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890955.872479:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 291 00000100:00100000:2.0:1788890955.874932:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890955.876392:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987823360 00000100:00100000:3.0:1788890955.876404:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987823360 00000100:00100000:3.0:1788890955.876462:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:3.0:1788890955.876470:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1875787987823360:12345-192.168.204.26@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788890955.876496:0:9362:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 1c240b24-a098-4d30-bfbf-dd53172bbf52@192.168.204.26@tcp t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:3.0:1788890955.876549:0:9362:0:(genops.c:1385:class_connect()) connect: client 1c240b24-a098-4d30-bfbf-dd53172bbf52, cookie 0xa66601b03fd52de5 00000004:00100000:3.0:1788890955.876581:0:9362:0:(mdt_handler.c:7304:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788890955.876716:0:9362:0:(import.c:65:import_set_state_nolock()) ffff924f83374800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788890955.877445:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:2390:x1875787987823360:12345-192.168.204.26@tcp:38:mount.lustre.0 Request processed in 971us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890955.877454:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:1.0:1788890955.877725:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890955.878318:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987823616 00000100:00100000:2.0:1788890955.878326:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987823616 00000100:00100000:2.0:1788890955.878412:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:2.0:1788890955.878419:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1875787987823616:12345-192.168.204.26@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788890955.878447:0:6495:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from 1c240b24-a098-4d30-bfbf-dd53172bbf52@192.168.204.26@tcp t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:2.0:1788890955.878495:0:6495:0:(genops.c:1385:class_connect()) connect: client 1c240b24-a098-4d30-bfbf-dd53172bbf52, cookie 0xa66601b03fd52dec 00000004:00100000:2.0:1788890955.878517:0:6495:0:(mdt_handler.c:7304:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788890955.878648:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00080000:2.0:1788890955.878707:0:6495:0:(import.c:65:import_set_state_nolock()) ffff924f832d9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788890955.878831:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:2390:x1875787987823616:12345-192.168.204.26@tcp:38:mount.lustre.0 Request processed in 409us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890955.878844:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:2.0:1788890955.879050:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987824128 00000100:00100000:0.0:1788890955.879217:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890955.879274:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987824000 00000100:00100000:3.0:1788890955.879280:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987824000 00000100:00100000:3.0:1788890955.879334:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 87 00000100:00100000:3.0:1788890955.879341:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:2392:x1875787987824000:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890955.879381:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:2392:x1875787987824000:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 41us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890955.879389:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 87 00000100:00080000:0.0:1788890955.879518:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788890955.879585:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987824128 00000100:00100000:2.0:1788890955.879829:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 88 00000100:00100000:2.0:1788890955.879844:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987824128:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788890955.879883:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987824128:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 47us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890955.879890:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 88 00000100:00080000:0.0:1788890955.880205:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788890955.884712:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890955.884754:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890955.884887:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890955.885328:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987823872 00000100:00100000:1.0:1788890955.885345:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987823872 00000100:00080000:0.0:1788890955.885433:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890955.885463:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987823488 00000100:00100000:3.0:1788890955.885468:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987823488 00000100:00100000:3.0:1788890955.885492:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987823744 00000100:00100000:3.0:1788890955.885495:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987823744 00000100:00100000:1.0:1788890955.885500:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:1.0:1788890955.885512:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+7:8701:x1875787987823872:12345-192.168.204.26@tcp:41:mount.lustre.0 00000100:00100000:3.0:1788890955.885515:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:3.0:1788890955.885573:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+7:0:x1875787987823488:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788890955.885591:0:9362:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000004:00000024:1.0:1788890955.885591:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00080000:0.0:1788890955.885629:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788890955.885721:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+7:8701:x1875787987823872:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 210us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890955.885737:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:1.0:1788890955.885758:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:1.0:1788890955.885765:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:0:x1875787987823744:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788890955.885784:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788890955.885821:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:0:x1875787987823744:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 56us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890955.885838:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:3.0:1788890955.886142:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:0:x1875787987823488:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 570us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890955.886150:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:0.0:1788890955.889604:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890955.889796:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987824256 00000100:00100000:2.0:1788890955.889814:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987824256 00000100:00100000:2.0:1788890955.889901:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:2.0:1788890955.889912:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:8701:x1875787987824256:12345-192.168.204.26@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788890955.890012:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:8701:x1875787987824256:12345-192.168.204.26@tcp:40:mount.lustre.0 Request processed in 101us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890955.890019:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:1.0:1788890955.893994:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890955.894038:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890955.894210:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987824384 00000100:00100000:0.0:1788890955.894221:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987824384 00000100:00100000:0.0:1788890955.894272:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987824512 00000100:00100000:0.0:1788890955.894276:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987824512 00000100:00100000:0.0:1788890955.894307:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:0.0:1788890955.894315:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1875787987824384:12345-192.168.204.26@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788890955.894350:0:8596:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 1c240b24-a098-4d30-bfbf-dd53172bbf52@192.168.204.26@tcp t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:0.0:1788890955.894391:0:8596:0:(genops.c:1385:class_connect()) connect: client 1c240b24-a098-4d30-bfbf-dd53172bbf52, cookie 0xa66601b03fd52df3 00002000:00100000:0.0:1788890955.894403:0:8596:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1c240b24-a098-4d30-bfbf-dd53172bbf52/ffff924f82216800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788890955.894415:0:8596:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788890955.894476:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:2.0:1788890955.894482:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2390:x1875787987824512:12345-192.168.204.26@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788890955.894500:0:8410:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 1c240b24-a098-4d30-bfbf-dd53172bbf52@192.168.204.26@tcp t0 exp 0000000000000000 cur 178 last 0 00002000:00080000:0.0:1788890955.894507:0:8596:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000020:00000080:2.0:1788890955.894516:0:8410:0:(genops.c:1385:class_connect()) connect: client 1c240b24-a098-4d30-bfbf-dd53172bbf52, cookie 0xa66601b03fd52dfa 00002000:00100000:2.0:1788890955.894545:0:8410:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1c240b24-a098-4d30-bfbf-dd53172bbf52/ffff924f832d8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788890955.894565:0:8410:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788890955.894607:0:8410:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788890955.894764:0:8596:0:(import.c:65:import_set_state_nolock()) ffff924f82215000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788890955.896121:0:8410:0:(import.c:65:import_set_state_nolock()) ffff924f832dc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788890955.896186:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:2390:x1875787987824512:12345-192.168.204.26@tcp:8:mount.lustre.0 Request processed in 1700us (2145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890955.896195:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:1.0:1788890955.897041:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890955.897144:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987824640 00000100:00100000:3.0:1788890955.897152:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987824640 00000100:00100000:3.0:1788890955.897252:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:3.0:1788890955.897262:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:8701:x1875787987824640:12345-192.168.204.26@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788890955.897327:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:8701:x1875787987824640:12345-192.168.204.26@tcp:900:mount.lustre.0 Request processed in 66us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890955.897334:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:0.0:1788890955.898515:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:2390:x1875787987824384:12345-192.168.204.26@tcp:8:mount.lustre.0 Request processed in 4194us (4525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890955.898539:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:1.0:1788890955.899299:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890955.899347:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987824768 00000100:00100000:0.0:1788890955.899355:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987824768 00000100:00100000:0.0:1788890955.899392:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:0.0:1788890955.899400:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:8701:x1875787987824768:12345-192.168.204.26@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788890955.899485:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788890955.899635:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:8701:x1875787987824768:12345-192.168.204.26@tcp:33:mount.lustre.0 Request processed in 234us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890955.899642:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:0.0:1788890956.411848:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788890956.411896:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997326080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788890956.412067:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890956.412131:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997326080 00000100:00100000:1.0:1788890956.412144:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997326080 00000100:00100000:1.0:1788890956.414725:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788890956.414737:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997326080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788890956.414763:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788890956.414828:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997326080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (2763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890956.414833:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788890956.414957:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997326080:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788890956.736623:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890956.944726:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890956.944771:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890956.944794:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987824896 00000100:00100000:1.0:1788890956.944805:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987824896 00000100:00100000:1.0:1788890956.944860:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 292 00000100:00100000:1.0:1788890956.944869:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2391:x1875787987824896:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890956.944949:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2391:x1875787987824896:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 80us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890956.944956:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987825024 00000100:00100000:0.0:1788890956.944962:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987825024 00000100:00100000:0.0:1788890956.944997:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 89 00000100:00100000:0.0:1788890956.945006:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+6:2391:x1875787987825024:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788890956.945044:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+6:2391:x1875787987825024:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 40us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890956.945051:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 89 00000100:00100000:1.0:1788890956.945207:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 292 00000100:00100000:3.0:1788890956.948356:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890956.948486:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890956.948542:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890956.948612:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987825536 00000100:00100000:1.0:1788890956.948625:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987825536 00000100:00100000:1.0:1788890956.948706:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00100000:1.0:1788890956.948719:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:2392:x1875787987825536:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890956.948815:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:2392:x1875787987825536:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 98us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890956.948824:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00080000:1.0:1788890956.948871:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890956.949230:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890956.949490:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987825280 00000100:00100000:0.0:1788890956.949496:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987825280 00000100:00100000:0.0:1788890956.949582:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987825152 00000100:00100000:0.0:1788890956.949586:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987825152 00000100:00100000:0.0:1788890956.949612:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 90 00000100:00100000:0.0:1788890956.949620:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:2392:x1875787987825280:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788890956.949672:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:2392:x1875787987825280:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 53us (2199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890956.949680:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 90 00000100:00100000:0.0:1788890956.949695:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 91 00000100:00100000:0.0:1788890956.949702:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987825152:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788890956.949725:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987825152:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 24us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890956.949732:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 91 00000100:00100000:3.0:1788890956.949983:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890956.950209:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987825408 00000100:00100000:0.0:1788890956.950214:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987825408 00000100:00100000:0.0:1788890956.950249:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 92 00000100:00100000:0.0:1788890956.950256:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:2392:x1875787987825408:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788890956.950289:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:2392:x1875787987825408:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 33us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890956.950296:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 92 00000100:00100000:2.0:1788890956.951922:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987825664 00000100:00100000:2.0:1788890956.951936:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987825664 00000100:00100000:2.0:1788890956.952005:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 46 00000100:00100000:2.0:1788890956.952013:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:2392:x1875787987825664:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788890956.952078:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:2392:x1875787987825664:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 66us (2096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890956.952086:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 46 00000100:00080000:0.0:1788890956.952237:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788890957.756648:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788890957.949610:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1c240b24-a098-4d30-bfbf-dd53172bbf52 00000001:00100000:3.0:1788890957.949627:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df03475d-d91a-4e91-8125-742ac4d4c589 00000020:00000080:3.0:1788890957.949631:0:9489:0:(genops.c:885:class_export_put()) final put ffff9250ba8f4800/df03475d-d91a-4e91-8125-742ac4d4c589 00000020:00000080:0.0:1788890957.949928:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9250ba8f4800/df03475d-d91a-4e91-8125-742ac4d4c589 for lustre-OST0001 00000020:00000080:0.0:1788890957.950001:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f82c18800 for lustre-OST0001 00000001:00100000:2.0:1788890957.950887:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1c240b24-a098-4d30-bfbf-dd53172bbf52 00000001:00100000:2.0:1788890957.950897:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df03475d-d91a-4e91-8125-742ac4d4c589 00000020:00000080:2.0:1788890957.950900:0:8404:0:(genops.c:885:class_export_put()) final put ffff924f83102000/df03475d-d91a-4e91-8125-742ac4d4c589 00000020:00000080:3.0:1788890957.950971:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f83102000/df03475d-d91a-4e91-8125-742ac4d4c589 for lustre-OST0000 00000020:00000080:3.0:1788890957.951099:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f83102800 for lustre-OST0000 00000100:00100000:2.0:1788890958.461281:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997326464:0@lo:400:kworker.0 00000100:00100000:1.0:1788890958.461337:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997326336:0@lo:400:kworker.0 00000100:00100000:0.0:1788890958.461732:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997326208:0@lo:400:kworker.0 00000100:00100000:0.0:1788890958.461790:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890958.461864:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997326720:0@lo:400:kworker.0 00000100:00100000:0.0:1788890958.461908:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890958.461938:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997327232:0@lo:400:kworker.0 00000100:00100000:0.0:1788890958.461973:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890958.461996:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997327744:0@lo:400:kworker.0 00000100:00100000:3.0:1788890958.462015:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997326208 00000100:00100000:0.0:1788890958.462022:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890958.462030:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997326208 00000100:00100000:3.0:1788890958.462132:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788890958.462141:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997326720 00000100:00100000:0.0:1788890958.462146:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997326720 00000100:00100000:0.0:1788890958.462196:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788890958.462207:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997326720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890958.462222:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3629:x1875787997326208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890958.462296:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997326720:12345-0@lo:400:kworker.0 Request processed in 91us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890958.462298:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3629:x1875787997326208:12345-0@lo:400:kworker.0 Request processed in 80us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890958.462317:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788890958.462317:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788890958.462358:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997327232 00000100:00100000:0.0:1788890958.462363:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997327232 00000100:00100000:0.0:1788890958.462410:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997327744 00000100:00100000:0.0:1788890958.462413:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997327744 00000100:00100000:0.0:1788890958.462441:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788890958.462449:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997327232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890958.462484:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997327232:12345-0@lo:400:kworker.0 Request processed in 36us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890958.462491:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788890958.462501:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788890958.462507:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997327744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890958.462620:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997327744:12345-0@lo:400:kworker.0 Request processed in 112us (597us total) trans 0 rc 0/0 00000100:00080000:3.0:1788890958.462653:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788890958.462659:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890958.463137:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875787997326592:0@lo:400:kworker.0 00000100:00100000:3.0:1788890958.463230:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890958.463262:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997327104:0@lo:400:kworker.0 00000100:00100000:3.0:1788890958.463285:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890958.463301:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997327616:0@lo:400:kworker.0 00000100:00100000:3.0:1788890958.463325:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890958.463365:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997327104 00000100:00100000:3.0:1788890958.463371:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997327104 00000100:00100000:1.0:1788890958.463486:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890958.463562:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1875787997326848:0@lo:400:kworker.0 00000100:00100000:1.0:1788890958.463616:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890958.463636:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1875787997327360:0@lo:400:kworker.0 00000100:00100000:0.0:1788890958.463805:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788890958.463842:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997327616 00000100:00100000:0.0:1788890958.463846:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997327616 00000100:00100000:1.0:1788890958.463870:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890958.463903:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788890958.463913:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997327616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890958.463946:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997326592 00000100:00100000:1.0:1788890958.463955:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997326592 00000100:00100000:0.0:1788890958.463987:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997327616:12345-0@lo:400:kworker.0 Request processed in 71us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890958.463996:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788890958.464002:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997326336 00000100:00100000:1.0:1788890958.464008:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997326336 00000100:00100000:0.0:1788890958.464033:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997326848 00000100:00100000:1.0:1788890958.464034:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997327360 00000100:00100000:1.0:1788890958.464045:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997327360 00000100:00100000:0.0:1788890958.464047:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997326848 00000100:00100000:1.0:1788890958.464079:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788890958.464091:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875787997326592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890958.464149:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875787997326592:12345-0@lo:400:kworker.0 Request processed in 61us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890958.464278:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788890958.464288:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997327104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890958.464335:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997327104:12345-0@lo:400:kworker.0 Request processed in 49us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890958.464343:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788890958.464361:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788890958.464367:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890958.464374:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997326336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890958.464418:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997326336:12345-0@lo:400:kworker.0 Request processed in 48us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890958.464428:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1788890958.464581:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788890958.464585:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890958.464622:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875787997326592:0@lo:400:kworker.0 00010000:00080000:3.0:1788890958.464637:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1c15500 x1875787997327104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890958.464662:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997327104:0@lo:400:kworker.0 00010000:00080000:3.0:1788890958.464673:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1c16680 x1875787997327616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890958.464681:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997327616:0@lo:400:kworker.0 00000100:00100000:2.0:1788890958.465787:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890958.465832:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997326976:0@lo:400:kworker.0 00000100:00100000:2.0:1788890958.465867:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890958.465880:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997327488:0@lo:400:kworker.0 00000100:00100000:2.0:1788890958.465901:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890958.465965:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997326464 00000100:00100000:2.0:1788890958.465971:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997326464 00000100:00100000:2.0:1788890958.466248:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788890958.466270:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997326464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890958.466328:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997326464:12345-0@lo:400:kworker.0 Request processed in 60us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890958.466336:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788890958.466359:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997326976 00000100:00100000:2.0:1788890958.466363:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997326976 00000100:00100000:0.0:1788890958.467066:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788890958.467106:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997327488 00000100:00100000:0.0:1788890958.467113:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997327488 00000100:00100000:0.0:1788890958.467149:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788890958.467159:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875787997327360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890958.467250:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875787997327360:12345-0@lo:400:kworker.0 Request processed in 93us (3383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890958.467257:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788890958.467271:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788890958.467278:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875787997326848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890958.467311:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875787997326848:12345-0@lo:400:kworker.0 Request processed in 34us (3694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890958.467317:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788890958.467330:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788890958.467349:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997327488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890958.467383:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997327488:12345-0@lo:400:kworker.0 Request processed in 35us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890958.467389:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788890958.467450:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997326208:0@lo:400:kworker.0 00000100:00100000:0.0:1788890958.467469:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997326720:0@lo:400:kworker.0 00010000:00080000:0.0:1788890958.467487:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1c17b80 x1875787997327232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890958.467498:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997327232:0@lo:400:kworker.0 00010000:00080000:0.0:1788890958.467511:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1c17480 x1875787997327744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890958.467520:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997327744:0@lo:400:kworker.0 00000100:00100000:0.0:1788890958.467641:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997326336:0@lo:400:kworker.0 00000100:00100000:0.0:1788890958.467657:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1875787997326848:0@lo:400:kworker.0 00000100:00100000:0.0:1788890958.467670:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1875787997327360:0@lo:400:kworker.0 00000100:00100000:0.0:1788890958.469566:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997326464:0@lo:400:kworker.0 00010000:00080000:0.0:1788890958.469591:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1c15180 x1875787997327488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890958.469602:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997327488:0@lo:400:kworker.0 00000100:00080000:1.0:1788890958.471569:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788890958.478344:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788890958.478391:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997326976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890958.478769:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997326976:12345-0@lo:400:kworker.0 Request processed in 407us (12899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890958.478779:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:2.0:1788890958.479253:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf739f80 x1875787997326976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890958.479273:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997326976:0@lo:400:kworker.0 00010000:00010000:3.0:1788890958.783005:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890958.972704:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997327872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788890958.973984:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890958.974171:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788890958.974199:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997328000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788890958.974266:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890958.974299:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997327872 00000100:00100000:1.0:1788890958.974306:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997327872 00000100:00100000:1.0:1788890958.974369:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997328000 00000100:00100000:1.0:1788890958.974372:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997328000 00000100:00100000:1.0:1788890958.974390:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788890958.974398:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997327872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788890958.974439:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788890958.974625:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788890958.974634:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997328000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788890958.974645:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788890958.974681:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997328000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890958.974688:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788890958.974727:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf6a4700 x1875787997328000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890958.974745:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997328000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788890958.976688:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997327872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2284us (2701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890958.976700:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788890958.976878:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bab60000 x1875787997327872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890958.976899:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997327872:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1788890959.137904:0:12164:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1788890959.803695:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890960.507695:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997328128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788890960.507784:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890960.507784:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997328256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788890960.507839:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890960.507884:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997328128 00000100:00100000:3.0:1788890960.507893:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997328128 00000100:00100000:0.0:1788890960.507896:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997328256 00000100:00100000:0.0:1788890960.507901:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997328256 00000100:00100000:0.0:1788890960.507953:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788890960.507962:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997328256:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788890960.507984:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788890960.507998:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788890960.508625:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997328256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 662us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890960.508635:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788890960.508697:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bab61c00 x1875787997328256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890960.508719:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997328256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788890960.508808:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788890960.508818:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997328384:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788890960.508855:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890960.508991:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788890960.509001:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997328128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788890960.509015:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788890960.509049:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997328128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890960.509055:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788890960.509112:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997328384 00000100:00100000:3.0:1788890960.509117:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997328384 00000100:00100000:3.0:1788890960.509185:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788890960.509193:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997328384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788890960.509217:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788890960.509275:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997328384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890960.509281:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:3.0:1788890960.509346:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1c16680 x1875787997328128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890960.509367:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997328128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788890960.509400:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997328384:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788890960.828018:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890961.531695:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8382df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997328512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788890961.531769:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890961.531839:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997328512 00000100:00100000:1.0:1788890961.531847:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997328512 00000100:00100000:1.0:1788890961.531887:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788890961.531895:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997328512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788890961.531923:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788890961.532007:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997328512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890961.532016:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788890961.532031:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8382df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997328512:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1788890961.538767:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1c240b24-a098-4d30-bfbf-dd53172bbf52 00000001:00100000:1.0:1788890961.539163:0:7425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1c240b24-a098-4d30-bfbf-dd53172bbf52 00010000:00010000:1.0:1788890961.854859:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890962.383754:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890962.383816:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890962.383822:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987825792 00000100:00100000:1.0:1788890962.383837:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987825792 00000100:00100000:3.0:1788890962.383862:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890962.383920:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890962.383921:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 294 00000100:00100000:1.0:1788890962.383950:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2392:x1875787987825792:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890962.383983:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987826048 00000100:00100000:3.0:1788890962.383993:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987826048 00000100:00100000:2.0:1788890962.384014:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987826560 00000100:00100000:1.0:1788890962.384057:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2392:x1875787987825792:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 113us (317us total) trans 0 rc 0/0 00000100:00080000:0.0:1788890962.384058:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788890962.384073:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 294 00000100:00100000:3.0:1788890962.384078:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987826304 00000100:00100000:3.0:1788890962.384084:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987826304 00000100:00100000:2.0:1788890962.384092:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987826560 00000100:00080000:0.0:1788890962.384136:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788890962.384138:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 99 00000100:00100000:3.0:1788890962.384158:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 100 00000100:00100000:0.0:1788890962.384228:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788890962.384239:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788890962.384461:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987826048:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890962.384514:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987826048:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 364us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890962.384517:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2392:x1875787987826304:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890962.384565:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 99 00000100:00100000:2.0:1788890962.385200:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:2.0:1788890962.385213:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2392:x1875787987826560:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788890962.385453:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2392:x1875787987826560:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 243us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890962.385469:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00080000:2.0:1788890962.385493:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788890962.386811:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2392:x1875787987826304:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 2633us (2941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890962.386827:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 100 00000100:00100000:1.0:1788890962.386842:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890962.386865:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987825920 00000100:00100000:3.0:1788890962.386875:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987825920 00000100:00100000:3.0:1788890962.386946:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 101 00000100:00100000:3.0:1788890962.386956:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+6:2391:x1875787987825920:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890962.386980:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890962.387019:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+6:2391:x1875787987825920:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 63us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890962.387042:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 101 00000100:00100000:3.0:1788890962.387058:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987826176 00000100:00100000:3.0:1788890962.387062:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987826176 00000100:00100000:1.0:1788890962.387148:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890962.387333:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987826432 00000100:00100000:0.0:1788890962.387340:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987826432 00000100:00100000:0.0:1788890962.387424:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:0.0:1788890962.387443:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2391:x1875787987826432:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788890962.387557:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2391:x1875787987826432:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 54us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890962.387566:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00080000:2.0:1788890962.388587:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788890962.388598:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890962.389430:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 102 00000100:00100000:3.0:1788890962.389445:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2391:x1875787987826176:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890962.389559:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2391:x1875787987826176:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 116us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890962.389567:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 102 00010000:00010000:1.0:1788890962.875878:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788890963.461246:0:12480:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788890963.461466:0:12480:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788890963.580082:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997328896:0@lo:400:kworker.0 00000100:00100000:2.0:1788890963.580103:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997329024:0@lo:400:kworker.0 00000100:00100000:1.0:1788890963.580170:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997328768:0@lo:400:kworker.0 00000100:00100000:0.0:1788890963.580191:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997328640:0@lo:400:kworker.0 00000100:00100000:2.0:1788890963.582946:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890963.583015:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997329536:0@lo:400:kworker.0 00000100:00100000:2.0:1788890963.583055:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890963.583082:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997330048:0@lo:400:kworker.0 00000100:00100000:2.0:1788890963.583121:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890963.583189:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890963.583224:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890963.583244:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997329280:0@lo:400:kworker.0 00000100:00100000:3.0:1788890963.583264:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1875787997329408:0@lo:400:kworker.0 00000100:00100000:1.0:1788890963.583284:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890963.583331:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997328896 00000100:00100000:3.0:1788890963.583340:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997328896 00000100:00100000:3.0:1788890963.583386:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788890963.583395:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997328896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890963.583447:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890963.583474:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997329152:0@lo:400:kworker.0 00000100:00100000:0.0:1788890963.583494:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890963.583508:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997329664:0@lo:400:kworker.0 00000100:00100000:0.0:1788890963.583537:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890963.583552:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997330176:0@lo:400:kworker.0 00000100:00100000:0.0:1788890963.583568:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890963.583954:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997329024 00000100:00100000:0.0:1788890963.583959:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997329024 00000100:00100000:2.0:1788890963.583965:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997328768 00000100:00100000:2.0:1788890963.583971:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997328768 00000100:00100000:0.0:1788890963.583992:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997329280 00000100:00100000:0.0:1788890963.583996:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997329280 00000100:00100000:2.0:1788890963.584009:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788890963.584020:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997329024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890963.584028:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788890963.584038:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997328768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890963.584072:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997329024:12345-0@lo:400:kworker.0 Request processed in 54us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890963.584082:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788890963.584096:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997328768:12345-0@lo:400:kworker.0 Request processed in 50us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890963.584105:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788890963.584116:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788890963.584126:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997329280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890963.584141:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997328640 00000100:00100000:0.0:1788890963.584146:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997328640 00000100:00100000:2.0:1788890963.584164:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997329280:12345-0@lo:400:kworker.0 Request processed in 38us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890963.584171:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788890963.584180:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788890963.584188:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3628:x1875787997328640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890963.584196:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997329536 00000100:00100000:2.0:1788890963.584202:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997329536 00000100:00100000:2.0:1788890963.584239:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997330048 00000100:00100000:2.0:1788890963.584243:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997330048 00000100:00100000:0.0:1788890963.584245:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3628:x1875787997328640:12345-0@lo:400:kworker.0 Request processed in 58us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890963.584253:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788890963.584274:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997329664 00000100:00100000:2.0:1788890963.584279:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997329664 00000100:00100000:0.0:1788890963.584287:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997329152 00000100:00100000:0.0:1788890963.584292:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997329152 00000100:00100000:2.0:1788890963.584301:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997330176 00000100:00100000:2.0:1788890963.584306:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997330176 00000100:00100000:1.0:1788890963.584316:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997329280:0@lo:400:kworker.0 00000100:00100000:0.0:1788890963.584317:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788890963.584329:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997329792:0@lo:400:kworker.0 00000100:00100000:0.0:1788890963.584331:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997329152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890963.584334:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788890963.584349:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997329536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890963.584372:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890963.584382:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997329152:12345-0@lo:400:kworker.0 Request processed in 55us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890963.584389:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788890963.584413:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997329536:12345-0@lo:400:kworker.0 Request processed in 67us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890963.584418:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788890963.584426:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997328768:0@lo:400:kworker.0 00000100:00100000:2.0:1788890963.584427:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788890963.584433:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997330048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890963.584458:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997329792 00000100:00100000:1.0:1788890963.584463:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997329792 00000100:00100000:0.0:1788890963.584474:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997330048:12345-0@lo:400:kworker.0 Request processed in 45us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890963.584492:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788890963.584500:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997329792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890963.584546:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997328896:12345-0@lo:400:kworker.0 Request processed in 1151us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890963.584553:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788890963.584567:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997329792:12345-0@lo:400:kworker.0 Request processed in 67us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890963.584576:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788890963.584581:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890963.584594:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997329408 00000100:00100000:1.0:1788890963.584599:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997329408 00000100:00100000:3.0:1788890963.584604:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997329920:0@lo:400:kworker.0 00000100:00100000:1.0:1788890963.584619:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788890963.584628:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875787997329408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890963.584634:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890963.584662:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875787997329408:12345-0@lo:400:kworker.0 Request processed in 36us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890963.584669:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788890963.584677:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997329920 00000100:00100000:1.0:1788890963.584680:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997329920 00000100:00100000:1.0:1788890963.584694:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788890963.584700:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875787997329920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890963.584730:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997328896:0@lo:400:kworker.0 00000100:00100000:1.0:1788890963.584733:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875787997329920:12345-0@lo:400:kworker.0 Request processed in 32us (99us total) trans 0 rc 0/0 00010000:00080000:3.0:1788890963.584746:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1c15180 x1875787997329408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890963.584769:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1875787997329408:0@lo:400:kworker.0 00010000:00080000:3.0:1788890963.584782:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf739f80 x1875787997329920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890963.584790:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997329920:0@lo:400:kworker.0 00000100:00100000:1.0:1788890963.584808:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788890963.584843:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997329792:0@lo:400:kworker.0 00000100:00100000:1.0:1788890963.584910:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997328640:0@lo:400:kworker.0 00000100:00100000:1.0:1788890963.584920:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997329152:0@lo:400:kworker.0 00000100:00100000:2.0:1788890963.584959:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788890963.584967:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788890963.584971:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997329664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890963.584990:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788890963.584999:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997330176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890963.585030:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997329664:12345-0@lo:400:kworker.0 Request processed in 62us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890963.585038:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788890963.585041:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997330176:12345-0@lo:400:kworker.0 Request processed in 42us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890963.585050:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788890963.585072:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788890963.585078:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788890963.585081:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788890963.585083:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788890963.585123:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997329024:0@lo:400:kworker.0 00010000:00080000:2.0:1788890963.585135:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1c16a00 x1875787997329536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890963.585144:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997329536:0@lo:400:kworker.0 00010000:00080000:2.0:1788890963.585154:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf73b800 x1875787997330048/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890963.585162:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997330048:0@lo:400:kworker.0 00010000:00080000:1.0:1788890963.585574:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1c17480 x1875787997329664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890963.585584:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997329664:0@lo:400:kworker.0 00010000:00080000:1.0:1788890963.585598:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf73b100 x1875787997330176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890963.585605:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997330176:0@lo:400:kworker.0 00010000:00010000:0.0:1788890963.902633:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890964.091718:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997330304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788890964.091786:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890964.091913:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997330304 00000100:00100000:1.0:1788890964.091922:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997330304 00000100:00100000:1.0:1788890964.092100:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788890964.092111:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997330304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788890964.092140:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788890964.092190:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997330304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890964.092197:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788890964.093781:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bab60000 x1875787997330304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890964.093804:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997330304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788890964.094286:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997330432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788890964.094342:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890964.094483:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997330432 00000100:00100000:2.0:1788890964.094496:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997330432 00000100:00100000:2.0:1788890964.094560:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788890964.094568:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997330432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788890964.094585:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788890964.094628:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997330432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890964.094635:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1788890964.094665:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bab60000 x1875787997330432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890964.094677:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997330432:0@lo:13:osp-pre-1-1.0 00000020:00000004:1.0:1788890964.667103:0:12577:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788890964.667472:0:12577:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788890964.924292:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890965.628378:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997330560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788890965.628448:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890965.628689:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997330688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788890965.628723:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890965.628778:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788890965.628789:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997330816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788890965.628835:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997330560 00000100:00100000:2.0:1788890965.628844:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997330560 00000100:00100000:2.0:1788890965.628999:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788890965.629011:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997330560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788890965.629044:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788890965.629116:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997330560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890965.629123:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890965.629126:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788890965.629175:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997330688 00000100:00100000:3.0:1788890965.629180:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997330688 00000100:00100000:3.0:1788890965.629366:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997330816 00000100:00100000:3.0:1788890965.629370:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997330816 00000100:00100000:3.0:1788890965.629386:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788890965.629393:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997330688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788890965.629412:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788890965.629784:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997330688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 389us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890965.629793:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788890965.629801:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788890965.629816:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997330816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788890965.629828:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788890965.629847:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788890965.629866:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997330816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890965.629873:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788890965.632171:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82e51880 x1875787997330688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890965.632203:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997330688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788890965.632371:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997330560:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1788890965.632404:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf73b800 x1875787997330816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890965.632419:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997330816:0@lo:13:osp-pre-0-0.0 00000020:00000004:1.0:1788890965.821222:0:12675:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788890965.821475:0:12675:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788890965.950236:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890966.651986:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788890966.652010:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8382ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997330944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788890966.652095:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890966.652171:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997330944 00000100:00100000:0.0:1788890966.652179:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997330944 00000100:00100000:0.0:1788890966.652236:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788890966.652247:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997330944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788890966.652290:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788890966.652338:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997330944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890966.652346:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788890966.652556:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8382ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997330944:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788890966.972045:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788890966.980049:0:12772:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788890966.980263:0:12772:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788890967.503625:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890967.503671:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890967.503711:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987826944 00000100:00100000:2.0:1788890967.503721:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987826944 00000100:00080000:1.0:1788890967.503774:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788890967.503800:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987826688 00000100:00100000:2.0:1788890967.503800:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 109 00000100:00100000:3.0:1788890967.503807:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987826688 00000100:00100000:2.0:1788890967.503815:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2394:x1875787987826944:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890967.503848:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 296 00000100:00100000:3.0:1788890967.503858:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2394:x1875787987826688:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788890967.503899:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2394:x1875787987826944:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 87us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890967.503919:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 109 00000100:00100000:3.0:1788890967.506938:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2394:x1875787987826688:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 3070us (3310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890967.506954:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 296 00000100:00100000:0.0:1788890967.507137:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890967.507180:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890967.507181:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987827200 00000100:00100000:1.0:1788890967.507191:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987827200 00000100:00100000:0.0:1788890967.507212:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890967.507242:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890967.507269:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890967.507294:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987827456 00000100:00100000:0.0:1788890967.507298:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987827456 00000100:00100000:0.0:1788890967.507337:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987827328 00000100:00100000:0.0:1788890967.507340:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987827328 00000100:00100000:0.0:1788890967.507376:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 57 00000100:00100000:0.0:1788890967.507386:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987827456:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788890967.507448:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987827456:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 64us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890967.507455:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 57 00000100:00100000:0.0:1788890967.507474:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 58 00000100:00100000:0.0:1788890967.507482:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987827328:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890967.508559:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987826816 00000100:00100000:1.0:1788890967.508566:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987826816 00000100:00100000:1.0:1788890967.508602:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987827072 00000100:00100000:1.0:1788890967.508605:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987827072 00000100:00100000:1.0:1788890967.508625:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 110 00000100:00100000:1.0:1788890967.508633:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987827200:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890967.508685:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987827200:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 53us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890967.508693:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 110 00000100:00100000:1.0:1788890967.508709:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 111 00000100:00100000:1.0:1788890967.508715:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+6:2394:x1875787987826816:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890967.508739:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+6:2394:x1875787987826816:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 24us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890967.508744:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 111 00000100:00100000:1.0:1788890967.508756:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 112 00000100:00100000:1.0:1788890967.508762:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987827072:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890967.508783:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987827072:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 22us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890967.508788:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 112 00000100:00080000:1.0:1788890967.508809:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788890967.508813:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788890967.508816:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788890967.508818:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788890967.509392:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987827328:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 40us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890967.509409:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 58 00010000:00010000:1.0:1788890967.995780:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788890968.052271:0:12870:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788890968.052483:0:12870:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788890968.699903:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997331328:0@lo:400:kworker.0 00000100:00100000:1.0:1788890968.699977:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890968.700020:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997331200:0@lo:400:kworker.0 00000100:00100000:1.0:1788890968.700041:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997331840:0@lo:400:kworker.0 00000100:00100000:2.0:1788890968.700055:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890968.700064:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997331456:0@lo:400:kworker.0 00000100:00100000:2.0:1788890968.700076:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997331712:0@lo:400:kworker.0 00000100:00100000:1.0:1788890968.700087:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890968.700108:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997331200 00000100:00100000:2.0:1788890968.700116:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997331200 00000100:00100000:1.0:1788890968.700116:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997331968:0@lo:400:kworker.0 00000100:00100000:1.0:1788890968.700139:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890968.700156:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997331456 00000100:00100000:2.0:1788890968.700158:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997331456 00000100:00100000:1.0:1788890968.700159:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997332480:0@lo:400:kworker.0 00000100:00100000:1.0:1788890968.700178:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890968.700180:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788890968.700188:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997331200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890968.700209:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997331328 00000100:00100000:1.0:1788890968.700212:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997331328 00000100:00100000:2.0:1788890968.700235:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997331200:12345-0@lo:400:kworker.0 Request processed in 46us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890968.700242:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788890968.700252:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788890968.700255:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788890968.700258:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997331328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890968.700260:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997331456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890968.700291:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997331456:12345-0@lo:400:kworker.0 Request processed in 29us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890968.700291:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997331328:12345-0@lo:400:kworker.0 Request processed in 32us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890968.700298:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788890968.700298:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788890968.700333:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997331968 00000100:00100000:1.0:1788890968.700337:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997331968 00000100:00100000:3.0:1788890968.700357:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997331072:0@lo:400:kworker.0 00000100:00100000:1.0:1788890968.700378:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997332480 00000100:00100000:1.0:1788890968.700381:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997332480 00000100:00100000:3.0:1788890968.700392:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890968.700406:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788890968.700413:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997331968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890968.700414:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997331584:0@lo:400:kworker.0 00000100:00100000:3.0:1788890968.700435:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890968.700440:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997331968:12345-0@lo:400:kworker.0 Request processed in 28us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890968.700446:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788890968.700451:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997332096:0@lo:400:kworker.0 00000100:00100000:1.0:1788890968.700457:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788890968.700462:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997332480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890968.700470:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890968.700486:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997332608:0@lo:400:kworker.0 00000100:00100000:1.0:1788890968.700486:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997332480:12345-0@lo:400:kworker.0 Request processed in 23us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890968.700492:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788890968.700501:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997332096 00000100:00100000:3.0:1788890968.700503:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890968.700504:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997332096 00000100:00100000:3.0:1788890968.700546:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997331584 00000100:00100000:3.0:1788890968.700550:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997331584 00000100:00100000:1.0:1788890968.700552:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997332608 00000100:00100000:1.0:1788890968.700555:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997332608 00000100:00100000:1.0:1788890968.700568:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788890968.700571:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788890968.700573:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83890700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997332096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890968.700577:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997331584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890968.700606:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83890700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997332096:12345-0@lo:400:kworker.0 Request processed in 33us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890968.700612:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788890968.700638:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788890968.700643:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788890968.700760:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788890968.700767:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997332608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890968.701473:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997331584:12345-0@lo:400:kworker.0 Request processed in 892us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890968.701491:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788890968.701735:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997332608:12345-0@lo:400:kworker.0 Request processed in 967us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890968.701744:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788890968.701791:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997331072 00000100:00100000:1.0:1788890968.701798:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997331072 00000100:00100000:1.0:1788890968.701848:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788890968.701855:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3627:x1875787997331072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890968.701905:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3627:x1875787997331072:12345-0@lo:400:kworker.0 Request processed in 50us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890968.701912:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788890968.701946:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890968.702082:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1875787997332224:0@lo:400:kworker.0 00000100:00100000:1.0:1788890968.702110:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890968.702249:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997331200:0@lo:400:kworker.0 00000100:00100000:1.0:1788890968.702293:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997331456:0@lo:400:kworker.0 00010000:00080000:1.0:1788890968.702309:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1c14700 x1875787997331968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890968.702332:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997331968:0@lo:400:kworker.0 00010000:00080000:1.0:1788890968.702347:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f833d2d80 x1875787997332480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890968.702356:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997332480:0@lo:400:kworker.0 00000100:00100000:1.0:1788890968.702385:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890968.702499:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997331712 00000100:00100000:2.0:1788890968.702505:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997331712 00000100:00100000:2.0:1788890968.702565:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997332224 00000100:00100000:2.0:1788890968.702569:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997332224 00000100:00100000:2.0:1788890968.702596:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788890968.702603:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875787997331712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890968.702657:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875787997331712:12345-0@lo:400:kworker.0 Request processed in 55us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890968.702663:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788890968.702679:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788890968.702686:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875787997332224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890968.702713:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875787997332224:12345-0@lo:400:kworker.0 Request processed in 29us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890968.702719:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1788890968.702741:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788890968.702761:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997331712:0@lo:400:kworker.0 00000100:00100000:2.0:1788890968.702771:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1875787997332224:0@lo:400:kworker.0 00000100:00100000:1.0:1788890968.702967:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997332352:0@lo:400:kworker.0 00000100:00100000:1.0:1788890968.703012:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890968.703134:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997331328:0@lo:400:kworker.0 00000100:00100000:1.0:1788890968.703158:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997331072:0@lo:400:kworker.0 00000100:00100000:1.0:1788890968.703170:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997331584:0@lo:400:kworker.0 00010000:00080000:1.0:1788890968.703182:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf73b800 x1875787997332096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890968.703191:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997332096:0@lo:400:kworker.0 00010000:00080000:1.0:1788890968.703203:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f833d3800 x1875787997332608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890968.703211:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997332608:0@lo:400:kworker.0 00000100:00100000:3.0:1788890968.703407:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997331840 00000100:00100000:3.0:1788890968.703412:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997331840 00000100:00100000:3.0:1788890968.703453:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997332352 00000100:00100000:3.0:1788890968.703456:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997332352 00000100:00100000:3.0:1788890968.703480:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788890968.703488:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997331840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890968.703560:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997331840:12345-0@lo:400:kworker.0 Request processed in 73us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890968.703567:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788890968.703579:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788890968.703585:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997332352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890968.703612:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997332352:12345-0@lo:400:kworker.0 Request processed in 28us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890968.703618:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:3.0:1788890968.703657:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1c14000 x1875787997331840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890968.703668:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997331840:0@lo:400:kworker.0 00010000:00080000:3.0:1788890968.703680:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f833d3480 x1875787997332352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890968.703688:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997332352:0@lo:400:kworker.0 00000100:00080000:1.0:1788890968.703759:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788890969.020081:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890969.212383:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997332736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788890969.212461:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890969.212711:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997332736 00000100:00100000:3.0:1788890969.212720:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997332736 00000100:00100000:3.0:1788890969.212813:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788890969.212837:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997332736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788890969.212873:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788890969.212937:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997332736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890969.212944:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788890969.213059:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82e51880 x1875787997332736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890969.213080:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997332736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788890969.213365:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788890969.213376:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997332864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788890969.213416:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890969.214786:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997332864 00000100:00100000:3.0:1788890969.214797:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997332864 00000100:00100000:3.0:1788890969.214848:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788890969.214857:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997332864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788890969.214880:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788890969.215024:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997332864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890969.215032:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788890969.215234:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82ff7800 x1875787997332864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890969.215257:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997332864:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788890970.044181:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788890970.087355:0:13014:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788890970.747843:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788890970.747876:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997332992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788890970.747985:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890970.748030:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997332992 00000100:00100000:0.0:1788890970.748041:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997332992 00000100:00100000:0.0:1788890970.748119:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788890970.748131:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997332992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788890970.748168:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788890970.748223:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997332992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890970.748230:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788890970.748252:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788890970.748343:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83893b80 x1875787997332992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890970.748369:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997332992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788890970.748561:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788890970.748575:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8382c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997333120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788890970.748618:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890970.748659:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997333248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788890970.748687:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997333120 00000100:00100000:0.0:1788890970.748700:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890970.748744:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997333248 00000100:00100000:0.0:1788890970.748749:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997333248 00000100:00100000:0.0:1788890970.748789:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788890970.748799:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997333248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788890970.748832:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788890970.748873:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997333248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890970.748879:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788890970.748910:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997333248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788890970.749236:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997333120 00000100:00100000:1.0:1788890970.749324:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788890970.749335:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997333120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788890970.749360:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788890970.749452:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997333120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890970.749460:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788890970.749510:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788890970.749675:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f8382c380 x1875787997333120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890970.749767:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8382c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997333120:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788890971.069263:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890971.771959:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788890971.771990:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8382c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997333376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788890971.772079:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890971.772562:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997333376 00000100:00100000:2.0:1788890971.772571:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997333376 00000100:00100000:2.0:1788890971.772623:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788890971.772633:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997333376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788890971.772668:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788890971.772726:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997333376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890971.772734:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788890971.773066:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8382c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997333376:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788890972.093560:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788890972.164845:0:13161:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd478bc830 20000000:00000080:1.0:1788890972.164864:0:13161:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9250ba9c3c00 uarg=0000000000000000 20000000:01000000:1.0:1788890972.164910:0:13161:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788890972.164928:0:13161:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788890972.164934:0:13161:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788890972.166085:0:13162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788890972.166360:0:13161:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788890972.174314:0:13161:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788890972.174348:0:13161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52e01 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.174368:0:13161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250b69c6400/0xa66601b03fd52d13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd10 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.174395:0:13161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250813ec600/0xa66601b03fd52d3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52d36 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.174402:0:13161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250baae4400/0xa66601b03fd52d67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52d60 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.174409:0:13161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52d91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52d8a expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.174416:0:13161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250b69c6600/0xa66601b03fd52dbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52db4 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.174423:0:13161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff924f82310000/0xa66601b03fd52dde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd4f expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.174430:0:13161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52e01 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.174473:0:13161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff924f82310000/0xa66601b03fd52dde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd4f expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.174487:0:13161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff924f82310000/0xa66601b03fd52dde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd4f expref: 12 pid: 6491 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890972.174503:0:13161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875787997333504:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788890972.176320:0:13161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250b69c6600/0xa66601b03fd52dbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52db4 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.176338:0:13161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250b69c6600/0xa66601b03fd52dbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52db4 expref: 23 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890972.176359:0:13161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875787997333632:0@lo:104: 00000100:00100000:1.0:1788890972.176403:0:13161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788890972.176435:0:13161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52d91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52d8a expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.176444:0:13161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52d91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52d8a expref: 23 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890972.176447:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997333632 00000100:00100000:1.0:1788890972.176455:0:13161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875787997333760:0@lo:104: 00000100:00100000:2.0:1788890972.176464:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997333632 00000100:00100000:1.0:1788890972.176478:0:13161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788890972.176504:0:13161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250baae4400/0xa66601b03fd52d67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52d60 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.176513:0:13161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250baae4400/0xa66601b03fd52d67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52d60 expref: 23 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890972.176543:0:13161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875787997333888:0@lo:104: 00000100:00100000:2.0:1788890972.176548:0:10313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997333760 00000100:00100000:2.0:1788890972.176554:0:10313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997333760 00000100:00100000:0.0:1788890972.176565:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788890972.176571:0:13161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890972.176579:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:13161:x1875787997333632:12345-0@lo:104: 00010000:00010000:0.0:1788890972.176593:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52db4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52dbb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890972.176635:0:10313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788890972.176646:0:10313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:13161:x1875787997333760:12345-0@lo:104: 00010000:00010000:0.0:1788890972.176652:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1788890972.176658:0:10313:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52d8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52d91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890972.176660:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:13161:x1875787997333632:12345-0@lo:104: Request processed in 85us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890972.176687:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1788890972.176708:0:10313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1788890972.176714:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1788890972.176716:0:10313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:13161:x1875787997333760:12345-0@lo:104: Request processed in 72us (237us total) trans 0 rc 0/0 00010000:00010000:0.0:1788890972.176722:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52db4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52dbb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890972.176727:0:10313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1788890972.176736:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4800 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:0.0:1788890972.176741:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52db4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52dbb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.176751:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52db4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52dbb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890972.176759:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52db4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52dbb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890972.176765:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788890972.176797:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52db4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52dbb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.176804:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890972.176834:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52db4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52dbb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.176841:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52db4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52dbb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890972.176842:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997334016:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788890972.176860:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788890972.176864:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52d8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52d91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.176869:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4a00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:0.0:1788890972.176873:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52d8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52d91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890972.176878:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788890972.176894:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52d8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52d91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890972.176901:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52d8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52d91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890972.176906:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788890972.176937:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52d8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52d91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.176943:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890972.176963:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52d8a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52d91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890972.176967:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997334144:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788890972.176980:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52d8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52d91 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.176990:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890972.176995:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788890972.177000:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890972.177003:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890972.177024:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997334016 00000100:00100000:0.0:1788890972.177029:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997334016 00010000:00010000:0.0:1788890972.177047:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250b69c6600/0xa66601b03fd52dbb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52db4 expref: 24 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890972.177069:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997334144 00000100:00100000:0.0:1788890972.177072:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997334144 00010000:00010000:0.0:1788890972.177092:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52d91 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52d8a expref: 25 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890972.177117:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788890972.177123:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+25:3630:x1875787997334016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788890972.177137:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890972.177142:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250b69c6600/0xa66601b03fd52dbb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52db4 expref: 25 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.177152:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250b69c6600/0xa66601b03fd52dbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52db4 expref: 25 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890972.177161:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1788890972.177168:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890972.177173:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+25:3627:x1875787997334144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788890972.177185:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890972.177191:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52d91 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52d8a expref: 25 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890972.177203:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+25:3630:x1875787997334016:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (324us total) trans 0 rc 0/0 00010000:00010000:2.0:1788890972.177204:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52d91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52d8a expref: 25 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890972.177217:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1788890972.177225:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890972.177255:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997334016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788890972.177290:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997333888 00000100:00100000:0.0:1788890972.177293:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997333888 00000100:00100000:0.0:1788890972.177313:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788890972.177318:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:13161:x1875787997333888:12345-0@lo:104: 00010000:00010000:0.0:1788890972.177331:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd52d60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52d67 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890972.177370:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3627:x1875787997334144:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890972.177387:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1788890972.177405:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890972.177421:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997334144:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788890972.177579:0:13161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250813ec600/0xa66601b03fd52d3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52d36 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.177589:0:13161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250813ec600/0xa66601b03fd52d3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52d36 expref: 23 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890972.177597:0:13161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875787997334272:0@lo:104: 00000100:00100000:1.0:1788890972.177622:0:13161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788890972.177680:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788890972.177688:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:13161:x1875787997333888:12345-0@lo:104: Request processed in 368us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890972.177699:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1788890972.177700:0:13161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250b69c6400/0xa66601b03fd52d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd10 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890972.177702:0:10315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788890972.177710:0:10315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd52d60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52d67 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890972.177714:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997334272 00000100:00100000:0.0:1788890972.177721:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997334272 00010000:00010000:2.0:1788890972.177730:0:10315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ede00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788890972.177736:0:10315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd52d60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52d67 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.177737:0:13161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250b69c6400/0xa66601b03fd52d13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd10 expref: 12 pid: 6488 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890972.177752:0:10315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd52d60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52d67 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890972.177765:0:10315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd52d60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52d67 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890972.177765:0:13161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c14000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875787997334400:192.168.204.26@tcp:104: 10000000:01000000:2.0:1788890972.177777:0:10315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788890972.177801:0:10315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd52d60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52d67 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890972.177807:0:10315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788890972.177816:0:13161:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83284780 going to sleep for 11 seconds 00010000:00010000:2.0:1788890972.177826:0:10315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd52d60 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52d67 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.177834:0:13161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c6600/0xa66601b03fd52dbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52db4 expref: 23 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890972.177837:0:10315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd52d60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52d67 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890972.177858:0:13161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875787997333632:0@lo:104: 00010000:00010000:2.0:1788890972.177859:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890972.177863:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890972.177871:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890972.177873:0:13161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52d91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52d8a expref: 22 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890972.177884:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788890972.177885:0:13161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875787997333760:0@lo:104: 00000100:00100000:2.0:1788890972.177897:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997334528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788890972.177899:0:13161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875787997333888:0@lo:104: 00000100:00100000:2.0:1788890972.177944:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890972.177971:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788890972.177982:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:13161:x1875787997334272:12345-0@lo:104: 00010000:00010000:3.0:1788890972.177992:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd52d36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52d3d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890972.178061:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997334528 00000100:00100000:1.0:1788890972.178066:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997334528 00010000:00010000:1.0:1788890972.178092:0:10317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250baae4400/0xa66601b03fd52d67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52d60 expref: 22 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890972.178122:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788890972.178131:0:13161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875787997334272:0@lo:104: 00000100:00100000:1.0:1788890972.178132:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:3627:x1875787997334528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788890972.178135:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788890972.178143:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:13161:x1875787997334272:12345-0@lo:104: Request processed in 164us (520us total) trans 0 rc 0/0 00010000:00010000:1.0:1788890972.178145:0:10317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788890972.178150:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1788890972.178151:0:10317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250baae4400/0xa66601b03fd52d67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52d60 expref: 22 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.178159:0:10317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250baae4400/0xa66601b03fd52d67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52d60 expref: 22 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890972.178168:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788890972.178181:0:10317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae4400/0xa66601b03fd52d67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52d60 expref: 22 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.178191:0:10317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890972.178223:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:3627:x1875787997334528:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890972.178230:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788890972.178237:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997334528:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788890972.178344:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd52d36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52d3d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890972.178353:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310400 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:3.0:1788890972.178357:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd52d36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52d3d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890972.178364:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd52d36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52d3d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788890972.178371:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd52d36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52d3d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890972.178376:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788890972.178401:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd52d36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52d3d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890972.178407:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788890972.178431:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd52d36 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52d3d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890972.178439:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd52d36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52d3d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890972.178440:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788890972.178452:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997334656:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788890972.178474:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890972.178477:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890972.178479:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890972.178487:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890972.178557:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997334656 00000100:00100000:1.0:1788890972.178562:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997334656 00010000:00010000:1.0:1788890972.178578:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250813ec600/0xa66601b03fd52d3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52d36 expref: 21 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890972.178603:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788890972.178609:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:3630:x1875787997334656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788890972.178617:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890972.178622:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250813ec600/0xa66601b03fd52d3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52d36 expref: 21 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.178632:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250813ec600/0xa66601b03fd52d3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52d36 expref: 21 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.178642:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813ec600/0xa66601b03fd52d3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52d36 expref: 21 pid: 6488 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890972.178651:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890972.178681:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:3630:x1875787997334656:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890972.178688:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788890972.178712:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997334656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788890972.179966:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890972.180061:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987827584 00000100:00100000:0.0:1788890972.180067:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987827584 00010000:00010000:0.0:1788890972.180093:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff924f82310000/0xa66601b03fd52dde lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd4f expref: 13 pid: 6491 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890972.180127:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 44 00000100:00100000:0.0:1788890972.180135:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2393:x1875787987827584:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890972.180145:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890972.180161:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff924f82310000/0xa66601b03fd52dde lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd4f expref: 13 pid: 6491 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.180172:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff924f82310000/0xa66601b03fd52dde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd4f expref: 13 pid: 6491 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.180186:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890972.180232:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2393:x1875787987827584:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 98us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890972.180240:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 44 00010000:00010000:2.0:1788890972.180436:0:13161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924f82310000/0xa66601b03fd52dde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd4f expref: 12 pid: 6491 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890972.180455:0:13161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875787997333504:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788890972.181147:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890972.181166:0:13161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c14000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875787997334400:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788890972.181202:0:13161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52e01 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890972.181252:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987827712 00000100:00100000:0.0:1788890972.181256:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987827712 00010000:00010000:0.0:1788890972.181279:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250b69c6400/0xa66601b03fd52d13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd10 expref: 12 pid: 6488 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890972.181310:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00100000:0.0:1788890972.181318:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087acc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:2394:x1875787987827712:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890972.181328:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890972.181333:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250b69c6400/0xa66601b03fd52d13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd10 expref: 12 pid: 6488 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.181343:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250b69c6400/0xa66601b03fd52d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd10 expref: 12 pid: 6488 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.181352:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c6400/0xa66601b03fd52d13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd10 expref: 12 pid: 6488 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.181362:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52e01 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.181368:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52e01 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.181378:0:7436:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52e01 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.181382:0:7436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52e01 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.181387:0:7436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52e01 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.181392:0:7436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52e01 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.181404:0:7436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6e00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788890972.181409:0:7436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52e01 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.181416:0:7436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52e01 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.181437:0:7436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52e01 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890972.181446:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890972.181515:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087acc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:2394:x1875787987827712:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 197us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890972.181550:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 45 00010000:00010000:2.0:1788890972.181567:0:13161:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52e01 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890972.181576:0:13161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52e01 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890972.181582:0:13161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c6e00/0xa66601b03fd52e01 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890972.624150:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890972.624198:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890972.624230:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890972.624254:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890972.624276:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890972.624303:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987827968 00000100:00100000:3.0:1788890972.624313:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987827968 00000100:00100000:3.0:1788890972.624363:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987828224 00000100:00100000:3.0:1788890972.624366:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987828224 00000100:00100000:3.0:1788890972.624386:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 119 00000100:00100000:3.0:1788890972.624395:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+6:2394:x1875787987827968:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890972.624468:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+6:2394:x1875787987827968:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 73us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890972.624475:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 119 00000100:00100000:3.0:1788890972.624491:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 120 00000100:00100000:3.0:1788890972.624509:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987828224:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890972.624556:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987828224:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 59us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890972.624562:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 120 00000100:00100000:3.0:1788890972.624592:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987828480 00000100:00100000:3.0:1788890972.624595:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987828480 00000100:00100000:3.0:1788890972.624633:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987828608 00000100:00100000:3.0:1788890972.624636:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987828608 00000100:00100000:3.0:1788890972.624658:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:3.0:1788890972.624664:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987828480:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788890972.624671:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987827840 00000100:00100000:0.0:1788890972.624675:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987827840 00000100:00100000:0.0:1788890972.624704:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 298 00000100:00100000:0.0:1788890972.624711:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:2393:x1875787987827840:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788890972.624739:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:2393:x1875787987827840:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 29us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890972.624745:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 298 00000100:00100000:3.0:1788890972.624770:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987828480:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 105us (515us total) trans 0 rc 0/0 00000100:00080000:0.0:1788890972.624772:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788890972.624776:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00080000:0.0:1788890972.624777:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788890972.624780:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890972.624787:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:3.0:1788890972.624793:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987828608:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890972.624815:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987828608:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 22us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890972.624821:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:3.0:1788890972.629902:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890972.629973:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890972.630007:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987828096 00000100:00100000:3.0:1788890972.630017:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987828096 00000100:00100000:0.0:1788890972.630223:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987828352 00000100:00100000:0.0:1788890972.630228:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987828352 00000100:00100000:0.0:1788890972.630275:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 121 00000100:00100000:0.0:1788890972.630284:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2393:x1875787987828352:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788890972.630365:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2393:x1875787987828352:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 81us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890972.630373:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 121 00000100:00080000:0.0:1788890972.630403:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788890972.630960:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 122 00000100:00100000:2.0:1788890972.630975:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987828096:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788890972.631014:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987828096:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 40us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890972.631021:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 122 00010000:00010000:1.0:1788890973.115934:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890973.648784:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890973.650168:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987828736 00000100:00100000:1.0:1788890973.650179:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987828736 00000100:00100000:1.0:1788890973.650282:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 299 00000100:00100000:1.0:1788890973.650294:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:6157:x1875787987828736:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890973.650311:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890973.650332:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52e08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddd80 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890973.650360:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd80 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890973.650371:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd80 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890973.650382:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7e00, rc 0) 00000100:00100000:1.0:1788890973.650445:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:6157:x1875787987828736:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 153us (1674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890973.650453:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 299 00000100:00100000:2.0:1788890973.656939:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890973.657371:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987828864 00000100:00100000:0.0:1788890973.657382:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987828864 00000100:00100000:0.0:1788890973.657463:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 300 00000100:00100000:0.0:1788890973.657474:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:6157:x1875787987828864:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890973.657645:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:6157:x1875787987828864:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 173us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890973.657654:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 300 00000100:00100000:2.0:1788890973.663740:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890973.663778:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987828992 00000100:00100000:2.0:1788890973.663787:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987828992 00000100:00100000:2.0:1788890973.663830:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 301 00000100:00100000:2.0:1788890973.663840:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:6157:x1875787987828992:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890973.663990:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:6157:x1875787987828992:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 150us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890973.663999:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 301 00000100:00100000:2.0:1788890973.670256:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890973.670360:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987829120 00000100:00100000:0.0:1788890973.670370:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987829120 00000100:00100000:0.0:1788890973.670734:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 302 00000100:00100000:0.0:1788890973.670746:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:6157:x1875787987829120:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890973.670764:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890973.670783:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae5800/0xa66601b03fd52e0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddd87 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890973.670812:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae5800/0xa66601b03fd52e0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd87 expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890973.670825:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae5800/0xa66601b03fd52e0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd87 expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890973.670835:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5800, rc 0) 00000100:00100000:0.0:1788890973.670973:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:6157:x1875787987829120:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 229us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890973.670980:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 302 00000100:00100000:0.0:1788890973.673719:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890973.673753:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987829248 00000100:00100000:2.0:1788890973.673762:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987829248 00000100:00100000:2.0:1788890973.673814:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 303 00000100:00100000:2.0:1788890973.673824:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:6157:x1875787987829248:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890973.673977:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:6157:x1875787987829248:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 154us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890973.673986:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 303 00000100:00100000:2.0:1788890973.675598:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890973.675878:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987829376 00000100:00100000:0.0:1788890973.675885:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987829376 00000100:00100000:0.0:1788890973.675935:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 304 00000100:00100000:0.0:1788890973.675943:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:6157:x1875787987829376:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890973.676049:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:6157:x1875787987829376:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 106us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890973.676057:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 304 10000000:01000000:3.0:1788890973.755645:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788890973.755653:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9250c12de800 from 7 10000000:01000000:3.0:1788890973.755658:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788890973.755709:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52e16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890973.755726:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52e16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890973.755737:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52e16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890973.755765:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83893100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997334784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788890973.755851:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890973.755916:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c0a626c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890973.755926:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997334784 00000100:00100000:0.0:1788890973.755937:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997334784 00000100:00100000:0.0:1788890973.755994:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788890973.756006:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997334784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890973.756023:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890973.756039:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae4e00/0xa66601b03fd52e1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52e16 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890973.756068:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae4e00/0xa66601b03fd52e1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52e16 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890973.756082:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae4e00/0xa66601b03fd52e1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52e16 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890973.756095:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4e00, rc 0) 00000100:00100000:0.0:1788890973.756149:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997334784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890973.756167:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788890973.756177:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83893100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997334784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788890973.756196:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52e16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52e1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890973.756206:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52e16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52e1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890973.756267:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83893100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997334912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788890973.756293:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890973.756315:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c0a626c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890973.756498:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997334912 00000100:00100000:0.0:1788890973.756504:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997334912 00000100:00100000:0.0:1788890973.756559:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788890973.756569:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997334912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890973.756682:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997334912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890973.756689:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788890973.756718:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83893100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997334912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788890973.756744:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83893100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997335040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788890973.756782:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890973.756804:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c0a626c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890973.756831:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997335040 00000100:00100000:0.0:1788890973.756836:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997335040 00000100:00100000:0.0:1788890973.756867:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788890973.756875:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997335040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890973.756977:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997335040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890973.756984:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788890973.757032:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83893100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997335040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788890973.757784:0:13296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788890973.757946:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788890973.757965:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788890973.757974:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52e16 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52e1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890973.757984:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52e16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52e1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890973.757993:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788890973.757996:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9250ba9ab800 from 7 10000000:01000000:0.0:1788890973.757999:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788890973.758025:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52e24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890973.758042:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52e24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890973.758052:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52e24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890973.758069:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997335168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788890973.758194:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890973.758226:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997335168 00000100:00100000:0.0:1788890973.758227:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788890973.758233:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997335168 00000100:00100000:1.0:1788890973.758309:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788890973.758319:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997335168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890973.758329:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890973.758341:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c7000/0xa66601b03fd52e2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52e24 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890973.758363:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c7000/0xa66601b03fd52e2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52e24 expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890973.758381:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c7000/0xa66601b03fd52e2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52e24 expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890973.758391:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7000, rc 0) 00000100:00100000:1.0:1788890973.758431:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997335168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890973.758438:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788890973.758467:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997335168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890973.758480:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52e24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52e2b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890973.758488:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52e24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52e2b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890973.758564:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997335296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890973.758723:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890973.764365:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997335296 00000100:00100000:3.0:1788890973.764384:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997335296 00000100:00100000:3.0:1788890973.764453:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788890973.764467:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997335296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788890973.764673:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997335296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (5947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890973.764681:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788890973.767379:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788890973.767432:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997335296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890973.767518:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997335424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890973.767616:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890973.767647:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788890973.767805:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997335424 00000100:00100000:3.0:1788890973.767815:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997335424 00000100:00100000:3.0:1788890973.767869:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788890973.767880:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997335424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788890973.768028:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997335424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890973.768036:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788890973.768695:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997335424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788890973.769784:0:13297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788890973.769978:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788890973.770009:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788890973.770019:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52e24 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52e2b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890973.770031:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52e24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52e2b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890973.770042:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788890973.770044:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92508475e000 from 7 10000000:01000000:0.0:1788890973.770048:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788890973.770080:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52e32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890973.770088:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52e32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890973.770098:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52e32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890973.770121:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997335552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788890973.770179:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890973.770251:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788890973.770294:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997335552 00000100:00100000:1.0:1788890973.770300:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997335552 00000100:00100000:1.0:1788890973.770376:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788890973.770385:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997335552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890973.770397:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890973.770409:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd52e39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52e32 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890973.770432:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd52e39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52e32 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890973.770442:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd52e39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52e32 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890973.770451:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6c00, rc 0) 00000100:00100000:1.0:1788890973.770501:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997335552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890973.770507:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788890973.770610:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997335552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788890973.770624:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52e32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52e39 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890973.770644:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52e32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52e39 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890973.770697:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997335680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890973.770725:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890973.770861:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82259240 going to sleep for 11 seconds 00000100:00100000:0.0:1788890973.770897:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997335680 00000100:00100000:0.0:1788890973.770901:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997335680 00000100:00100000:0.0:1788890973.770961:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788890973.770968:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997335680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890973.771099:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a92b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997335680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890973.771106:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788890973.771162:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997335680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890973.771189:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997335808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890973.771235:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890973.771253:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82259240 going to sleep for 11 seconds 00000100:00100000:0.0:1788890973.771292:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997335808 00000100:00100000:0.0:1788890973.771302:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997335808 00000100:00100000:0.0:1788890973.771319:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788890973.771324:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997335808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890973.771398:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997335808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890973.771405:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788890973.771472:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997335808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788890973.772405:0:13298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788890973.772712:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788890973.772735:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788890973.772746:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52e32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52e39 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890973.772757:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52e32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52e39 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890973.772768:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788890973.772771:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92509099a000 from 7 10000000:01000000:0.0:1788890973.772775:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788890973.772807:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4400/0xa66601b03fd52e40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890973.772815:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae4400/0xa66601b03fd52e40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890973.772825:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae4400/0xa66601b03fd52e40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890973.772847:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997335936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788890973.772905:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890973.772984:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6480 going to sleep for 11 seconds 00000100:00100000:1.0:1788890973.773065:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997335936 00000100:00100000:1.0:1788890973.773078:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997335936 00000100:00100000:1.0:1788890973.773155:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788890973.773164:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997335936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890973.773176:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890973.773188:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c7800/0xa66601b03fd52e47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52e40 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890973.773210:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c7800/0xa66601b03fd52e47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52e40 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890973.773220:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c7800/0xa66601b03fd52e47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52e40 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890973.773228:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7800, rc 0) 00000100:00100000:1.0:1788890973.773273:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:6493:x1875787997335936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890973.773280:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788890973.773349:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997335936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788890973.773363:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae4400/0xa66601b03fd52e40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52e47 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890973.773372:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae4400/0xa66601b03fd52e40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52e47 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890973.773423:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997336064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890973.773454:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890973.773652:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82259f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890973.773699:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997336064 00000100:00100000:0.0:1788890973.773709:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997336064 00000100:00100000:0.0:1788890973.773731:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788890973.773738:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:6493:x1875787997336064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890973.773881:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:6493:x1875787997336064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890973.773899:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788890973.773956:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997336064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890973.773984:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997336192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890973.774025:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890973.774081:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82259f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788890973.774149:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997336192 00000100:00100000:1.0:1788890973.774153:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997336192 00000100:00100000:0.0:1788890973.774187:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788890973.774195:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:6493:x1875787997336192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890973.774274:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:6493:x1875787997336192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890973.774281:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788890973.774353:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997336192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788890973.775188:0:13299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788890973.776093:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788890973.776118:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788890973.776129:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4400/0xa66601b03fd52e40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52e47 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890973.776140:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae4400/0xa66601b03fd52e40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52e47 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890973.821564:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997336320:0@lo:400:kworker.0 00000100:00100000:2.0:1788890973.821584:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997336704:0@lo:400:kworker.0 00000100:00100000:2.0:1788890973.822511:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890973.822602:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997337216:0@lo:400:kworker.0 00000100:00100000:2.0:1788890973.822637:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890973.822660:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997337728:0@lo:400:kworker.0 00000100:00100000:2.0:1788890973.822686:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890973.822779:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788890973.822790:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997337344:0@lo:400:kworker.0 00000100:00100000:2.0:1788890973.822822:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890973.822898:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997336448:0@lo:400:kworker.0 00000100:00100000:2.0:1788890973.822925:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890973.823009:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997336960:0@lo:400:kworker.0 00000100:00100000:2.0:1788890973.823035:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890973.823055:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997337472:0@lo:400:kworker.0 00000100:00100000:2.0:1788890973.823081:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890973.823104:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788890973.823111:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997336576:0@lo:400:kworker.0 00000100:00100000:2.0:1788890973.823135:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890973.823158:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997337088:0@lo:400:kworker.0 00000100:00100000:2.0:1788890973.823180:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890973.823213:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997337600:0@lo:400:kworker.0 00000100:00100000:2.0:1788890973.823242:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890973.823333:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997336704 00000100:00100000:2.0:1788890973.823341:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997336704 00000100:00100000:2.0:1788890973.823385:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997336448 00000100:00100000:2.0:1788890973.823389:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997336448 00000100:00100000:0.0:1788890973.823405:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788890973.823417:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788890973.823425:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997336448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890973.823478:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997336448:12345-0@lo:400:kworker.0 Request processed in 53us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890973.823485:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788890973.823506:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997337216 00000100:00100000:2.0:1788890973.823509:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997337216 00000100:00100000:2.0:1788890973.823561:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997337728 00000100:00100000:2.0:1788890973.823564:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997337728 00000100:00100000:3.0:1788890973.823573:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890973.823580:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997337088 00000100:00100000:2.0:1788890973.823583:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997337088 00000100:00100000:2.0:1788890973.823598:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997337600 00000100:00100000:2.0:1788890973.823600:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997337600 00000100:00100000:2.0:1788890973.823616:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788890973.823619:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997337344 00000100:00100000:2.0:1788890973.823625:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997337216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890973.823627:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997337344 00000100:00100000:3.0:1788890973.823658:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997336960 00000100:00100000:3.0:1788890973.823662:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997336960 00000100:00100000:2.0:1788890973.823670:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997337216:12345-0@lo:400:kworker.0 Request processed in 46us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890973.823675:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997337472 00000100:00100000:2.0:1788890973.823679:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788890973.823680:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997337472 00000100:00100000:2.0:1788890973.823700:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788890973.823701:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997336576 00000100:00100000:3.0:1788890973.823705:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997336576 00000100:00100000:2.0:1788890973.823710:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997337728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890973.823716:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997336320 00000100:00100000:3.0:1788890973.823719:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997336320 00000100:00100000:3.0:1788890973.823730:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788890973.823736:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997337344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890973.823776:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997337344:12345-0@lo:400:kworker.0 Request processed in 41us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890973.823783:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788890973.823795:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788890973.823801:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997336960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890973.823826:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997336960:12345-0@lo:400:kworker.0 Request processed in 25us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890973.823831:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788890973.823841:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788890973.823846:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997337472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890973.823869:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997337472:12345-0@lo:400:kworker.0 Request processed in 23us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890973.823874:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788890973.823896:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788890973.823903:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997336576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890973.823928:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997336576:12345-0@lo:400:kworker.0 Request processed in 26us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890973.823933:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788890973.823943:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788890973.823947:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997336320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890973.823971:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997336320:12345-0@lo:400:kworker.0 Request processed in 24us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890973.823976:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788890973.824006:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997336320:0@lo:400:kworker.0 00000100:00100000:3.0:1788890973.824021:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1875787997336832:0@lo:400:kworker.0 00000100:00100000:3.0:1788890973.824042:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890973.824696:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997336704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890973.824742:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997336704:12345-0@lo:400:kworker.0 Request processed in 1328us (2235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890973.824748:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788890973.824927:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997337728:12345-0@lo:400:kworker.0 Request processed in 1218us (2238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890973.824935:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788890973.824959:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788890973.824967:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997337088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890973.825002:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997337088:12345-0@lo:400:kworker.0 Request processed in 37us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890973.825008:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788890973.825021:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788890973.825028:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997337600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890973.825077:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997337600:12345-0@lo:400:kworker.0 Request processed in 49us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890973.825174:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997336832 00000100:00100000:3.0:1788890973.825179:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997336832 00000100:00100000:3.0:1788890973.825205:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788890973.825214:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875787997336832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890973.825220:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788890973.825283:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788890973.825288:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788890973.825291:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788890973.825294:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788890973.825327:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997337344:0@lo:400:kworker.0 00000100:00100000:3.0:1788890973.825334:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875787997336832:12345-0@lo:400:kworker.0 Request processed in 120us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890973.825341:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788890973.825347:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997336704:0@lo:400:kworker.0 00010000:00080000:2.0:1788890973.825379:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82ff7800 x1875787997337216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890973.825515:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997337216:0@lo:400:kworker.0 00010000:00080000:2.0:1788890973.825561:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f833d2a00 x1875787997337728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890973.825572:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997337728:0@lo:400:kworker.0 00000100:00100000:1.0:1788890973.825591:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1875787997336832:0@lo:400:kworker.0 00000100:00100000:2.0:1788890973.825785:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997336576:0@lo:400:kworker.0 00010000:00080000:2.0:1788890973.825799:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82ff7480 x1875787997337088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890973.825816:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997337088:0@lo:400:kworker.0 00010000:00080000:2.0:1788890973.825828:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f833d2680 x1875787997337600/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890973.825837:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997337600:0@lo:400:kworker.0 00000100:00100000:2.0:1788890973.825848:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997336448:0@lo:400:kworker.0 00010000:00080000:2.0:1788890973.825860:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82ff5180 x1875787997336960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890973.825868:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997336960:0@lo:400:kworker.0 00010000:00080000:2.0:1788890973.825880:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f833d3480 x1875787997337472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890973.825902:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997337472:0@lo:400:kworker.0 00010000:00010000:0.0:1788890974.139804:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788890974.224258:0:13359:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788890974.332198:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997337856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788890974.332311:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890974.332736:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997337856 00000100:00100000:1.0:1788890974.332747:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997337856 00000100:00100000:1.0:1788890974.333074:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788890974.333085:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997337856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788890974.333119:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788890974.333202:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997337856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890974.333209:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1788890974.333398:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1c15180 x1875787997337856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890974.333418:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997337856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788890974.334355:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788890974.334378:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997337984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788890974.334466:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890974.334503:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997337984 00000100:00100000:1.0:1788890974.334514:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997337984 00000100:00100000:1.0:1788890974.334612:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788890974.334623:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997337984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788890974.334645:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788890974.334912:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997337984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 290us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890974.334919:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1788890974.335285:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83890000 x1875787997337984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890974.335312:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997337984:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788890975.164203:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890975.868454:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788890975.868472:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997338240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788890975.868486:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997338112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788890975.868890:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997338368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788890975.869441:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890975.869607:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890975.869711:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890975.869781:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997338368 00000100:00100000:1.0:1788890975.869792:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997338368 00000100:00100000:1.0:1788890975.869865:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788890975.869876:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997338368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788890975.869924:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788890975.870151:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997338368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 276us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890975.870160:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788890975.870287:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997338368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788890975.870420:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997338112 00000100:00100000:1.0:1788890975.870425:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997338112 00000100:00100000:2.0:1788890975.870499:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997338240 00000100:00100000:2.0:1788890975.870503:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997338240 00000100:00100000:1.0:1788890975.870584:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788890975.870592:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997338112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788890975.870633:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788890975.870679:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997338112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890975.870686:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1788890975.870719:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1c15180 x1875787997338112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890975.870736:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997338112:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788890975.870801:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788890975.870930:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788890975.870937:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997338240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788890975.870949:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788890975.871016:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997338240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890975.871022:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1788890975.871162:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83890000 x1875787997338240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890975.871181:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997338240:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788890976.193040:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890976.892126:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997338496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788890976.892204:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890976.892351:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997338496 00000100:00100000:3.0:1788890976.892376:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997338496 00000100:00100000:3.0:1788890976.892451:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788890976.892462:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997338496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788890976.892513:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788890976.892590:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997338496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890976.892597:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788890976.892821:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997338496:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788890977.214959:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788890977.495694:0:13508:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 14:09:36 (1788890976) === 00000100:00100000:3.0:1788890977.613789:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890977.614286:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987829504 00000100:00100000:1.0:1788890977.614298:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987829504 00000100:00100000:1.0:1788890977.614376:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:1.0:1788890977.614390:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:df03475d-d91a-4e91-8125-742ac4d4c589+6:10466:x1875787987829504:12345-192.168.204.26@tcp:700:mkdir.0 00000100:00100000:1.0:1788890977.614466:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:df03475d-d91a-4e91-8125-742ac4d4c589+6:10466:x1875787987829504:12345-192.168.204.26@tcp:700:mkdir.0 Request processed in 79us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890977.614474:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00080000:0.0:1788890977.614704:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890977.618676:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890977.618724:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987829760 00000100:00100000:2.0:1788890977.618734:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987829760 00000100:00100000:2.0:1788890977.618793:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:2.0:1788890977.618804:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:10466:x1875787987829760:12345-192.168.204.26@tcp:36:mkdir.0 00010000:00010000:2.0:1788890977.618884:0:9362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890977.618970:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd52cf0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddcfb expref: 6 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.618989:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e39700) 00010000:00010000:2.0:1788890977.619000:0:9362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788890977.619083:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52e4e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.619097:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52e4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.619108:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52e4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.619134:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd52e55 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.619143:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd52e55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.619150:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd52e55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.620084:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311e00/0xa66601b03fd52e5c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.620098:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311e00/0xa66601b03fd52e5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.620107:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311e00/0xa66601b03fd52e5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788890977.620129:0:9362:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096354419 reply state 000000006751ac10 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311e00/0xa66601b03fd52e5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.620142:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311e00/0xa66601b03fd52e5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.620149:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff924f82e34400) 00010000:00010000:2.0:1788890977.620152:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788890977.620252:0:9362:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788890977.620258:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788890977.620267:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52e4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.620274:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52e4e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.620282:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52e4e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.620289:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788890977.620293:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52e4e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.620301:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52e4e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.620312:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e34d00) 00010000:00010000:2.0:1788890977.620314:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890977.620318:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52e4e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.620335:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52e4e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788890977.620351:0:9362:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096354419 reply state 000000006751ac10 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd52e55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.620361:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd52e55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.620367:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff924f82e34c00) 00010000:00010000:2.0:1788890977.620370:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788890977.620372:0:9362:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788890977.620473:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+7:10466:x1875787987829760:12345-192.168.204.26@tcp:36:mkdir.0 Request processed in 1668us (1805us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788890977.620482:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:2.0:1788890977.629242:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890977.629384:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987829888 00000100:00100000:0.0:1788890977.629394:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987829888 00000100:00100000:0.0:1788890977.629450:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:0.0:1788890977.629460:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+7:10468:x1875787987829888:12345-192.168.204.26@tcp:101:chmod.0 00010000:00010000:0.0:1788890977.629484:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890977.629509:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd52e63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddd8e expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.629605:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd52e6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.629621:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd52e6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.629634:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd52e6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890977.629679:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788890977.629683:0:12407:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788890977.629720:0:12407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd52e6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.629746:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd52e63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd8e expref: 9 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.629762:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd52e6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd8e expref: 8 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.629789:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925085363700) 00010000:00010000:0.0:1788890977.629793:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788890977.629796:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5600, rc 0) 00000100:00100000:0.0:1788890977.629865:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+8:10468:x1875787987829888:12345-192.168.204.26@tcp:101:chmod.0 Request processed in 406us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890977.629873:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:3.0:1788890977.634369:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890977.634621:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987830144 00000100:00100000:0.0:1788890977.634631:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987830144 00000100:00100000:0.0:1788890977.634961:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:0.0:1788890977.634976:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+8:10468:x1875787987830144:12345-192.168.204.26@tcp:36:chmod.0 00010000:00010000:0.0:1788890977.635096:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890977.635126:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd52e6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd8e expref: 8 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.635143:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925085363700) 00010000:00010000:0.0:1788890977.635154:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788890977.635282:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd52e71 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.635297:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd52e71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.635307:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd52e71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788890977.635507:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c818b5b reply state 00000000ad60669b transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd52e71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.635571:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd52e71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.635578:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925085363800) 00010000:00010000:0.0:1788890977.635581:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788890977.635584:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788890977.635593:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788890977.635677:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+9:10468:x1875787987830144:12345-192.168.204.26@tcp:36:chmod.0 Request processed in 704us (1317us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788890977.635684:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:1.0:1788890977.652917:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890977.653061:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987830272 00000100:00100000:2.0:1788890977.653070:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987830272 00000100:00100000:2.0:1788890977.653136:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:2.0:1788890977.653147:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+9:10469:x1875787987830272:12345-192.168.204.26@tcp:101:chown.0 00010000:00010000:2.0:1788890977.653171:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890977.653286:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52e78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddd95 expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.653351:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd52e7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.653364:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd52e7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.653388:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd52e7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890977.653432:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788890977.653436:0:9362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788890977.653470:0:9362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd52e7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.653494:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52e78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd95 expref: 11 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.653511:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd52e7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd95 expref: 10 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.653570:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925085363800) 00010000:00010000:2.0:1788890977.653574:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788890977.653577:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311c00, rc 0) 00000100:00100000:2.0:1788890977.653732:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+10:10469:x1875787987830272:12345-192.168.204.26@tcp:101:chown.0 Request processed in 586us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890977.653740:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:2.0:1788890977.656315:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890977.656415:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987830400 00000100:00100000:3.0:1788890977.656424:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987830400 00000100:00100000:3.0:1788890977.656473:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 26 00000100:00100000:3.0:1788890977.656484:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+10:10469:x1875787987830400:12345-192.168.204.26@tcp:101:chown.0 00010000:00010000:3.0:1788890977.656502:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890977.656575:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd52e86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddd9c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656633:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52e8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656646:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52e8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656657:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52e8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656667:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52e94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656690:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52e94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656696:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52e94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656772:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd52e9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656780:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd52e9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656787:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd52e9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788890977.656838:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788890977.656841:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788890977.656871:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd52e9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656883:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52e8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656889:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52e8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656896:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52e8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656902:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788890977.656906:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52e8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656919:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52e8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656931:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925085363800) 00010000:00010000:3.0:1788890977.656934:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890977.656938:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52e8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656944:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52e8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656956:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52e94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656962:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52e94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656968:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52e94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656973:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8ac00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788890977.656976:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52e94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656981:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52e94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.656988:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff924f82e34c00) 00010000:00010000:3.0:1788890977.656990:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890977.656993:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52e94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.657008:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52e94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.657034:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd52e86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd9c expref: 12 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.657047:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd52e9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd9c expref: 11 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.657054:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff924f82e34400) 00010000:00010000:3.0:1788890977.657056:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788890977.657058:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8b800, rc 0) 00000100:00100000:3.0:1788890977.657289:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+11:10469:x1875787987830400:12345-192.168.204.26@tcp:101:chown.0 Request processed in 806us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890977.657298:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 26 00000100:00100000:3.0:1788890977.665942:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890977.666078:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987830528 00000100:00100000:2.0:1788890977.666095:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987830528 00000100:00100000:2.0:1788890977.666174:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:2.0:1788890977.666184:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:df03475d-d91a-4e91-8125-742ac4d4c589+11:10469:x1875787987830528:12345-192.168.204.26@tcp:900:chown.0 00000100:00100000:2.0:1788890977.666288:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:df03475d-d91a-4e91-8125-742ac4d4c589+11:10469:x1875787987830528:12345-192.168.204.26@tcp:900:chown.0 Request processed in 105us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890977.666314:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:1.0:1788890977.669643:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890977.669935:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987830784 00000100:00100000:3.0:1788890977.669949:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987830784 00000100:00100000:3.0:1788890977.670126:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:3.0:1788890977.670138:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+11:10469:x1875787987830784:12345-192.168.204.26@tcp:36:chown.0 00010000:00010000:3.0:1788890977.670228:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890977.670264:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd52e9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd9c expref: 11 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.670288:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff924f82e34400) 00010000:00010000:3.0:1788890977.670295:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788890977.670344:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd52ea2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.670362:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd52ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.670376:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd52ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788890977.673568:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:2.0:1788890977.673876:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd52e55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.673892:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd52e55 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.673901:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd52e55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.673908:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788890977.673914:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd52e55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.673922:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd52e55 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.673944:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff924f82e34c00) 00010000:00010000:2.0:1788890977.673948:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890977.673954:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd52e55 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.673960:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd52e55 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.673993:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311e00/0xa66601b03fd52e5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.674000:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311e00/0xa66601b03fd52e5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.674022:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311e00/0xa66601b03fd52e5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.674027:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311e00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788890977.674030:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311e00/0xa66601b03fd52e5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.674036:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311e00/0xa66601b03fd52e5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.674044:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff924f82e34400) 00010000:00010000:2.0:1788890977.674047:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890977.674049:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311e00/0xa66601b03fd52e5c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.674055:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311e00/0xa66601b03fd52e5c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.674070:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd52e71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.674077:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd52e71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.674083:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd52e71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.674087:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788890977.674090:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd52e71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.674105:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd52e71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.674113:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925085363800) 00010000:00010000:2.0:1788890977.674115:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788890977.674118:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd52e71 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.674123:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd52e71 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788890977.674294:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9ff1479 reply state 000000007997b809 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd52ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.674311:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd52ea2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.674318:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff924f82e34400) 00010000:00010000:0.0:1788890977.674320:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788890977.674324:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788890977.674341:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1788890977.674570:0:6497:0:(ldlm_lib.c:3484:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788890977.674594:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+7:10469:x1875787987830784:12345-192.168.204.26@tcp:36:chown.0 Request processed in 4451us (4959us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788890977.674605:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 27 00010000:00010000:2.0:1788890977.676451:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd52ea2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.676471:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd52ea2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.676482:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd52ea2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.676489:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788890977.676494:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd52ea2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.676502:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd52ea2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.676536:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff924f82e34400) 00010000:00010000:2.0:1788890977.676540:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788890977.676546:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd52ea2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.676572:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd52ea2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890977.688471:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890977.688661:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987830912 00000100:00100000:2.0:1788890977.688676:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987830912 00000100:00100000:2.0:1788890977.688922:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:2.0:1788890977.688936:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:10470:x1875787987830912:12345-192.168.204.26@tcp:101:touch.500 00010000:00010000:2.0:1788890977.688972:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890977.688999:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311e00/0xa66601b03fd52ea9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddda3 expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788890977.690555:0:9362:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1487us 00010000:00010000:0.0:1788890977.706039:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd52eb0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706084:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd52eb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706098:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd52eb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706117:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd52eb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706125:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd52eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706133:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd52eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706273:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd52ebe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706283:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd52ebe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706291:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd52ebe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890977.706324:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788890977.706329:0:9362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788890977.706370:0:9362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd52ebe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706385:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd52eb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706403:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd52eb0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706411:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd52eb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706419:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788890977.706424:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd52eb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706432:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd52eb0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706446:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925085363800) 00010000:00010000:0.0:1788890977.706449:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890977.706454:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd52eb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706461:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd52eb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706482:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd52eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706488:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd52eb7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706495:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd52eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706501:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788890977.706511:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd52eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706519:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd52eb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706575:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff925085363700) 00010000:00010000:0.0:1788890977.706578:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890977.706582:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd52eb7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706589:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd52eb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706633:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311e00/0xa66601b03fd52ea9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddda3 expref: 8 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706649:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd52ebe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddda3 expref: 7 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890977.706657:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff925085363400) 00010000:00010000:0.0:1788890977.706660:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788890977.706664:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5000, rc 0) 00000100:00100000:0.0:1788890977.706761:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+7:10470:x1875787987830912:12345-192.168.204.26@tcp:101:touch.500 Request processed in 17826us (18303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890977.706772:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:3.0:1788890977.711479:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890977.712708:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987831168 00000100:00100000:2.0:1788890977.712726:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987831168 00000100:00100000:2.0:1788890977.712832:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:2.0:1788890977.712846:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+7:10470:x1875787987831168:12345-192.168.204.26@tcp:101:touch.500 00010000:00010000:2.0:1788890977.712886:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890977.712914:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd52ec5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dddaa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.713057:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52ecc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.713074:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52ecc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.713088:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52ecc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.715359:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd52ed3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x6274d149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.715383:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd52ed3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.715408:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd52ed3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788890977.716254:0:6496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788890977.716555:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd52eda lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.716567:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd52eda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.716577:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd52eda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.716615:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52ecc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.716622:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52ecc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.716629:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52ecc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.716636:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788890977.716640:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52ecc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.716660:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52ecc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.716679:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff925085363400) 00010000:00010000:2.0:1788890977.716682:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890977.716687:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52ecc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.716693:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52ecc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788890977.716841:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ef5bb84 reply state 00000000eaa108f5 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd52ed3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.716855:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd52ed3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.716862:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6274d149 (ffff924f82e34400) 00010000:00010000:2.0:1788890977.716865:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788890977.716868:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788890977.716904:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd52ec5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddaa expref: 10 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.716919:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd52eda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddaa expref: 9 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.716927:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff924f82e34c00) 00010000:00010000:2.0:1788890977.716929:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890977.716932:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310800, rc 0) 00000100:00100000:2.0:1788890977.717007:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+10:10470:x1875787987831168:12345-192.168.204.26@tcp:101:touch.500 Request processed in 4165us (5597us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788890977.717022:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:0.0:1788890977.725123:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890977.727588:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987831424 00000100:00100000:1.0:1788890977.727602:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987831424 00000100:00100000:1.0:1788890977.727712:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:1.0:1788890977.727723:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+10:10470:x1875787987831424:12345-192.168.204.26@tcp:36:touch.500 00010000:00010000:1.0:1788890977.727781:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890977.727817:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd52eda lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddaa expref: 10 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890977.727859:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff924f82e34c00) 00010000:00010000:1.0:1788890977.727870:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788890977.727930:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd52ee8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890977.727947:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd52ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890977.727957:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd52ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788890977.728053:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006de5a7d3 reply state 0000000069770ea9 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd52ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890977.728065:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd52ee8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890977.728072:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9250b65f1100) 00010000:00010000:1.0:1788890977.728075:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788890977.728078:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788890977.728219:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+11:10470:x1875787987831424:12345-192.168.204.26@tcp:36:touch.500 Request processed in 496us (3105us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788890977.728230:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:0.0:1788890977.732319:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890977.732443:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987831552 00000100:00100000:2.0:1788890977.732453:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987831552 00000100:00100000:2.0:1788890977.732671:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:2.0:1788890977.732683:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+11:10470:x1875787987831552:12345-192.168.204.26@tcp:101:touch.500 00010000:00010000:2.0:1788890977.732707:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890977.732727:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd52eef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dddb1 expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.732784:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd52eef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddb1 expref: 12 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.732800:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd52eef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddb1 expref: 12 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.732833:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9250b65f1100) 00010000:00010000:2.0:1788890977.732836:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788890977.732840:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310600, rc 0) 00000100:00100000:2.0:1788890977.732897:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+12:10470:x1875787987831552:12345-192.168.204.26@tcp:101:touch.500 Request processed in 216us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890977.732904:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:3.0:1788890977.735427:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890977.735784:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987831680 00000100:00100000:2.0:1788890977.735793:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987831680 00000100:00100000:2.0:1788890977.735855:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:2.0:1788890977.735863:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2390:x1875787987831680:12345-192.168.204.26@tcp:8:touch.500 00010000:00080000:2.0:1788890977.735900:0:11803:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:2.0:1788890977.735952:0:11803:0:(genops.c:1385:class_connect()) connect: client df03475d-d91a-4e91-8125-742ac4d4c589, cookie 0xa66601b03fd52ef6 00002000:00100000:2.0:1788890977.735964:0:11803:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli df03475d-d91a-4e91-8125-742ac4d4c589/ffff9250bf76a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788890977.735974:0:11803:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788890977.736070:0:11803:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788890977.736102:0:11803:0:(import.c:65:import_set_state_nolock()) ffff9250bf768000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788890977.736190:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df03475d-d91a-4e91-8125-742ac4d4c589+6:2390:x1875787987831680:12345-192.168.204.26@tcp:8:touch.500 Request processed in 325us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890977.736198:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:1.0:1788890977.740926:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890977.741240:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987831808 00000100:00100000:2.0:1788890977.741250:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987831808 00000100:00100000:2.0:1788890977.741326:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:2.0:1788890977.741337:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:0:x1875787987831808:12345-192.168.204.26@tcp:2:touch.500 00000100:00080000:0.0:1788890977.741508:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890977.743013:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890977.743160:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890977.744041:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987832064 00000100:00100000:2.0:1788890977.744051:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987832064 00000100:00100000:2.0:1788890977.744132:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 129 00000100:00100000:2.0:1788890977.744147:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+5:2391:x1875787987832064:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788890977.744148:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987831936 00000100:00080000:1.0:1788890977.744158:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788890977.744166:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987831936 00000100:00100000:2.0:1788890977.744405:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+5:2391:x1875787987832064:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 261us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890977.744414:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 129 00000100:00100000:0.0:1788890977.744440:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 317 00000100:00100000:0.0:1788890977.744451:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a92a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2391:x1875787987831936:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890977.745910:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890977.745950:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890977.746022:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987832192 00000100:00100000:3.0:1788890977.746028:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987832192 00000100:00100000:3.0:1788890977.746076:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987832320 00000100:00100000:3.0:1788890977.746079:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987832320 00000100:00100000:3.0:1788890977.746101:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 130 00000100:00100000:3.0:1788890977.746109:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2391:x1875787987832192:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890977.746161:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2391:x1875787987832192:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 52us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890977.746169:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 130 00000100:00100000:3.0:1788890977.746185:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 131 00000100:00100000:3.0:1788890977.746191:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2391:x1875787987832320:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890977.746214:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2391:x1875787987832320:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 24us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890977.746220:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 131 00000100:00080000:1.0:1788890977.746358:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788890977.746362:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890977.746729:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a92a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2391:x1875787987831936:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 2277us (3719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890977.746739:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 317 00000001:00080000:1.0:1788890977.750002:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:1.0:1788890977.750016:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df03475d-d91a-4e91-8125-742ac4d4c589 00000100:00100000:2.0:1788890977.750216:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:0:x1875787987831808:12345-192.168.204.26@tcp:2:touch.500 Request processed in 8875us (9293us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788890977.750229:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:3.0:1788890977.756380:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890977.756422:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890977.756456:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890977.756666:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987832832 00000100:00100000:0.0:1788890977.756678:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987832832 00000100:00100000:2.0:1788890977.756711:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987832448 00000100:00100000:2.0:1788890977.756718:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987832448 00000100:00100000:2.0:1788890977.756762:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987832576 00000100:00100000:2.0:1788890977.756766:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987832576 00000100:00100000:0.0:1788890977.756818:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:2.0:1788890977.756819:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:0.0:1788890977.756839:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+12:10470:x1875787987832832:12345-192.168.204.26@tcp:35:touch.500 00000100:00100000:2.0:1788890977.756840:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2390:x1875787987832448:12345-192.168.204.26@tcp:9:kworker.0 00000020:00000080:2.0:1788890977.756873:0:8408:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52df3 00000100:00080000:2.0:1788890977.756882:0:8408:0:(import.c:65:import_set_state_nolock()) ffff924f82215000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788890977.756945:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788890977.757081:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:1.0:1788890977.757092:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2390:x1875787987832576:12345-192.168.204.26@tcp:9:kworker.0 00000020:00000080:1.0:1788890977.757108:0:11803:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52dfa 00000100:00080000:1.0:1788890977.757115:0:11803:0:(import.c:65:import_set_state_nolock()) ffff924f832dc000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788890977.757120:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+13:10470:x1875787987832832:12345-192.168.204.26@tcp:35:touch.500 Request processed in 287us (659us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788890977.757131:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2 00000001:00000004:1.0:1788890977.757150:0:11803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:0.0:1788890977.757155:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890977.757249:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1c240b24-a098-4d30-bfbf-dd53172bbf52+2:2390:x1875787987832576:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 159us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890977.757257:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:2.0:1788890977.757699:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+2:2390:x1875787987832448:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 868us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890977.757706:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 24 00010000:00010000:2.0:1788890977.757722:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788890977.757733:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788890977.757737:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890977.766878:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890977.767044:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987832960 00000100:00100000:2.0:1788890977.767054:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987832960 00000100:00100000:2.0:1788890977.767114:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:2.0:1788890977.767125:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+13:10471:x1875787987832960:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:2.0:1788890977.767149:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890977.767167:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52efd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dddb8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.767246:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd52f04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.767260:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd52f04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.767275:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd52f04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890977.767346:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788890977.767360:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788890977.767400:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd52f04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.767426:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52efd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddb8 expref: 15 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.767446:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd52f04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddb8 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.767453:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff925085363400) 00010000:00010000:2.0:1788890977.767456:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788890977.767459:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311400, rc 0) 00000100:00100000:2.0:1788890977.767561:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+14:10471:x1875787987832960:12345-192.168.204.26@tcp:101:rm.0 Request processed in 400us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890977.767569:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:1.0:1788890977.770906:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890977.771002:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987833216 00000100:00100000:3.0:1788890977.771012:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987833216 00000100:00100000:3.0:1788890977.771065:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:3.0:1788890977.771076:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+14:10471:x1875787987833216:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:3.0:1788890977.771097:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890977.771116:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd52f0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dddbf expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788890977.771226:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788890977.771334:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd52f0b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddbf expref: 16 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.771351:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925085363800) 00010000:00010000:3.0:1788890977.771354:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788890977.771360:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd52f0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddbf expref: 16 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.771375:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8b800, rc 0) 00000100:00100000:3.0:1788890977.771440:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+15:10471:x1875787987833216:12345-192.168.204.26@tcp:101:rm.0 Request processed in 366us (544us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1788890977.771448:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:1.0:1788890977.776301:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890977.776377:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987833344 00000100:00100000:0.0:1788890977.776388:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987833344 00000100:00100000:0.0:1788890977.776444:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:0.0:1788890977.776456:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+15:10471:x1875787987833344:12345-192.168.204.26@tcp:37:rm.0 00000100:00100000:2.0:1788890977.782935:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+15:10471:x1875787987833344:12345-192.168.204.26@tcp:37:rm.0 Request processed in 6470us (6631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890977.782953:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:1.0:1788890977.786183:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890977.786315:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987833600 00000100:00100000:3.0:1788890977.786326:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987833600 00000100:00100000:3.0:1788890977.786436:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:3.0:1788890977.786462:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090479c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+15:10471:x1875787987833600:12345-192.168.204.26@tcp:35:rm.0 00000100:00100000:3.0:1788890977.786722:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090479c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+16:10471:x1875787987833600:12345-192.168.204.26@tcp:35:rm.0 Request processed in 263us (549us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788890977.786964:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:1.0:1788890977.789097:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890977.789245:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987833856 00000100:00100000:2.0:1788890977.789254:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987833856 00000100:00100000:2.0:1788890977.789312:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:2.0:1788890977.789323:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+16:10471:x1875787987833856:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:2.0:1788890977.789350:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890977.789370:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52f19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dddc6 expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.789498:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd52f20 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.789570:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd52f20 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.789584:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd52f20 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890977.789596:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788890977.789691:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52f19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddc6 expref: 19 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.789708:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd52f20 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddc6 expref: 18 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.789716:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff925085363400) 00010000:00010000:2.0:1788890977.789719:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788890977.789722:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311800, rc 0) 00000100:00100000:2.0:1788890977.790144:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+18:10471:x1875787987833856:12345-192.168.204.26@tcp:101:rm.0 Request processed in 821us (1053us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788890977.790152:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:0.0:1788890977.793685:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890977.793776:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987833984 00000100:00100000:3.0:1788890977.793786:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987833984 00000100:00100000:3.0:1788890977.793892:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:3.0:1788890977.793902:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+18:10471:x1875787987833984:12345-192.168.204.26@tcp:41:rm.0 00000004:00000024:3.0:1788890977.793957:0:12407:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1788890977.794046:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+18:10471:x1875787987833984:12345-192.168.204.26@tcp:41:rm.0 Request processed in 137us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890977.794056:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:1.0:1788890977.795953:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890977.796245:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987834112 00000100:00100000:2.0:1788890977.796252:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987834112 00000100:00100000:2.0:1788890977.796396:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:2.0:1788890977.796404:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+18:10471:x1875787987834112:12345-192.168.204.26@tcp:101:rm.0 00010000:00010000:2.0:1788890977.796420:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890977.796437:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd52f2e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dddcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796504:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd52f35 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796516:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd52f35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796562:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd52f35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796576:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd52f3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796583:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd52f3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796590:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd52f3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796696:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd52f43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796705:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd52f43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796712:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd52f43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890977.796746:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788890977.796751:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788890977.796767:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd52f43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796790:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd52f43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796799:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd52f35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796805:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd52f35 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796822:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd52f35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796827:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788890977.796832:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd52f35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796839:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd52f35 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796851:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff925085363400) 00010000:00010000:2.0:1788890977.796854:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890977.796858:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd52f35 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796864:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd52f35 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796876:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd52f3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796881:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd52f3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796892:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd52f3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796897:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788890977.796899:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd52f3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796904:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd52f3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796911:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6274d149 (ffff924f82e34400) 00010000:00010000:2.0:1788890977.796912:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890977.796916:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd52f3c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796920:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd52f3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796944:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd52f2e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddcd expref: 20 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796956:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd52f43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddcd expref: 19 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.796962:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9250b65f1100) 00010000:00010000:2.0:1788890977.796964:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890977.796967:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310e00, rc 0) 00000100:00100000:2.0:1788890977.797028:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+19:10471:x1875787987834112:12345-192.168.204.26@tcp:101:rm.0 Request processed in 624us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890977.797055:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:1.0:1788890977.800142:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890977.800405:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987834368 00000100:00100000:2.0:1788890977.800414:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987834368 00000100:00100000:2.0:1788890977.800506:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:2.0:1788890977.800517:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+19:10471:x1875787987834368:12345-192.168.204.26@tcp:36:rm.0 00010000:00010000:2.0:1788890977.800600:0:9362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788890977.800627:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd52f43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddcd expref: 19 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.800648:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd52eef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddb1 expref: 18 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.800657:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9250b65f1100) 00010000:00010000:2.0:1788890977.800665:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd52f04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddb8 expref: 17 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.800673:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff925085363400) 00010000:00010000:2.0:1788890977.800676:0:9362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788890977.800695:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52f4a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.800707:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52f4a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.800717:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52f4a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.800727:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd52f51 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x6274d149 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.800749:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd52f51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.800755:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd52f51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.800849:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd52f58 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.800859:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd52f58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.800866:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd52f58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788890977.801093:0:9362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788890977.801104:0:9362:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 200045580378ns, next at 201045577787ns, rc = 0 00010000:00010000:2.0:1788890977.801149:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd52f5f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801158:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd52f5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801165:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd52f5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801186:0:9362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd52f5f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801194:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd52f5f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801209:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd52f5f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801234:0:9362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788890977.801250:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd52f58 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801255:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd52f58 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801261:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd52f58 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801266:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788890977.801269:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd52f58 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801276:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd52f58 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801284:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9250b65f1100) 00010000:00010000:2.0:1788890977.801287:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788890977.801290:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd52f58 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801296:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd52f58 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801308:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52f4a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801313:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52f4a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801323:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52f4a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801327:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788890977.801330:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52f4a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801335:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52f4a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801341:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff925085363400) 00010000:00010000:2.0:1788890977.801343:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890977.801345:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52f4a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801351:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd52f4a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788890977.801358:0:9362:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a76dc43 reply state 0000000065fe95f2 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd52f51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801368:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd52f51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890977.801373:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6274d149 (ffff924f82e34400) 00010000:00010000:2.0:1788890977.801375:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788890977.801377:0:9362:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788890977.801440:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+18:10471:x1875787987834368:12345-192.168.204.26@tcp:36:rm.0 Request processed in 924us (1305us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788890977.801447:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 37 00010000:00010000:3.0:1788890977.801541:0:10314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788890977.801548:0:10314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd52f5f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.801554:0:10314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310000 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788890977.801557:0:10314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd52f5f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.801564:0:10314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd52f5f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.801574:0:10314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9250b65f1100) 00010000:00010000:3.0:1788890977.801576:0:10314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788890977.801579:0:10314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd52f5f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.801584:0:10314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd52f5f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.801601:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890977.801602:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890977.801604:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890977.804875:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890977.804917:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987834624 00000100:00100000:2.0:1788890977.804927:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987834624 00000100:00100000:2.0:1788890977.804986:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:2.0:1788890977.805250:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+18:10471:x1875787987834624:12345-192.168.204.26@tcp:35:rm.0 00000100:00100000:2.0:1788890977.808248:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+19:10471:x1875787987834624:12345-192.168.204.26@tcp:35:rm.0 Request processed in 3241us (3371us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788890977.808261:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:1.0:1788890977.811274:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890977.811378:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987834880 00000100:00100000:3.0:1788890977.811389:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987834880 00000100:00100000:3.0:1788890977.811503:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:3.0:1788890977.811515:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+19:10471:x1875787987834880:12345-192.168.204.26@tcp:36:rm.0 00010000:00010000:3.0:1788890977.811601:0:12407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788890977.811629:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd52f20 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddc6 expref: 19 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.811650:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd52ebe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddda3 expref: 18 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.811661:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff925085363400) 00010000:00010000:3.0:1788890977.811676:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd52e7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd95 expref: 17 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.811684:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925085363800) 00010000:00010000:3.0:1788890977.811689:0:12407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788890977.811716:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd52f66 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.811730:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd52f66 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.811741:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd52f66 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.811786:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52f6d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.811794:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52f6d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.811801:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52f6d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.811895:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52f74 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.811904:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52f74 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.811911:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52f74 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788890977.812169:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788890977.812316:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52f74 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.812324:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52f74 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.812330:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52f74 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.812337:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788890977.812341:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52f74 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.812358:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52f74 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.812368:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9250905a3800) 00010000:00010000:3.0:1788890977.812371:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788890977.812375:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52f74 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.812381:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b600/0xa66601b03fd52f74 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.812401:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd52f66 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.812407:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd52f66 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.812412:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd52f66 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.812417:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788890977.812420:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd52f66 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.812426:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd52f66 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.812432:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250905a3e00) 00010000:00010000:3.0:1788890977.812434:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890977.812437:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd52f66 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.812452:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd52f66 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788890977.812464:0:12407:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc625897 reply state 000000007465afa0 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52f6d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.812475:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52f6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890977.812482:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9250905a3b00) 00010000:00010000:3.0:1788890977.812484:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788890977.812486:0:12407:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788890977.812595:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+18:10471:x1875787987834880:12345-192.168.204.26@tcp:36:rm.0 Request processed in 1080us (1329us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788890977.812604:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 38 00010000:00010000:0.0:1788890978.236266:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890978.941096:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997338752:0@lo:400:kworker.0 00000100:00100000:2.0:1788890978.941170:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890978.941232:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997339264:0@lo:400:kworker.0 00000100:00100000:2.0:1788890978.941258:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890978.941291:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997339776:0@lo:400:kworker.0 00000100:00100000:2.0:1788890978.941315:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890978.941345:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788890978.941351:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997338880:0@lo:400:kworker.0 00000100:00100000:2.0:1788890978.941376:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890978.941397:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1262d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997339392:0@lo:400:kworker.0 00000100:00100000:3.0:1788890978.941415:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997338752 00000100:00100000:3.0:1788890978.941424:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997338752 00000100:00100000:2.0:1788890978.941425:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890978.941445:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997339904:0@lo:400:kworker.0 00000100:00100000:2.0:1788890978.941468:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890978.941477:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997339264 00000100:00100000:3.0:1788890978.941481:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997339264 00000100:00100000:2.0:1788890978.941494:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997339776 00000100:00100000:2.0:1788890978.941500:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997339776 00000100:00100000:3.0:1788890978.941511:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997339392 00000100:00100000:3.0:1788890978.941516:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997339392 00000100:00100000:2.0:1788890978.941547:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997339904 00000100:00100000:2.0:1788890978.941552:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997339904 00000100:00100000:3.0:1788890978.941571:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788890978.941581:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997338752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890978.941632:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997339008:0@lo:400:kworker.0 00000100:00100000:3.0:1788890978.941645:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997338752:12345-0@lo:400:kworker.0 Request processed in 65us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890978.941665:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890978.941680:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997339520:0@lo:400:kworker.0 00000100:00100000:1.0:1788890978.941703:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890978.941710:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997338624:0@lo:400:kworker.0 00000100:00100000:1.0:1788890978.941724:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997340032:0@lo:400:kworker.0 00000100:00100000:1.0:1788890978.942011:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890978.942049:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997339520 00000100:00100000:1.0:1788890978.942053:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997339520 00000100:00100000:1.0:1788890978.942079:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997340032 00000100:00100000:1.0:1788890978.942092:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997340032 00000100:00100000:1.0:1788890978.942114:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788890978.942122:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf784e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997339520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890978.942160:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf784e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997339520:12345-0@lo:400:kworker.0 Request processed in 39us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890978.942168:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788890978.942184:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788890978.942210:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997339008 00000100:00100000:2.0:1788890978.942213:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997339008 00000100:00100000:2.0:1788890978.942238:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788890978.942245:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997339264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890978.942277:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997339264:12345-0@lo:400:kworker.0 Request processed in 33us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890978.942283:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788890978.942296:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788890978.942302:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997339776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890978.942326:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997339776:12345-0@lo:400:kworker.0 Request processed in 24us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890978.942331:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788890978.942343:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788890978.942348:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997339392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890978.942373:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997339392:12345-0@lo:400:kworker.0 Request processed in 25us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890978.942380:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788890978.942394:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788890978.942399:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997339904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890978.942422:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997339904:12345-0@lo:400:kworker.0 Request processed in 23us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890978.942427:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788890978.942437:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788890978.942443:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997339008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890978.942468:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997339008:12345-0@lo:400:kworker.0 Request processed in 26us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890978.942474:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788890978.942501:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997338880 00000100:00100000:2.0:1788890978.942505:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997338880 00000100:00100000:2.0:1788890978.942552:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788890978.942559:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997338880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890978.942590:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997338880:12345-0@lo:400:kworker.0 Request processed in 32us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890978.942596:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1788890978.942630:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788890978.942634:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788890978.942637:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788890978.942640:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788890978.942697:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997338880:0@lo:400:kworker.0 00010000:00080000:2.0:1788890978.942714:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1262d80 x1875787997339392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890978.942726:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1262d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997339392:0@lo:400:kworker.0 00010000:00080000:2.0:1788890978.942735:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf6cf100 x1875787997339904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890978.942744:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997339904:0@lo:400:kworker.0 00000100:00100000:2.0:1788890978.942754:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997338752:0@lo:400:kworker.0 00000100:00100000:2.0:1788890978.942763:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997339264:0@lo:400:kworker.0 00000100:00100000:2.0:1788890978.942772:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997339776:0@lo:400:kworker.0 00000100:00100000:2.0:1788890978.942924:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997339008:0@lo:400:kworker.0 00010000:00080000:2.0:1788890978.942937:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1262300 x1875787997339520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890978.942955:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997339520:0@lo:400:kworker.0 00000100:00100000:1.0:1788890978.943651:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997340032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890978.943730:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997340032:12345-0@lo:400:kworker.0 Request processed in 1540us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890978.943738:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788890978.943941:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890978.944005:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997339136:0@lo:400:kworker.0 00000100:00100000:0.0:1788890978.944053:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890978.944087:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997339648:0@lo:400:kworker.0 00000100:00100000:0.0:1788890978.944116:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890978.944138:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997340160:0@lo:400:kworker.0 00000100:00100000:0.0:1788890978.944161:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890978.944199:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997338624 00000100:00100000:0.0:1788890978.944205:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997338624 00000100:00100000:0.0:1788890978.944247:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788890978.944257:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a92a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3628:x1875787997338624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890978.944265:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788890978.944299:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a92a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3628:x1875787997338624:12345-0@lo:400:kworker.0 Request processed in 44us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890978.944321:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788890978.944353:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997339136 00000100:00100000:0.0:1788890978.944357:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997339136 00000100:00100000:0.0:1788890978.944382:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788890978.944390:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997339136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890978.944451:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997339136:12345-0@lo:400:kworker.0 Request processed in 62us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890978.944458:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788890978.944484:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997339648 00000100:00100000:0.0:1788890978.944488:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997339648 00010000:00080000:2.0:1788890978.944544:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf6cea00 x1875787997340032/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890978.944550:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997340160 00000100:00100000:0.0:1788890978.944555:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997340160 00000100:00100000:2.0:1788890978.944562:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997340032:0@lo:400:kworker.0 00000100:00100000:0.0:1788890978.944580:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788890978.944588:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997339648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890978.944617:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997339648:12345-0@lo:400:kworker.0 Request processed in 32us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890978.944623:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788890978.944642:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788890978.944649:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997340160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890978.944677:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997340160:12345-0@lo:400:kworker.0 Request processed in 29us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890978.944683:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1788890978.944715:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788890978.944718:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788890978.944735:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997338624:0@lo:400:kworker.0 00000100:00100000:0.0:1788890978.944749:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997339136:0@lo:400:kworker.0 00010000:00080000:0.0:1788890978.944944:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf6cc380 x1875787997339648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890978.944955:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997339648:0@lo:400:kworker.0 00010000:00080000:0.0:1788890978.944968:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf6cf480 x1875787997340160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890978.944977:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997340160:0@lo:400:kworker.0 00010000:00010000:3.0:1788890979.260958:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890979.451908:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997340288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788890979.452001:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890979.452631:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997340288 00000100:00100000:3.0:1788890979.452641:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997340288 00000100:00100000:3.0:1788890979.452688:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788890979.452698:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997340288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788890979.452726:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788890979.452790:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997340288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890979.452799:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1788890979.452846:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c12a5f80 x1875787997340288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890979.452868:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997340288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788890979.455339:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788890979.455360:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997340416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788890979.455422:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890979.455493:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997340416 00000100:00100000:3.0:1788890979.455501:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997340416 00000100:00100000:3.0:1788890979.455568:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788890979.455578:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997340416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788890979.455597:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788890979.455647:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997340416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890979.455654:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1788890979.455706:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf784000 x1875787997340416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890979.455724:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997340416:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788890980.283733:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788890980.408097:0:13655:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1788890980.987779:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997340544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788890980.987855:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890980.988022:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997340544 00000100:00100000:2.0:1788890980.988031:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997340544 00000100:00100000:2.0:1788890980.988086:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788890980.988097:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997340544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788890980.988133:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788890980.988178:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997340544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890980.988185:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1788890980.988246:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788890980.988337:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf784a80 x1875787997340544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890980.988358:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997340544:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1788890980.988600:0:8593:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 203233076227ns, next at 204233073677ns, rc = 0 00000100:00100000:2.0:1788890980.988718:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788890980.988728:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997340672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788890980.988770:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890980.989068:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997340672 00000100:00100000:3.0:1788890980.989074:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997340672 00000100:00100000:3.0:1788890980.989117:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788890980.989123:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997340672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788890980.989134:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788890980.989169:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890980.989174:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997340672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890980.989182:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1788890980.989208:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83843800 x1875787997340672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890980.989223:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997340672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788890980.995018:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf785f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997340800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788890980.995098:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890980.995272:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997340800 00000100:00100000:0.0:1788890980.995282:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997340800 00000100:00100000:0.0:1788890980.995371:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788890980.995381:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997340800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788890980.995415:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788890980.995494:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997340800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890980.995502:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788890980.995622:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf785f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997340800:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1788890981.123773:0:13703:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc519a7a0 20000000:00000080:2.0:1788890981.123790:0:13703:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff924f831d3c00 uarg=0000000000000000 20000000:01000000:2.0:1788890981.123834:0:13703:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788890981.123842:0:13703:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788890981.123846:0:13703:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788890981.124780:0:13704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788890981.124958:0:13703:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788890981.130336:0:13703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788890981.130379:0:13703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788890981.130395:0:13703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788890981.130412:0:13703:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788890981.130436:0:13703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff925091a8b600/0xa66601b03fd52f7b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.130457:0:13703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52e08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd80 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.130465:0:13703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250baae5800/0xa66601b03fd52e0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd87 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.130505:0:13703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250baae4e00/0xa66601b03fd52e1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52e16 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.130512:0:13703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250b69c7000/0xa66601b03fd52e2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52e24 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.130519:0:13703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd52e39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52e32 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.131008:0:13703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250b69c7800/0xa66601b03fd52e47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52e40 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.131015:0:13703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff925091a8b600/0xa66601b03fd52f7b lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.131060:0:13703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250b69c7800/0xa66601b03fd52e47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52e40 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.131074:0:13703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250b69c7800/0xa66601b03fd52e47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52e40 expref: 23 pid: 6488 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890981.131091:0:13703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8382c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1875787997340928:0@lo:104: 00000100:00100000:3.0:1788890981.131179:0:13703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788890981.131258:0:13703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd52e39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52e32 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.131267:0:13703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd52e39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52e32 expref: 23 pid: 6491 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890981.131276:0:13703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1875787997341056:0@lo:104: 00010000:00010000:3.0:1788890981.131309:0:13703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250b69c7000/0xa66601b03fd52e2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52e24 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.131318:0:13703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250b69c7000/0xa66601b03fd52e2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52e24 expref: 23 pid: 6488 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890981.131326:0:13703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1875787997341184:0@lo:104: 00010000:00010000:3.0:1788890981.131348:0:13703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250baae4e00/0xa66601b03fd52e1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd52e16 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.131356:0:13703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9250baae4e00/0xa66601b03fd52e1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd52e16 expref: 23 pid: 6491 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890981.131363:0:13703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1875787997341312:0@lo:104: 00010000:00010000:3.0:1788890981.131389:0:13703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250baae5800/0xa66601b03fd52e0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd87 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.131400:0:13703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250baae5800/0xa66601b03fd52e0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd87 expref: 12 pid: 6490 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890981.131409:0:13703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1875787997341440:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788890981.131461:0:13703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd80 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.131470:0:13703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52e08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd80 expref: 12 pid: 6491 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890981.131815:0:13703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1875787997341568:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788890981.131851:0:13703:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847180 going to sleep for 11 seconds 00000100:00100000:1.0:1788890981.131932:0:6480:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788890981.131953:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890981.131982:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890981.131999:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890981.132008:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997340928 00000100:00100000:1.0:1788890981.132014:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997340928 00000100:00100000:1.0:1788890981.132053:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997341056 00000100:00100000:1.0:1788890981.132056:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997341056 00000100:00100000:1.0:1788890981.132066:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997341184 00000100:00100000:1.0:1788890981.132068:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997341184 00000100:00100000:1.0:1788890981.132077:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997341312 00000100:00100000:1.0:1788890981.132079:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997341312 00000100:00100000:1.0:1788890981.132091:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788890981.132100:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+6:13703:x1875787997340928:12345-0@lo:104: 00000100:00100000:3.0:1788890981.132101:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1788890981.132119:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250baae4400/0xa66601b03fd52e40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52e47 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890981.132120:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf784700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+6:13703:x1875787997341056:12345-0@lo:104: 00010000:00010000:3.0:1788890981.132127:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52e32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52e39 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.132227:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788890981.132234:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf784700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+6:13703:x1875787997341056:12345-0@lo:104: Request processed in 115us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890981.132241:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788890981.132260:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788890981.132266:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf785500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+5:13703:x1875787997341184:12345-0@lo:104: 00010000:00010000:3.0:1788890981.132274:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52e24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52e2b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.133434:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788890981.133457:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+5:13703:x1875787997340928:12345-0@lo:104: Request processed in 1356us (2276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890981.133467:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1788890981.133502:0:10314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788890981.133512:0:10314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52e32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52e39 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.133536:0:10314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4a00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788890981.133542:0:10314:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52e32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52e39 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.133554:0:10314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52e32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52e39 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788890981.133562:0:10314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52e32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52e39 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890981.133568:0:10314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788890981.133601:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1788890981.133612:0:10314:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52e32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52e39 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890981.133614:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf787b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:13703:x1875787997341312:12345-0@lo:104: 00010000:00010000:1.0:1788890981.133626:0:10314:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890981.133629:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52e16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52e1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.133650:0:10314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52e32 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52e39 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.133683:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788890981.133688:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf787b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+4:13703:x1875787997341312:12345-0@lo:104: Request processed in 80us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890981.133694:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1788890981.133709:0:10315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788890981.133714:0:10315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250baae4400/0xa66601b03fd52e40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52e47 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.133721:0:10315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4400 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:0.0:1788890981.133724:0:10315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250baae4400/0xa66601b03fd52e40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52e47 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.133731:0:10315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250baae4400/0xa66601b03fd52e40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52e47 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.133806:0:10314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd52e32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52e39 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890981.133810:0:10315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250baae4400/0xa66601b03fd52e40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52e47 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890981.133826:0:10315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788890981.133833:0:10314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788890981.133839:0:10314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52e16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52e1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.133845:0:10315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250baae4400/0xa66601b03fd52e40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52e47 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.133865:0:10314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a000 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788890981.133871:0:10314:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52e16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52e1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.133877:0:10315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788890981.133884:0:10314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52e16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52e1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788890981.133891:0:10314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52e16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52e1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890981.133897:0:10314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788890981.133898:0:10315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250baae4400/0xa66601b03fd52e40 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52e47 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.133908:0:10315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250baae4400/0xa66601b03fd52e40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52e47 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.133916:0:10314:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52e16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52e1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.133919:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890981.133922:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890981.133925:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890981.133927:0:10314:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788890981.133936:0:10314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52e16 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52e1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.133942:0:10314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52e16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52e1d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.133953:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890981.133955:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890981.134011:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997341824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788890981.134047:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788890981.134066:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890981.134084:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788890981.134091:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997341696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788890981.134094:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997341952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788890981.134127:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890981.134159:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997341824 00000100:00100000:1.0:1788890981.134165:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997341824 00010000:00010000:1.0:1788890981.134190:0:10317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250b69c7800/0xa66601b03fd52e47 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52e40 expref: 24 pid: 6488 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890981.134220:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997341696 00000100:00100000:1.0:1788890981.134223:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997341696 00010000:00010000:1.0:1788890981.134236:0:10317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd52e39 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52e32 expref: 25 pid: 6491 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890981.134257:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788890981.134264:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc9e9f5-fe04-4428-a993-651ed6fecbec+25:3627:x1875787997341824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788890981.134277:0:10317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890981.134283:0:10317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250b69c7800/0xa66601b03fd52e47 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52e40 expref: 25 pid: 6488 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.134296:0:10317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250b69c7800/0xa66601b03fd52e47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52e40 expref: 25 pid: 6488 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.134324:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788890981.134332:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf785500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+3:13703:x1875787997341184:12345-0@lo:104: Request processed in 2066us (2349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890981.134340:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1788890981.134360:0:10316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788890981.134364:0:10316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52e24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd52e2b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.134371:0:10316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4800 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:3.0:1788890981.134374:0:10316:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52e24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd52e2b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.134382:0:10316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52e24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd52e2b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.134389:0:10317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:3.0:1788890981.134401:0:10316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52e24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd52e2b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890981.134407:0:10316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788890981.134422:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc9e9f5-fe04-4428-a993-651ed6fecbec+25:3627:x1875787997341824:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890981.134430:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:3.0:1788890981.134432:0:10316:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52e24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52e2b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.134438:0:10316:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788890981.134448:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00010000:00010000:3.0:1788890981.134451:0:10316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52e24 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52e2b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890981.134458:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf786680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3630:x1875787997341696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788890981.134465:0:10316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52e24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd52e2b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.134470:0:10317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890981.134476:0:10317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd52e39 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52e32 expref: 24 pid: 6491 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.134485:0:10317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd52e39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52e32 expref: 24 pid: 6491 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.134494:0:10317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890981.134580:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890981.134613:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997341824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788890981.134621:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf786680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3630:x1875787997341696:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890981.134630:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788890981.134648:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997341952 00000100:00100000:0.0:1788890981.134652:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997341952 00010000:00010000:0.0:1788890981.134669:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250baae4e00/0xa66601b03fd52e1d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52e16 expref: 24 pid: 6491 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890981.134697:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788890981.134704:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3627:x1875787997341952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788890981.134890:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890981.134897:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250baae4e00/0xa66601b03fd52e1d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52e16 expref: 24 pid: 6491 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.134917:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250baae4e00/0xa66601b03fd52e1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52e16 expref: 24 pid: 6491 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.135023:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890981.135026:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890981.135028:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890981.135039:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997342080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788890981.135066:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788890981.135103:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890981.135106:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997342080 00000100:00100000:1.0:1788890981.135112:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997342080 00010000:00010000:1.0:1788890981.135129:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250b69c7000/0xa66601b03fd52e2b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52e24 expref: 25 pid: 6488 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890981.135130:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997341696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788890981.135161:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788890981.135168:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+25:3629:x1875787997342080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788890981.135177:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890981.135178:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788890981.135182:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250b69c7000/0xa66601b03fd52e2b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd52e24 expref: 25 pid: 6488 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.135194:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250b69c7000/0xa66601b03fd52e2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd52e24 expref: 25 pid: 6488 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.135205:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890981.135224:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+25:3627:x1875787997341952:12345-0@lo:103:ldlm_bl.0 Request processed in 519us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890981.135233:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788890981.135242:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+25:3629:x1875787997342080:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890981.135250:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1788890981.135303:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c7800/0xa66601b03fd52e47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52e40 expref: 23 pid: 6488 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890981.135305:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997342080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788890981.135316:0:13703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8382c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1875787997340928:0@lo:104: 00000100:00100000:3.0:1788890981.135331:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997341952:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788890981.135331:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd52e39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52e32 expref: 22 pid: 6491 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890981.135341:0:13703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1875787997341056:0@lo:104: 00010000:00010000:2.0:1788890981.135352:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c7000/0xa66601b03fd52e2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52e24 expref: 21 pid: 6488 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890981.135421:0:13703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1875787997341184:0@lo:104: 00010000:00010000:2.0:1788890981.135434:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae4e00/0xa66601b03fd52e1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd52e16 expref: 20 pid: 6491 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890981.135442:0:13703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1875787997341312:0@lo:104: 00000100:00100000:1.0:1788890981.136916:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890981.136947:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890981.137334:0:13703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1875787997341440:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788890981.137347:0:13703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13703:1875787997341568:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788890981.137467:0:13703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff925091a8b600/0xa66601b03fd52f7b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890981.138721:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987835136 00000100:00100000:3.0:1788890981.138737:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987835136 00010000:00010000:3.0:1788890981.138814:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52e08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd80 expref: 13 pid: 6491 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890981.138893:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 50 00000100:00100000:3.0:1788890981.138904:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf786a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2391:x1875787987835136:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788890981.138993:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890981.139002:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52e08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd80 expref: 13 pid: 6491 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890981.139006:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987835008 00010000:00010000:3.0:1788890981.139020:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd80 expref: 13 pid: 6491 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890981.139023:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987835008 00010000:00010000:3.0:1788890981.139055:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c7e00/0xa66601b03fd52e08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd80 expref: 14 pid: 6491 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.139075:0:10317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250baae5800/0xa66601b03fd52e0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd87 expref: 13 pid: 6490 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.139078:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890981.139127:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:0.0:1788890981.139138:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf785180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2391:x1875787987835008:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890981.139152:0:10317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890981.139158:0:10317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250baae5800/0xa66601b03fd52e0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd87 expref: 13 pid: 6490 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.139170:0:10317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250baae5800/0xa66601b03fd52e0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd87 expref: 13 pid: 6490 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.139196:0:10317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae5800/0xa66601b03fd52e0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd87 expref: 13 pid: 6490 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.139214:0:10317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff925091a8b600/0xa66601b03fd52f7b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.139223:0:10317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8b600/0xa66601b03fd52f7b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890981.139241:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf786a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:2391:x1875787987835136:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 334us (2288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890981.139266:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 50 00010000:00010000:0.0:1788890981.139276:0:10317:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925091a8b600/0xa66601b03fd52f7b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.139287:0:10317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925091a8b600/0xa66601b03fd52f7b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.139294:0:10317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff925091a8b600/0xa66601b03fd52f7b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.139302:0:10317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff925091a8b600/0xa66601b03fd52f7b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.139309:0:10317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788890981.139313:0:10317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff925091a8b600/0xa66601b03fd52f7b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.139320:0:10317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff925091a8b600/0xa66601b03fd52f7b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.139347:0:10317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff925091a8b600/0xa66601b03fd52f7b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.139357:0:10317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890981.139414:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf785180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:2391:x1875787987835008:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 277us (2505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890981.139424:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 51 00010000:00010000:3.0:1788890981.139773:0:13703:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff925091a8b600/0xa66601b03fd52f7b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.140718:0:13703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff925091a8b600/0xa66601b03fd52f7b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890981.140727:0:13703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8b600/0xa66601b03fd52f7b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890981.307646:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788890981.712324:0:13753:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff366d5f00 20000000:00000080:1.0:1788890981.712340:0:13753:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff924f838efc00 uarg=0000000000000000 20000000:01000000:1.0:1788890981.712382:0:13753:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1788890981.712388:0:13753:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1788890981.712394:0:13753:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1788890981.712882:0:13754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1788890981.713041:0:13753:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1788890981.713119:0:13753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1788890981.713147:0:13753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1788890981.713163:0:13753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1788890981.713174:0:13753:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788890981.713195:0:13753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52f82 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.713211:0:13753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52f82 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.713223:0:13753:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52f82 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.713229:0:13753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52f82 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.713235:0:13753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52f82 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.713241:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52f82 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.713248:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6a00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788890981.713252:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52f82 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.713260:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52f82 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.713272:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52f82 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.713281:0:13753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52f82 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.713294:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c6a00/0xa66601b03fd52f82 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890982.013207:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788890982.013399:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997342208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788890982.013489:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890982.014172:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997342208 00000100:00100000:0.0:1788890982.014185:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997342208 00000100:00100000:0.0:1788890982.014291:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788890982.014318:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b70850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997342208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788890982.014364:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788890982.014440:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b70850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997342208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890982.014448:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788890982.014854:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997342208:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788890982.332351:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890982.355892:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890982.357759:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987835264 00000100:00100000:3.0:1788890982.357848:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987835264 00000100:00100000:3.0:1788890982.357926:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 319 00000100:00100000:3.0:1788890982.357952:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92508a92ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:6157:x1875787987835264:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788890982.357969:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890982.357989:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8b600/0xa66601b03fd52f89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204dddd4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890982.358017:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8b600/0xa66601b03fd52f89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddd4 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890982.358029:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8b600/0xa66601b03fd52f89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddd4 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890982.358038:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8b600, rc 0) 00000100:00100000:3.0:1788890982.361949:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92508a92ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:6157:x1875787987835264:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 3984us (6057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890982.361963:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 319 00000100:00100000:2.0:1788890982.364507:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890982.364777:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987835392 00000100:00100000:0.0:1788890982.364790:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987835392 00000100:00100000:0.0:1788890982.364854:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 320 00000100:00100000:0.0:1788890982.364864:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:6157:x1875787987835392:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890982.365158:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:6157:x1875787987835392:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 293us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890982.365166:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 320 00000100:00100000:1.0:1788890982.368214:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890982.368299:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987835520 00000100:00100000:3.0:1788890982.368310:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987835520 00000100:00100000:3.0:1788890982.368363:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 321 00000100:00100000:3.0:1788890982.368373:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:6157:x1875787987835520:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788890982.368505:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:6157:x1875787987835520:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 133us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890982.368513:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 321 00000100:00100000:1.0:1788890982.371725:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890982.371912:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987835648 00000100:00100000:2.0:1788890982.371922:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987835648 00000100:00100000:2.0:1788890982.371977:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 322 00000100:00100000:2.0:1788890982.371987:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:10755:x1875787987835648:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788890982.372265:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:10755:x1875787987835648:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 279us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890982.372274:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 322 00000100:00100000:2.0:1788890982.378389:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890982.378645:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987835776 00000100:00100000:0.0:1788890982.378659:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987835776 00000100:00100000:0.0:1788890982.378735:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 323 00000100:00100000:0.0:1788890982.378746:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:10755:x1875787987835776:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788890982.378971:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:10755:x1875787987835776:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 226us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890982.378981:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 323 00000100:00100000:1.0:1788890982.381755:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890982.382026:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987835904 00000100:00100000:3.0:1788890982.382037:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987835904 00000100:00100000:3.0:1788890982.382098:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 324 00000100:00100000:3.0:1788890982.382109:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:6157:x1875787987835904:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788890982.382144:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890982.382164:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8b800/0xa66601b03fd52f90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddddb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890982.382194:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8b800/0xa66601b03fd52f90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddddb expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890982.382206:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8b800/0xa66601b03fd52f90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddddb expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890982.382216:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8b800, rc 0) 00000100:00100000:3.0:1788890982.382281:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:6157:x1875787987835904:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 173us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890982.382288:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 324 00000100:00100000:1.0:1788890982.384514:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890982.384667:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987836032 00000100:00100000:2.0:1788890982.384679:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987836032 00000100:00100000:2.0:1788890982.384787:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 325 00000100:00100000:2.0:1788890982.384799:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:6157:x1875787987836032:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890982.384975:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:6157:x1875787987836032:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 177us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890982.384983:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 325 00000100:00100000:2.0:1788890982.390125:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890982.390300:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987836160 00000100:00100000:0.0:1788890982.390311:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987836160 00000100:00100000:0.0:1788890982.390373:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 326 00000100:00100000:0.0:1788890982.390383:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:6157:x1875787987836160:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890982.390693:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:6157:x1875787987836160:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 310us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890982.390701:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 326 00000100:00100000:1.0:1788890982.397608:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890982.398184:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987836288 00000100:00100000:2.0:1788890982.398197:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987836288 00000100:00100000:2.0:1788890982.398303:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 327 00000100:00100000:2.0:1788890982.398316:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:10758:x1875787987836288:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788890982.398491:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:10758:x1875787987836288:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 177us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890982.398500:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 327 00000100:00100000:1.0:1788890982.404213:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890982.407039:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987836416 00000100:00100000:0.0:1788890982.407061:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987836416 00000100:00100000:0.0:1788890982.407221:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 328 00000100:00100000:0.0:1788890982.407232:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:10758:x1875787987836416:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788890982.408368:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:10758:x1875787987836416:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 1129us (4159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890982.408380:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 328 00000100:00100000:0.0:1788890982.868631:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890982.868678:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890982.868733:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890982.868759:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987836544 00000100:00100000:3.0:1788890982.868761:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987836800 00000100:00100000:0.0:1788890982.868761:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890982.868772:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987836800 00000100:00100000:2.0:1788890982.868772:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987836544 00000100:00100000:0.0:1788890982.868793:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788890982.868829:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890982.868840:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 329 00000100:00100000:3.0:1788890982.868842:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987837056 00000100:00100000:3.0:1788890982.868848:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987837056 00000100:00100000:1.0:1788890982.868848:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987836672 00000100:00100000:1.0:1788890982.868855:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987836672 00000100:00100000:2.0:1788890982.868856:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2393:x1875787987836544:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890982.868872:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987837184 00000100:00100000:3.0:1788890982.868877:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987837184 00000100:00100000:0.0:1788890982.868878:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987836928 00000100:00100000:0.0:1788890982.868884:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987836928 00000100:00100000:1.0:1788890982.868890:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 138 00000100:00100000:1.0:1788890982.868901:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987836800:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890982.868910:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 139 00000100:00100000:3.0:1788890982.868921:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2393:x1875787987837056:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788890982.868928:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00100000:2.0:1788890982.868935:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2393:x1875787987836544:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 81us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890982.868944:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987836800:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 42us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890982.868945:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987836928:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890982.868960:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 138 00000100:00100000:3.0:1788890982.868963:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2393:x1875787987837056:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 42us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890982.868966:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 329 00000100:00100000:3.0:1788890982.868976:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 139 00000100:00100000:1.0:1788890982.868993:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 140 00000100:00100000:0.0:1788890982.868999:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987836928:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 59us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890982.869006:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 141 00000100:00100000:1.0:1788890982.869007:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+18:2393:x1875787987836672:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788890982.869015:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00100000:3.0:1788890982.869021:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2393:x1875787987837184:12345-192.168.204.26@tcp:400:kworker.0 00000100:00080000:2.0:1788890982.869025:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788890982.869032:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788890982.869037:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788890982.869046:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+18:2393:x1875787987836672:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 44us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890982.869066:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 140 00000100:00100000:3.0:1788890982.869067:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2393:x1875787987837184:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 48us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890982.869078:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 141 10000000:01000000:3.0:1788890983.035666:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788890983.035675:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9250c12de800 from 7 10000000:01000000:3.0:1788890983.035680:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788890983.035787:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd52f97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.035801:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd52f97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.035812:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd52f97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890983.035862:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997342336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788890983.035954:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890983.036025:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250988a90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890983.036041:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997342336 00000100:00100000:0.0:1788890983.036051:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997342336 00000100:00100000:0.0:1788890983.036110:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788890983.036120:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:6493:x1875787997342336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890983.036134:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890983.036147:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae4e00/0xa66601b03fd52f9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52f97 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.036173:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae4e00/0xa66601b03fd52f9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52f97 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.036183:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae4e00/0xa66601b03fd52f9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52f97 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.036193:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4e00, rc 0) 00000100:00100000:0.0:1788890983.036246:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997342336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890983.036253:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788890983.036767:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997342336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788890983.036783:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd52f97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52f9e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.036792:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd52f97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52f9e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890983.036854:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997342464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788890983.036884:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890983.036914:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250988a90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890983.036929:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997342464 00000100:00100000:2.0:1788890983.036936:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997342464 00000100:00100000:2.0:1788890983.036970:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788890983.036978:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997342464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890983.037149:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997342464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890983.037157:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788890983.037217:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997342464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788890983.037243:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997342592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788890983.037280:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890983.037396:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250988a90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890983.037432:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997342592 00000100:00100000:2.0:1788890983.037444:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997342592 00000100:00100000:2.0:1788890983.037474:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788890983.037481:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997342592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890983.037666:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997342592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890983.037839:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788890983.038394:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997342592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890983.039028:0:13766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf785f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:13766:1875787997342720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890983.039088:0:13766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890983.040174:0:13766:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509271fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788890983.040214:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997342720 00000100:00100000:2.0:1788890983.040220:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997342720 00000100:00100000:2.0:1788890983.040307:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788890983.040316:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:13766:x1875787997342720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788890983.040448:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:13766:x1875787997342720:12345-0@lo:502:llog_process_th.0 Request processed in 133us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890983.040455:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788890983.040555:0:13766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf785f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:13766:1875787997342720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788890983.040585:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890983.040594:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890983.040597:0:13766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788890983.040603:0:13766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9250c12de800 00000020:00000080:1.0:1788890983.040606:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788890983.040676:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890983.040680:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890983.040682:0:13766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788890983.040685:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890983.040687:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890983.040688:0:13766:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788890983.040691:0:13766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9250c12de800 00000020:00000080:1.0:1788890983.040694:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788890983.040742:0:13766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf785f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:13766:1875787997342848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890983.040781:0:13766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890983.043723:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997342848 00000100:00100000:0.0:1788890983.043741:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997342848 00000100:00100000:1.0:1788890983.043784:0:13766:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509271fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788890983.043788:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788890983.043800:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:13766:x1875787997342848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890983.044036:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:13766:x1875787997342848:12345-0@lo:502:llog_process_th.0 Request processed in 237us (3253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890983.044045:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788890983.044209:0:13766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf785f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:13766:1875787997342848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788890983.044246:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890983.044254:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890983.044257:0:13766:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788890983.044261:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788890983.044455:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788890983.044479:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788890983.044491:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd52f97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52f9e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.044511:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd52f97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52f9e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890983.044632:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788890983.044635:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9250ba9ab800 from 7 10000000:01000000:0.0:1788890983.044638:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788890983.044671:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52fa5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.044678:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52fa5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.044688:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52fa5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890983.044718:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997342976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788890983.044762:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890983.044821:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83284540 going to sleep for 11 seconds 00000100:00100000:1.0:1788890983.044862:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997342976 00000100:00100000:1.0:1788890983.044873:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997342976 00000100:00100000:1.0:1788890983.044944:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788890983.044952:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:6493:x1875787997342976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890983.044962:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890983.044973:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c7800/0xa66601b03fd52fac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52fa5 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.044995:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c7800/0xa66601b03fd52fac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52fa5 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.045006:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c7800/0xa66601b03fd52fac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52fa5 expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.045014:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7800, rc 0) 00000100:00100000:1.0:1788890983.045050:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997342976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890983.045056:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788890983.045118:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997342976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890983.045131:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52fa5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52fac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.045141:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52fa5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52fac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890983.045210:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997343104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890983.045236:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890983.045258:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83284540 going to sleep for 11 seconds 00000100:00100000:0.0:1788890983.045271:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997343104 00000100:00100000:0.0:1788890983.045275:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997343104 00000100:00100000:0.0:1788890983.045305:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788890983.045312:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997343104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890983.045420:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997343104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890983.045427:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788890983.045462:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997343104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890983.045492:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997343232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890983.045563:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890983.045586:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83284540 going to sleep for 11 seconds 00000100:00100000:2.0:1788890983.045601:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997343232 00000100:00100000:2.0:1788890983.045613:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997343232 00000100:00100000:2.0:1788890983.045644:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788890983.045651:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997343232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890983.045741:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997343232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890983.045748:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1788890983.046279:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997343232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890983.046501:0:13768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:13768:1875787997343360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890983.046588:0:13768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890983.046619:0:13768:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83284f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788890983.046905:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997343360 00000100:00100000:2.0:1788890983.046912:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997343360 00000100:00100000:2.0:1788890983.046956:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788890983.046964:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:13768:x1875787997343360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788890983.047069:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:13768:x1875787997343360:12345-0@lo:502:llog_process_th.0 Request processed in 104us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890983.047076:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788890983.047446:0:13768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:13768:1875787997343360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788890983.047471:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788890983.047482:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890983.047485:0:13768:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788890983.047491:0:13768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9250ba9ab800 00000020:00000080:0.0:1788890983.047494:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788890983.048656:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788890983.048663:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890983.048664:0:13768:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788890983.048667:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788890983.048670:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890983.048671:0:13768:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788890983.048675:0:13768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9250ba9ab800 00000020:00000080:0.0:1788890983.048683:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788890983.048754:0:13768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:13768:1875787997343488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890983.049437:0:13768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890983.049565:0:13768:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83284f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788890983.049749:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997343488 00000100:00100000:1.0:1788890983.049829:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997343488 00000100:00100000:1.0:1788890983.049923:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788890983.049933:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:13768:x1875787997343488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890983.050066:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:13768:x1875787997343488:12345-0@lo:502:llog_process_th.0 Request processed in 135us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890983.050074:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788890983.050154:0:13768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:13768:1875787997343488:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788890983.050182:0:13768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788890983.050189:0:13768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890983.050190:0:13768:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788890983.050195:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788890983.050420:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788890983.050441:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788890983.050451:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52fa5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52fac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.050463:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52fa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52fac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890983.050474:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788890983.050477:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92508475e000 from 7 10000000:01000000:3.0:1788890983.050480:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788890983.050507:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52fb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.050516:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52fb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.050557:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52fb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890983.050581:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997343616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788890983.050616:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890983.050919:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250988a9300 going to sleep for 11 seconds 00000100:00100000:0.0:1788890983.050952:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997343616 00000100:00100000:0.0:1788890983.050957:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997343616 00000100:00100000:0.0:1788890983.050983:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788890983.050990:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:6493:x1875787997343616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890983.051000:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890983.051013:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae4a00/0xa66601b03fd52fba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52fb3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.051037:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae4a00/0xa66601b03fd52fba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52fb3 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.051048:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae4a00/0xa66601b03fd52fba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52fb3 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.051057:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4a00, rc 0) 00000100:00100000:0.0:1788890983.051095:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997343616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890983.051101:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788890983.051135:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997343616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890983.051148:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52fb3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52fba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.051157:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52fb3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52fba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890983.051230:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997343744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890983.051256:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890983.051270:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83284900 going to sleep for 11 seconds 00000100:00100000:0.0:1788890983.051282:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997343744 00000100:00100000:0.0:1788890983.051285:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997343744 00000100:00100000:0.0:1788890983.051301:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788890983.051307:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090450c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997343744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890983.051402:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090450c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997343744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890983.051409:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788890983.051437:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997343744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890983.051466:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997343872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890983.051498:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890983.051512:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b6854a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788890983.051547:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997343872 00000100:00100000:0.0:1788890983.051551:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997343872 00000100:00100000:0.0:1788890983.051568:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788890983.051574:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090453c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997343872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890983.051645:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090453c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997343872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890983.051651:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788890983.051688:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997343872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890983.053078:0:13770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833bea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:13770:1875787997344000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890983.053144:0:13770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890983.053176:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997344000 00000100:00100000:0.0:1788890983.053181:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997344000 00000100:00100000:0.0:1788890983.053210:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788890983.053217:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:13770:x1875787997344000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890983.053310:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:13770:x1875787997344000:12345-0@lo:502:llog_process_th.0 Request processed in 92us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890983.053317:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788890983.053351:0:13770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b6854b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788890983.053367:0:13770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833bea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:13770:1875787997344000:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788890983.053394:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788890983.053403:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890983.053406:0:13770:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788890983.053413:0:13770:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92508475e000 00000020:00000080:0.0:1788890983.053415:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788890983.053475:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890983.053917:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890983.053920:0:13770:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788890983.053925:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890983.053930:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890983.053932:0:13770:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788890983.053941:0:13770:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92508475e000 00000020:00000080:1.0:1788890983.053944:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788890983.053995:0:13770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf785f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:13770:1875787997344128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890983.054039:0:13770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890983.054067:0:13770:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509271f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788890983.054087:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997344128 00000100:00100000:1.0:1788890983.054091:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997344128 00000100:00100000:1.0:1788890983.054118:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788890983.054124:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:13770:x1875787997344128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890983.054208:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:13770:x1875787997344128:12345-0@lo:502:llog_process_th.0 Request processed in 83us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890983.054214:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788890983.054257:0:13770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf785f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:13770:1875787997344128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788890983.054277:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890983.054282:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890983.054284:0:13770:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788890983.056401:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788890983.057221:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788890983.057249:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788890983.057264:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52fb3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52fba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.057276:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52fb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52fba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890983.057287:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788890983.057290:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92509099a000 from 7 10000000:01000000:3.0:1788890983.057293:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788890983.057333:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52fc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.057341:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52fc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.057352:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52fc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890983.057377:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997344256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788890983.057450:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890983.057501:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997344256 00000100:00100000:3.0:1788890983.057504:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250988a9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788890983.057510:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997344256 00000100:00100000:1.0:1788890983.057643:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788890983.057653:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:6493:x1875787997344256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890983.057666:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890983.057679:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c6400/0xa66601b03fd52fc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd52fc1 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.057720:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c6400/0xa66601b03fd52fc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd52fc1 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.057744:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c6400/0xa66601b03fd52fc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd52fc1 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.057754:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6400, rc 0) 00000100:00100000:1.0:1788890983.057823:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:6493:x1875787997344256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890983.057831:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788890983.057916:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997344256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890983.057930:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52fc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52fc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.057940:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52fc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52fc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890983.058001:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997344384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890983.058030:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890983.058060:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b6854b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788890983.058070:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997344384 00000100:00100000:3.0:1788890983.058075:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997344384 00000100:00100000:3.0:1788890983.058223:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788890983.058232:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:6493:x1875787997344384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788890983.058470:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:6493:x1875787997344384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890983.058477:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788890983.058553:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997344384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890983.058586:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997344512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890983.058627:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890983.058655:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890983.058656:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997344512 00000100:00100000:1.0:1788890983.058660:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997344512 00000100:00100000:1.0:1788890983.058691:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788890983.058699:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:6493:x1875787997344512:12345-0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788890983.059796:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788890983.059848:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:6493:x1875787997344512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1147us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890983.059857:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788890983.059997:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0dc9e9f5-fe04-4428-a993-651ed6fecbec:6493:1875787997344512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788890983.061954:0:13772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:13772:1875787997344640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788890983.062030:0:13772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890983.062071:0:13772:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250988a96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890983.062331:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997344640 00000100:00100000:0.0:1788890983.062338:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997344640 00000100:00100000:0.0:1788890983.062384:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788890983.062392:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:13772:x1875787997344640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890983.062566:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:13772:x1875787997344640:12345-0@lo:502:llog_process_th.0 Request processed in 173us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890983.062574:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788890983.062887:0:13772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:13772:1875787997344640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788890983.062923:0:13772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788890983.062933:0:13772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890983.062935:0:13772:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788890983.062944:0:13772:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92509099a000 00000020:00000080:3.0:1788890983.062947:0:13772:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788890983.063011:0:13772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788890983.063014:0:13772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890983.063015:0:13772:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788890983.063018:0:13772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788890983.063020:0:13772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890983.063022:0:13772:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788890983.063025:0:13772:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92509099a000 00000020:00000080:3.0:1788890983.063027:0:13772:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788890983.063074:0:13772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:13772:1875787997344768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788890983.063120:0:13772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890983.063145:0:13772:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250988a96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890983.064342:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997344768 00000100:00100000:0.0:1788890983.064353:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997344768 00000100:00100000:0.0:1788890983.064402:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788890983.064412:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:13772:x1875787997344768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890983.064585:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:13772:x1875787997344768:12345-0@lo:502:llog_process_th.0 Request processed in 173us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890983.064592:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788890983.064802:0:13772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0dc9e9f5-fe04-4428-a993-651ed6fecbec:13772:1875787997344768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788890983.064834:0:13772:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788890983.064842:0:13772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890983.064844:0:13772:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788890983.064849:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788890983.065089:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788890983.065124:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788890983.065135:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52fc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52fc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.065145:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52fc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52fc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788890983.080902:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788890983.355992:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788890983.550478:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1c240b24-a098-4d30-bfbf-dd53172bbf52 00000020:00000080:3.0:1788890983.550491:0:9489:0:(genops.c:885:class_export_put()) final put ffff924f832d8000/1c240b24-a098-4d30-bfbf-dd53172bbf52 00000020:00000080:1.0:1788890983.551098:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f832d8000/1c240b24-a098-4d30-bfbf-dd53172bbf52 for lustre-OST0001 00000020:00000080:1.0:1788890983.551171:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f832dc000 for lustre-OST0001 00000004:00080000:2.0:1788890983.551710:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788890983.551764:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1788890983.551776:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1788890983.552009:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd52ed3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552034:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd52ed3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552043:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd52ed3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552050:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788890983.552057:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd52ed3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552066:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd52ed3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552090:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6274d149 (ffff924f82e34400) 00010000:00010000:3.0:1788890983.552093:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890983.552100:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd52ed3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552108:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd52ed3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552134:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd52ee8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552141:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd52ee8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552147:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd52ee8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552153:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788890983.552164:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd52ee8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552171:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd52ee8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552181:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9250b65f1100) 00010000:00010000:3.0:1788890983.552184:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890983.552187:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd52ee8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552194:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd52ee8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552218:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd52f51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552225:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd52f51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552231:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd52f51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552236:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788890983.552240:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd52f51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552245:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd52f51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552254:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6274d149 (ffff924f82e34400) 00010000:00010000:3.0:1788890983.552257:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890983.552267:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd52f51 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552273:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd52f51 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6274d149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552295:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52f6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552303:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52f6d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552310:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52f6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890983.552314:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1788890983.552316:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8ac00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788890983.552323:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52f6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552328:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52f6d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552337:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9250905a3b00) 00010000:00010000:3.0:1788890983.552339:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890983.552343:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52f6d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552349:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52f6d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890983.552390:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997344896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788890983.552596:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890983.552645:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997344896 00000100:00100000:3.0:1788890983.552655:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997344896 00000100:00080000:1.0:1788890983.552710:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890983.552737:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788890983.552756:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf785f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997344896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788890983.552789:0:8411:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1788890983.552830:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa04f61, atime: 0x6aa04f61, ctime: 0x6aa04f61, blocks: 0x0 00010000:00010000:3.0:1788890983.552838:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6f82fab/0xa66601b03fd52fcf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788890983.552851:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1c240b24-a098-4d30-bfbf-dd53172bbf52 00010000:00010000:3.0:1788890983.552856:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=205s v=(0 0) 00000020:00000080:0.0:1788890983.552859:0:8404:0:(genops.c:885:class_export_put()) final put ffff924f82216800/1c240b24-a098-4d30-bfbf-dd53172bbf52 00010000:00010000:3.0:1788890983.552874:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890983.552883:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6f82fab/0xa66601b03fd52fcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552903:0:8411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6f82fab/0xa66601b03fd52fcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552913:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6f82fab/0xa66601b03fd52fcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552921:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6f82fab/0xa66601b03fd52fcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.552945:0:8411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788890983.553132:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf785f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3628:x1875787997344896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 378us (536us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788890983.553140:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:1.0:1788890983.553481:0:3628:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff924f833bd180/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788890983.553489:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997344896:0@lo:6:osp-syn-0-0.0 00000020:00000080:1.0:1788890983.553508:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f82216800/1c240b24-a098-4d30-bfbf-dd53172bbf52 for lustre-OST0000 00010000:00010000:0.0:1788890983.553508:0:10316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788890983.553546:0:10316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6f82fab/0xa66601b03fd52fcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.553558:0:10316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788890983.553562:0:10316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6f82fab/0xa66601b03fd52fcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.553572:0:10316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6f82fab/0xa66601b03fd52fcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.553610:0:10316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6f82fab/0xa66601b03fd52fcf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.553619:0:10316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6f82fab/0xa66601b03fd52fcf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.553637:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890983.553639:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890983.553641:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788890983.553729:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f82215000 for lustre-OST0000 00000100:00100000:0.0:1788890984.059865:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997345024:0@lo:400:kworker.0 00000100:00100000:3.0:1788890984.059915:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997345280:0@lo:400:kworker.0 00000100:00100000:1.0:1788890984.060021:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997345152:0@lo:400:kworker.0 00000100:00100000:2.0:1788890984.060050:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997345408:0@lo:400:kworker.0 00000100:00100000:1.0:1788890984.060079:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890984.060154:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890984.060160:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997345664:0@lo:400:kworker.0 00000100:00100000:2.0:1788890984.060209:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997345920:0@lo:400:kworker.0 00000100:00100000:2.0:1788890984.060752:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890984.060786:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997346432:0@lo:400:kworker.0 00000100:00100000:2.0:1788890984.060814:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890984.060853:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788890984.060863:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890984.060873:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997345536:0@lo:400:kworker.0 00000100:00100000:1.0:1788890984.061019:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890984.061231:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997345920 00000100:00100000:0.0:1788890984.061242:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997345920 00000100:00100000:0.0:1788890984.061306:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997346432 00000100:00100000:0.0:1788890984.061308:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997346432 00000100:00100000:0.0:1788890984.061330:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788890984.061340:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997345920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890984.061361:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997346176:0@lo:400:kworker.0 00000100:00100000:1.0:1788890984.061405:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890984.061414:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997345920:12345-0@lo:400:kworker.0 Request processed in 73us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890984.061424:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788890984.061434:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788890984.061444:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788890984.061445:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997345792:0@lo:400:kworker.0 00000100:00100000:0.0:1788890984.061454:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997346432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890984.061473:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890984.061488:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997346432:12345-0@lo:400:kworker.0 Request processed in 36us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890984.061495:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788890984.061518:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890984.061573:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997346048:0@lo:400:kworker.0 00000100:00100000:2.0:1788890984.061606:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890984.061636:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997346560:0@lo:400:kworker.0 00000100:00100000:2.0:1788890984.061667:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890984.061674:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997346304:0@lo:400:kworker.0 00000100:00100000:1.0:1788890984.061724:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890984.061753:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997345152 00000100:00100000:1.0:1788890984.061757:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997345152 00000100:00100000:1.0:1788890984.061785:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997345408 00000100:00100000:1.0:1788890984.061789:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997345408 00000100:00100000:1.0:1788890984.061800:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997345664 00000100:00100000:1.0:1788890984.061802:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997345664 00000100:00100000:1.0:1788890984.061815:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997346176 00000100:00100000:1.0:1788890984.061818:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997346176 00000100:00100000:1.0:1788890984.061844:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997345792 00000100:00100000:1.0:1788890984.061847:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997345792 00000100:00100000:1.0:1788890984.061859:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997346304 00000100:00100000:1.0:1788890984.061862:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997346304 00000100:00100000:1.0:1788890984.061875:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788890984.061882:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997345152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890984.061927:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997345152:12345-0@lo:400:kworker.0 Request processed in 45us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890984.061934:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788890984.061971:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890984.062068:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788890984.062089:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997345408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890984.062093:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788890984.062108:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997345664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890984.062121:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997345920:0@lo:400:kworker.0 00010000:00080000:2.0:1788890984.062149:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bab60a80 x1875787997346432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788891000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890984.062162:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997346432:0@lo:400:kworker.0 00000100:00100000:3.0:1788890984.062167:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997345408:12345-0@lo:400:kworker.0 Request processed in 88us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890984.062177:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788890984.062197:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997345408:0@lo:400:kworker.0 00000100:00100000:3.0:1788890984.062204:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788890984.062214:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997346176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890984.062228:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788890984.062241:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997345792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890984.062272:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997346176:12345-0@lo:400:kworker.0 Request processed in 59us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890984.062280:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788890984.062301:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997345664:12345-0@lo:400:kworker.0 Request processed in 195us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890984.062317:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788890984.062317:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997345792:12345-0@lo:400:kworker.0 Request processed in 71us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890984.062330:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788890984.062339:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997346304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890984.062344:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00010000:00080000:1.0:1788890984.062392:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f831d8700 x1875787997345792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890984.062393:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997346304:12345-0@lo:400:kworker.0 Request processed in 62us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890984.062397:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997345536 00000100:00100000:2.0:1788890984.062410:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997345536 00000100:00100000:3.0:1788890984.062425:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788890984.062432:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997345792:0@lo:400:kworker.0 00000100:00100000:2.0:1788890984.062457:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997345280 00000100:00100000:2.0:1788890984.062464:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997345280 00010000:00080000:1.0:1788890984.062464:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82e52a00 x1875787997346304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890984.062479:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997346304:0@lo:400:kworker.0 00000100:00100000:2.0:1788890984.062489:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788890984.062496:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997345536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890984.062560:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997345536:12345-0@lo:400:kworker.0 Request processed in 64us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890984.062567:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788890984.062580:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788890984.062586:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997345280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890984.062619:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997345280:12345-0@lo:400:kworker.0 Request processed in 34us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890984.062624:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788890984.062656:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997345536:0@lo:400:kworker.0 00000100:00100000:1.0:1788890984.062716:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997345152:0@lo:400:kworker.0 00000100:00100000:2.0:1788890984.062723:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997345280:0@lo:400:kworker.0 00000100:00100000:1.0:1788890984.062743:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997345664:0@lo:400:kworker.0 00000100:00100000:1.0:1788890984.062759:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997346176:0@lo:400:kworker.0 00000100:00100000:0.0:1788890984.063577:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997346048 00000100:00100000:0.0:1788890984.063585:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997346048 00000100:00100000:1.0:1788890984.064246:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997346560 00000100:00100000:0.0:1788890984.064263:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788890984.064265:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997346560 00000100:00100000:0.0:1788890984.064279:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3627:x1875787997346048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890984.064305:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788890984.064314:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997346560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890984.064467:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3627:x1875787997346048:12345-0@lo:400:kworker.0 Request processed in 193us (2859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890984.064480:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997346560:12345-0@lo:400:kworker.0 Request processed in 158us (2804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890984.064485:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788890984.064498:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788890984.064573:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997346048:0@lo:400:kworker.0 00010000:00080000:0.0:1788890984.064591:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83166a00 x1875787997346560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788891000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890984.064602:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997346560:0@lo:400:kworker.0 00000100:00080000:3.0:1788890984.065086:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788890984.065092:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788890984.065096:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788890984.065099:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890984.065119:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997345024 00000100:00100000:3.0:1788890984.065125:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997345024 00000100:00100000:3.0:1788890984.065165:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788890984.065176:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3628:x1875787997345024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890984.065237:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3628:x1875787997345024:12345-0@lo:400:kworker.0 Request processed in 65us (4382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890984.065245:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788890984.065673:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997345024:0@lo:400:kworker.0 00000040:00080000:0.0:1788890984.124239:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788890984.124917:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788890984.379824:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890984.572056:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997346688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788890984.572145:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997346816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788890984.572200:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890984.572259:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890984.572282:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997346688 00000100:00100000:0.0:1788890984.572290:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997346688 00000100:00100000:3.0:1788890984.572319:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997346816 00000100:00100000:3.0:1788890984.572330:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997346816 00000100:00100000:0.0:1788890984.572340:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788890984.572351:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997346688:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788890984.572359:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788890984.572368:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997346816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788890984.572383:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1788890984.572385:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788890984.572434:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997346688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890984.572440:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1788890984.572475:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82e52300 x1875787997346688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890984.572492:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997346688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788890984.573930:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997346816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1557us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890984.573939:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1788890984.574021:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c12a7100 x1875787997346816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890984.574041:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997346816:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788890985.404359:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890986.107911:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997347200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788890986.108017:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890986.108099:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997347200 00000100:00100000:1.0:1788890986.108106:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997347200 00000100:00100000:0.0:1788890986.108163:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997347072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788890986.108200:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890986.108229:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788890986.108235:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997346944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788890986.108256:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890986.108283:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997346944 00000100:00100000:0.0:1788890986.108288:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997346944 00000100:00100000:2.0:1788890986.112975:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997347072 00000100:00100000:2.0:1788890986.112991:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997347072 00000100:00100000:2.0:1788890986.113057:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788890986.113069:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997347072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788890986.113122:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788890986.113365:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997347072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 297us (5162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890986.113385:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788890986.113424:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788890986.113442:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997347200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788890986.113465:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788890986.113508:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997347200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (5491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890986.113515:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788890986.113577:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997347200:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788890986.114636:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788890986.114714:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997347072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788890986.114860:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788890986.114870:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1875787997346944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788890986.114886:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788890986.115031:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1875787997346944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (6773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890986.115040:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788890986.115479:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997346944:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788890986.428743:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890987.131995:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997347328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788890987.132076:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890987.132298:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997347328 00000100:00100000:0.0:1788890987.132306:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997347328 00000100:00100000:0.0:1788890987.132349:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788890987.132358:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997347328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788890987.132392:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788890987.132444:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997347328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890987.132451:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788890987.132548:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997347328:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788890987.452581:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890987.984267:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890987.984322:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890987.984356:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890987.984389:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890987.984408:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890987.984445:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890987.984579:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987837568 00000100:00100000:2.0:1788890987.984583:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987837824 00000100:00100000:2.0:1788890987.984591:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987837824 00000100:00100000:3.0:1788890987.984592:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987837568 00000100:00100000:3.0:1788890987.984680:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987837440 00000100:00080000:1.0:1788890987.984681:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788890987.984685:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987837440 00000100:00080000:1.0:1788890987.984687:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788890987.984747:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788890987.984778:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987837952 00000100:00100000:1.0:1788890987.984782:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987837952 00000100:00100000:0.0:1788890987.984893:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987837312 00000100:00100000:0.0:1788890987.984897:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987837312 00000100:00100000:0.0:1788890987.984942:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 351 00000100:00100000:0.0:1788890987.984953:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2391:x1875787987837312:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788890987.985033:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2391:x1875787987837312:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 82us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890987.985041:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 351 00000100:00100000:0.0:1788890987.985208:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 148 00000100:00100000:0.0:1788890987.985216:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+5:2391:x1875787987837568:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788890987.985251:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+5:2391:x1875787987837568:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 37us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890987.985258:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 148 00000100:00100000:2.0:1788890987.985660:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 149 00000100:00100000:2.0:1788890987.985670:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2391:x1875787987837824:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788890987.985701:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2391:x1875787987837824:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 34us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890987.985708:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 149 00000100:00100000:2.0:1788890987.985741:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987837696 00000100:00100000:2.0:1788890987.985745:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987837696 00000100:00100000:2.0:1788890987.985776:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00100000:2.0:1788890987.985784:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+5:2391:x1875787987837696:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788890987.985812:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+5:2391:x1875787987837696:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 29us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890987.985924:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 150 00000100:00100000:3.0:1788890987.985935:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+5:2391:x1875787987837440:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890987.985966:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+5:2391:x1875787987837440:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 34us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890987.985976:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 150 00000100:00100000:2.0:1788890987.985976:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00080000:3.0:1788890987.986025:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788890987.986030:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788890987.986633:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 151 00000100:00100000:1.0:1788890987.986646:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2391:x1875787987837952:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890987.986698:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2391:x1875787987837952:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 56us (2251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890987.986705:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 151 00010000:00010000:0.0:1788890988.475760:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890989.180649:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997347712:0@lo:400:kworker.0 00000100:00100000:1.0:1788890989.180686:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997347840:0@lo:400:kworker.0 00000100:00100000:2.0:1788890989.180734:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997347584:0@lo:400:kworker.0 00000100:00100000:0.0:1788890989.180742:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890989.180748:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890989.180863:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997347456:0@lo:400:kworker.0 00000100:00100000:0.0:1788890989.180907:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997348224:0@lo:400:kworker.0 00000100:00100000:2.0:1788890989.181316:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890989.181398:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997347840 00000100:00100000:1.0:1788890989.181407:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997347840 00000100:00100000:1.0:1788890989.181676:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997347584 00000100:00100000:1.0:1788890989.181681:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997347584 00000100:00100000:1.0:1788890989.181702:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788890989.181710:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997347840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890989.182219:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890989.182263:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890989.182291:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997347968:0@lo:400:kworker.0 00000100:00100000:0.0:1788890989.182329:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997348736:0@lo:400:kworker.0 00000100:00100000:3.0:1788890989.182346:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890989.182381:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890989.182386:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997348480:0@lo:400:kworker.0 00000100:00100000:0.0:1788890989.182429:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997347712 00000100:00100000:0.0:1788890989.182437:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997347712 00000100:00100000:3.0:1788890989.182451:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890989.182481:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997347968 00000100:00100000:3.0:1788890989.182485:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997348992:0@lo:400:kworker.0 00000100:00100000:0.0:1788890989.182487:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997347968 00000100:00100000:0.0:1788890989.182519:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788890989.182562:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890989.182564:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997347712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890989.182650:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997347456 00000100:00100000:0.0:1788890989.182655:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997347712:12345-0@lo:400:kworker.0 Request processed in 101us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890989.182660:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997347456 00000100:00100000:0.0:1788890989.182668:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788890989.182696:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788890989.182723:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788890989.182730:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997347968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890989.182736:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3627:x1875787997347456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890989.182817:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3627:x1875787997347456:12345-0@lo:400:kworker.0 Request processed in 82us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890989.182827:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788890989.182837:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997348096:0@lo:400:kworker.0 00000100:00100000:2.0:1788890989.182886:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890989.182901:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997348224 00000100:00100000:3.0:1788890989.182909:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997348224 00000100:00100000:2.0:1788890989.182915:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1875787997348608:0@lo:400:kworker.0 00000100:00100000:0.0:1788890989.182940:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997347968:12345-0@lo:400:kworker.0 Request processed in 215us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890989.182950:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788890989.182959:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997347840:12345-0@lo:400:kworker.0 Request processed in 1247us (2212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890989.182964:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997348736 00000100:00100000:3.0:1788890989.182971:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997348736 00000100:00100000:1.0:1788890989.182990:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788890989.182994:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997348096 00000100:00100000:0.0:1788890989.183000:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997348096 00000100:00100000:3.0:1788890989.183016:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788890989.183027:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997347584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890989.183075:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997347584:12345-0@lo:400:kworker.0 Request processed in 50us (1760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890989.183095:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788890989.183112:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997348224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890989.183159:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997348224:12345-0@lo:400:kworker.0 Request processed in 54us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890989.183166:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788890989.183177:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890989.183185:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788890989.183193:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997348736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890989.183220:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997347584:0@lo:400:kworker.0 00000100:00100000:1.0:1788890989.183230:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997348736:12345-0@lo:400:kworker.0 Request processed in 37us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890989.183237:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788890989.183250:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997348608 00000100:00100000:1.0:1788890989.183253:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997348608 00000100:00100000:1.0:1788890989.183270:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788890989.183276:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875787997348608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890989.183346:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875787997348608:12345-0@lo:400:kworker.0 Request processed in 69us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890989.183355:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788890989.183388:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997348480 00000100:00100000:1.0:1788890989.183393:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997348480 00000100:00100000:1.0:1788890989.183429:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997348992 00000100:00100000:1.0:1788890989.183432:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997348992 00000100:00100000:2.0:1788890989.183441:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788890989.183452:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3627:x1875787997348480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890989.183460:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788890989.183470:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997348992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890989.183515:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997348992:12345-0@lo:400:kworker.0 Request processed in 48us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890989.183558:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788890989.183608:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997347840:0@lo:400:kworker.0 00000100:00100000:1.0:1788890989.183617:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997348352:0@lo:400:kworker.0 00000100:00100000:1.0:1788890989.183645:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890989.183666:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997348864:0@lo:400:kworker.0 00000100:00100000:1.0:1788890989.183690:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890989.183709:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997348352 00000100:00100000:1.0:1788890989.183712:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997348352 00000100:00100000:0.0:1788890989.183735:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788890989.183749:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875787997348096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890989.183750:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3627:x1875787997348480:12345-0@lo:400:kworker.0 Request processed in 296us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890989.183766:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788890989.183782:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997348864 00000100:00100000:2.0:1788890989.183786:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997348864 00000100:00100000:1.0:1788890989.183805:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788890989.183805:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875787997348096:12345-0@lo:400:kworker.0 Request processed in 62us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890989.183814:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788890989.183898:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788890989.183899:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997348352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890989.183910:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997348864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890989.183941:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997348352:12345-0@lo:400:kworker.0 Request processed in 127us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890989.183949:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788890989.183958:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997348864:12345-0@lo:400:kworker.0 Request processed in 49us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890989.183965:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:1.0:1788890989.183987:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf6a6300 x1875787997348864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788891005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890989.184001:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788890989.184002:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997348864:0@lo:400:kworker.0 00000100:00100000:2.0:1788890989.184016:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997348096:0@lo:400:kworker.0 00000100:00100000:1.0:1788890989.184046:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997348352:0@lo:400:kworker.0 00000100:00100000:2.0:1788890989.184047:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1875787997348608:0@lo:400:kworker.0 00000100:00080000:3.0:1788890989.184057:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788890989.184068:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788890989.184073:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788890989.184078:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788890989.184126:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997347456:0@lo:400:kworker.0 00000100:00100000:1.0:1788890989.184140:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997347968:0@lo:400:kworker.0 00000100:00100000:1.0:1788890989.184152:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997348480:0@lo:400:kworker.0 00010000:00080000:1.0:1788890989.184164:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1c16680 x1875787997348992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788891005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890989.184192:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997348992:0@lo:400:kworker.0 00010000:00080000:0.0:1788890989.184278:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf6a5880 x1875787997348736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890989.184290:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997348736:0@lo:400:kworker.0 00000100:00100000:0.0:1788890989.184307:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997347712:0@lo:400:kworker.0 00010000:00080000:0.0:1788890989.184318:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e75f80 x1875787997348224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890989.184326:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997348224:0@lo:400:kworker.0 00010000:00010000:3.0:1788890989.503539:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890989.691987:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788890989.692011:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997349120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788890989.692088:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890989.692155:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997349120 00000100:00100000:1.0:1788890989.692162:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997349120 00000100:00100000:1.0:1788890989.692209:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788890989.692217:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997349120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788890989.692246:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788890989.692295:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997349120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890989.692302:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1788890989.692722:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c12a4a80 x1875787997349120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890989.692924:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997349248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788890989.692957:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890989.693044:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997349248 00000100:00100000:2.0:1788890989.693049:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997349248 00000100:00100000:2.0:1788890989.693085:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788890989.693092:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090310a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997349248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788890989.693104:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788890989.693139:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090310a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997349248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890989.693145:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1788890989.693169:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c12a4700 x1875787997349248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890989.693190:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997349248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788890989.693616:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997349120:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1788890989.695207:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:0.0:1788890990.524937:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890991.228365:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788890991.228401:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997349376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788890991.228498:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890991.228858:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997349376 00000100:00100000:1.0:1788890991.228881:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997349376 00000100:00100000:3.0:1788890991.228915:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997349504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788890991.228972:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788890991.229020:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788890991.229103:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997349632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788890991.229139:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890991.229256:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997349632 00000100:00100000:2.0:1788890991.229263:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997349632 00000100:00100000:2.0:1788890991.229321:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788890991.229332:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997349632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788890991.229377:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788890991.229432:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997349632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890991.229440:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788890991.230930:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997349504 00000100:00100000:1.0:1788890991.230947:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997349504 00000100:00080000:3.0:1788890991.231039:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788890991.231048:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788890991.231060:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997349376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788890991.231106:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788890991.231144:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997349632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788890991.231243:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788890991.231257:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997349504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788890991.231277:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788890991.231421:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788890991.231428:0:3629:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff924f833bd180, transno 4294967301 00000100:00100000:3.0:1788890991.231449:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997349376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788890991.231475:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997349376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 415us (2974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890991.231501:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788890991.231824:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997349504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 569us (2850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890991.231834:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788890991.231928:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997349504:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788890991.549148:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890992.256125:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788890992.256149:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997349760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788890992.256226:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890992.256355:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997349760 00000100:00100000:0.0:1788890992.256375:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997349760 00000100:00100000:0.0:1788890992.256423:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788890992.256433:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997349760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788890992.256469:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788890992.256563:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997349760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890992.256572:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788890992.257463:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997349760:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788890992.571848:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890993.104368:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890993.104424:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890993.104455:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987838208 00000100:00100000:1.0:1788890993.104466:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987838208 00000100:00100000:3.0:1788890993.104468:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890993.104499:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890993.104571:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890993.104633:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987838080 00000100:00100000:2.0:1788890993.104638:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987838080 00000100:00100000:2.0:1788890993.104681:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 353 00000100:00100000:2.0:1788890993.104700:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2391:x1875787987838080:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788890993.104901:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2391:x1875787987838080:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 211us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890993.104910:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 353 00000100:00100000:3.0:1788890993.105355:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890993.106966:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987838336 00000100:00100000:1.0:1788890993.106975:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987838336 00000100:00100000:1.0:1788890993.107028:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987838720 00000100:00100000:1.0:1788890993.107032:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987838720 00000100:00100000:1.0:1788890993.107054:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 158 00000100:00100000:1.0:1788890993.107063:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987838208:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890993.107126:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987838208:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 64us (2767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890993.107133:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 158 00000100:00100000:1.0:1788890993.107149:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 159 00000100:00100000:1.0:1788890993.107215:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+5:2391:x1875787987838336:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890993.107244:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+5:2391:x1875787987838336:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 89us (2745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890993.107250:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 159 00000100:00100000:1.0:1788890993.107368:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 160 00000100:00100000:1.0:1788890993.107377:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2392:x1875787987838720:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890993.107401:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2392:x1875787987838720:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 26us (2830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890993.107418:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 160 00000100:00100000:1.0:1788890993.107443:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987838464 00000100:00100000:1.0:1788890993.107446:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987838464 00000100:00100000:1.0:1788890993.107475:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 83 00000100:00100000:1.0:1788890993.107482:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987838464:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890993.107735:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987838464:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 252us (3266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890993.107742:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 83 00000100:00080000:1.0:1788890993.107874:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788890993.107880:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788890993.107882:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788890993.113484:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987838592 00000100:00100000:1.0:1788890993.113498:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987838592 00000100:00100000:1.0:1788890993.113656:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 161 00000100:00100000:1.0:1788890993.113666:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2391:x1875787987838592:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890993.113743:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2391:x1875787987838592:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 78us (8387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890993.113751:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 161 00000100:00080000:3.0:1788890993.113963:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788890993.596692:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890994.301009:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997350016:0@lo:400:kworker.0 00000100:00100000:0.0:1788890994.301095:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890994.301161:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997350528:0@lo:400:kworker.0 00000100:00100000:1.0:1788890994.301182:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997350016 00000100:00100000:0.0:1788890994.301189:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890994.301192:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997350016 00000100:00100000:0.0:1788890994.301226:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997351040:0@lo:400:kworker.0 00000100:00100000:1.0:1788890994.301245:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997350528 00000100:00100000:1.0:1788890994.301250:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997350528 00000100:00100000:0.0:1788890994.301255:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890994.301282:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788890994.301283:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997351040 00000100:00100000:1.0:1788890994.301288:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997351040 00000100:00100000:0.0:1788890994.301291:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997350144:0@lo:400:kworker.0 00000100:00100000:1.0:1788890994.301309:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788890994.301321:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997350016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890994.301322:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890994.301343:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997350656:0@lo:400:kworker.0 00000100:00100000:0.0:1788890994.301377:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890994.301388:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997350016:12345-0@lo:400:kworker.0 Request processed in 69us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890994.301396:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997351168:0@lo:400:kworker.0 00000100:00100000:1.0:1788890994.301414:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788890994.301421:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890994.301436:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997350656 00000100:00100000:1.0:1788890994.301442:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997350656 00000100:00100000:0.0:1788890994.301452:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997350016:0@lo:400:kworker.0 00000100:00100000:1.0:1788890994.301463:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997351168 00000100:00100000:1.0:1788890994.301468:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997351168 00000100:00100000:1.0:1788890994.301496:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788890994.301503:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997350528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890994.301561:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997349888:0@lo:400:kworker.0 00000100:00100000:1.0:1788890994.301573:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997350528:12345-0@lo:400:kworker.0 Request processed in 69us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890994.301581:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788890994.301597:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788890994.301601:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890994.301608:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997351040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890994.301642:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997350400:0@lo:400:kworker.0 00000100:00100000:1.0:1788890994.301649:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997351040:12345-0@lo:400:kworker.0 Request processed in 42us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890994.301656:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788890994.301673:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788890994.301675:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890994.301683:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997350656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890994.301698:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997350912:0@lo:400:kworker.0 00000100:00100000:1.0:1788890994.301721:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997350656:12345-0@lo:400:kworker.0 Request processed in 39us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890994.301728:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788890994.301738:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890994.301743:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788890994.301752:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997351168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890994.301762:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997351424:0@lo:400:kworker.0 00000100:00100000:1.0:1788890994.301791:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997351168:12345-0@lo:400:kworker.0 Request processed in 40us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890994.301799:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890994.301803:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788890994.301824:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788890994.301833:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997350272:0@lo:400:kworker.0 00000100:00100000:0.0:1788890994.301861:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788890994.301867:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e75f80 x1875787997350656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890994.301880:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997350656:0@lo:400:kworker.0 00000100:00100000:0.0:1788890994.301883:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997350784:0@lo:400:kworker.0 00010000:00080000:1.0:1788890994.301896:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e74700 x1875787997351168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890994.301907:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997351168:0@lo:400:kworker.0 00000100:00100000:0.0:1788890994.301914:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890994.301924:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997351040:0@lo:400:kworker.0 00000100:00100000:0.0:1788890994.301936:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997351296:0@lo:400:kworker.0 00000100:00100000:1.0:1788890994.301939:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997350528:0@lo:400:kworker.0 00000100:00100000:0.0:1788890994.301972:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890994.301973:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997350272 00000100:00100000:1.0:1788890994.301979:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997350272 00000100:00100000:1.0:1788890994.302007:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788890994.302015:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997350272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890994.302025:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997350912 00000100:00100000:0.0:1788890994.302031:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997350912 00000100:00100000:1.0:1788890994.302058:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997350272:12345-0@lo:400:kworker.0 Request processed in 44us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890994.302066:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788890994.302067:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997351424 00000100:00100000:0.0:1788890994.302071:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997351424 00000100:00100000:1.0:1788890994.302106:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997350272:0@lo:400:kworker.0 00000100:00100000:1.0:1788890994.302129:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997350784 00000100:00100000:1.0:1788890994.302134:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997350784 00000100:00100000:3.0:1788890994.302207:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997349888 00000100:00100000:3.0:1788890994.302211:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997349888 00000100:00100000:3.0:1788890994.302239:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788890994.302246:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3630:x1875787997349888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890994.302285:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3630:x1875787997349888:12345-0@lo:400:kworker.0 Request processed in 40us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890994.302291:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788890994.302370:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997350144 00000100:00100000:2.0:1788890994.302375:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997350144 00000100:00100000:2.0:1788890994.302402:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997350400 00000100:00100000:2.0:1788890994.302405:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997350400 00000100:00100000:2.0:1788890994.302430:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788890994.302436:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997350144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890994.302476:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997350144:12345-0@lo:400:kworker.0 Request processed in 40us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890994.302498:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788890994.302511:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788890994.302517:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997350400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890994.302560:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997350400:12345-0@lo:400:kworker.0 Request processed in 43us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890994.302565:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788890994.302580:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997351296 00000100:00100000:2.0:1788890994.302583:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997351296 00000100:00100000:0.0:1788890994.302663:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788890994.302671:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997350912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890994.302707:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997350912:12345-0@lo:400:kworker.0 Request processed in 38us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890994.302713:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788890994.302726:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788890994.302732:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997351424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890994.302757:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997351424:12345-0@lo:400:kworker.0 Request processed in 25us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890994.302772:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788890994.302857:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997350144:0@lo:400:kworker.0 00000100:00100000:0.0:1788890994.302888:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997349888:0@lo:400:kworker.0 00000100:00100000:0.0:1788890994.302898:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997350400:0@lo:400:kworker.0 00000100:00100000:0.0:1788890994.302907:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997350912:0@lo:400:kworker.0 00010000:00080000:0.0:1788890994.302917:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e76d80 x1875787997351424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788891010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890994.302926:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997351424:0@lo:400:kworker.0 00000100:00100000:1.0:1788890994.307410:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788890994.307425:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997350784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890994.307560:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997350784:12345-0@lo:400:kworker.0 Request processed in 139us (5649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890994.307569:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788890994.308145:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997350784:0@lo:400:kworker.0 00000100:00100000:2.0:1788890994.311335:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788890994.311352:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997351296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890994.311456:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997351296:12345-0@lo:400:kworker.0 Request processed in 109us (9485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890994.311461:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1788890994.311829:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e76680 x1875787997351296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788891010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890994.311846:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997351296:0@lo:400:kworker.0 00000100:00080000:3.0:1788890994.314006:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788890994.314017:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788890994.314020:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788890994.314024:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788890994.364678:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788890994.365548:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788890994.620724:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890994.811776:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997351552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788890994.811846:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890994.812019:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997351552 00000100:00100000:1.0:1788890994.812027:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997351552 00000100:00100000:1.0:1788890994.812078:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788890994.812088:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997351552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788890994.812117:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788890994.812177:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997351552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890994.812186:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1788890994.812262:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e76680 x1875787997351552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890994.812280:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997351552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788890994.812295:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788890994.812300:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997351680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788890994.812325:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890994.812443:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997351680 00000100:00100000:0.0:1788890994.812449:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997351680 00000100:00100000:0.0:1788890994.812490:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788890994.812499:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997351680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788890994.812510:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788890994.812583:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997351680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890994.812592:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1788890994.812843:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf739c00 x1875787997351680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890994.812855:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997351680:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788890995.643995:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890996.348149:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997351808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788890996.348225:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890996.348422:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788890996.348431:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997351936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788890996.348485:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890996.348619:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997351808 00000100:00100000:1.0:1788890996.348627:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997351808 00000100:00100000:1.0:1788890996.348693:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788890996.348703:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997351808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788890996.348738:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788890996.348780:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997351808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890996.348786:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788890996.348821:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788890996.349255:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788890996.349262:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997351808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788890996.349270:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997352064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788890996.349315:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890996.349559:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997352064 00000100:00100000:3.0:1788890996.349565:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997352064 00000100:00100000:3.0:1788890996.349615:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788890996.349624:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997352064:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788890996.349634:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788890996.349638:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788890996.349643:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997351936 00000100:00100000:0.0:1788890996.349650:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997351936 00000100:00100000:0.0:1788890996.349688:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788890996.349698:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997351936:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788890996.349704:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997352064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890996.349718:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00000024:0.0:1788890996.349739:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788890996.349762:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997352064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788890996.349796:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997351936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890996.349803:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788890996.349859:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997351936:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788890996.667785:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890997.372978:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997352192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788890997.373054:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890997.373233:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997352192 00000100:00100000:0.0:1788890997.373241:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997352192 00000100:00100000:0.0:1788890997.373304:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788890997.373316:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997352192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788890997.373355:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788890997.373669:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997352192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 354us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890997.373677:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788890997.373763:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997352192:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788890997.691795:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890998.226578:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890998.226743:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890998.226787:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788890998.227014:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987839104 00000100:00100000:2.0:1788890998.227024:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987839104 00000100:00100000:2.0:1788890998.227090:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987838976 00000100:00100000:2.0:1788890998.227094:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987838976 00000100:00100000:2.0:1788890998.227116:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 168 00000100:00100000:2.0:1788890998.227126:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987839104:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788890998.227218:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987839104:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 93us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890998.227226:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 168 00000100:00100000:2.0:1788890998.227244:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 169 00000100:00100000:2.0:1788890998.227252:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987838976:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788890998.227277:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987838976:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 25us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890998.227283:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 169 00000100:00100000:3.0:1788890998.227440:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987838848 00000100:00100000:3.0:1788890998.227447:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987838848 00000100:00100000:3.0:1788890998.227591:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 355 00000100:00100000:3.0:1788890998.227599:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2393:x1875787987838848:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788890998.227645:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2393:x1875787987838848:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 47us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890998.227652:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 355 00000100:00080000:1.0:1788890998.227813:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788890998.227817:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788890998.239006:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890998.239063:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788890998.239114:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788890998.239285:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987839232 00000100:00100000:3.0:1788890998.239299:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987839232 00000100:00100000:3.0:1788890998.239386:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:3.0:1788890998.239398:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b6b71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2390:x1875787987839232:12345-192.168.204.26@tcp:9:kworker.0 00000020:00000080:3.0:1788890998.239450:0:8596:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52ef6 00000100:00080000:3.0:1788890998.239461:0:8596:0:(import.c:65:import_set_state_nolock()) ffff9250bf768000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788890998.239555:0:8596:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:0.0:1788890998.239674:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890998.239690:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987839360 00000100:00100000:0.0:1788890998.239695:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987839360 00000100:00100000:0.0:1788890998.239735:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987839488 00000100:00100000:0.0:1788890998.239739:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987839488 00000100:00100000:0.0:1788890998.239765:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 170 00000100:00080000:1.0:1788890998.239869:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788890998.239874:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788890998.239877:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788890998.239910:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 171 00000100:00100000:1.0:1788890998.239919:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987839488:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788890998.240006:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987839488:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 89us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890998.240025:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 171 00000100:00100000:0.0:1788890998.240096:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987839360:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788890998.240130:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987839360:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 357us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890998.240137:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 170 00000100:00100000:3.0:1788890998.242212:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b6b71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+2:2390:x1875787987839232:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 2179us (2459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890998.242231:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 27 00010000:00010000:3.0:1788890998.717825:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890999.422087:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788890999.422295:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997352448:0@lo:400:kworker.0 00000100:00100000:1.0:1788890999.422399:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890999.422487:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997352320:0@lo:400:kworker.0 00000100:00100000:1.0:1788890999.422518:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890999.422746:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997352448 00000100:00100000:2.0:1788890999.422755:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997352448 00000100:00100000:2.0:1788890999.422816:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788890999.422827:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997352448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890999.422885:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997352448:12345-0@lo:400:kworker.0 Request processed in 60us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890999.422893:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788890999.423006:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997352448:0@lo:400:kworker.0 00000100:00100000:3.0:1788890999.423083:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997352320 00000100:00100000:3.0:1788890999.423088:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997352320 00000100:00100000:3.0:1788890999.423125:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788890999.423133:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3630:x1875787997352320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890999.423182:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3630:x1875787997352320:12345-0@lo:400:kworker.0 Request processed in 50us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890999.423188:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788890999.423695:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997352576:0@lo:400:kworker.0 00000100:00100000:3.0:1788890999.423731:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890999.423872:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788890999.423880:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997352704:0@lo:400:kworker.0 00000100:00100000:2.0:1788890999.423893:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997352320:0@lo:400:kworker.0 00000100:00100000:3.0:1788890999.423911:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890999.423937:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997352576 00000100:00100000:2.0:1788890999.423942:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997352576 00000100:00100000:3.0:1788890999.424062:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788890999.424109:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997352704 00000100:00100000:1.0:1788890999.424113:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997352704 00000100:00100000:1.0:1788890999.424141:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788890999.424148:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997352704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890999.424185:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997352704:12345-0@lo:400:kworker.0 Request processed in 37us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890999.424191:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788890999.424242:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997352576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890999.424243:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997352704:0@lo:400:kworker.0 00000100:00100000:3.0:1788890999.424297:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997352576:12345-0@lo:400:kworker.0 Request processed in 58us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890999.424306:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997352576:0@lo:400:kworker.0 00000100:00100000:0.0:1788890999.424605:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1875787997352960:0@lo:400:kworker.0 00000100:00100000:0.0:1788890999.424633:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890999.424652:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1875787997353472:0@lo:400:kworker.0 00000100:00100000:0.0:1788890999.424673:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890999.424707:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788890999.424712:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997352832:0@lo:400:kworker.0 00000100:00100000:0.0:1788890999.424733:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890999.424760:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997353344:0@lo:400:kworker.0 00000100:00100000:0.0:1788890999.424785:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890999.424802:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997353856:0@lo:400:kworker.0 00000100:00100000:0.0:1788890999.424823:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890999.424849:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997353344 00000100:00100000:0.0:1788890999.424853:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997353344 00000100:00100000:0.0:1788890999.424891:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997353856 00000100:00100000:0.0:1788890999.424894:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997353856 00000100:00100000:0.0:1788890999.424913:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788890999.424921:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997353344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890999.424956:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997353344:12345-0@lo:400:kworker.0 Request processed in 36us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890999.424962:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788890999.424974:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788890999.424994:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997353856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890999.425022:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997353856:12345-0@lo:400:kworker.0 Request processed in 30us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890999.425028:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788890999.425059:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997352832 00000100:00100000:0.0:1788890999.425063:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997352832 00000100:00100000:2.0:1788890999.425821:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997352960 00000100:00100000:2.0:1788890999.425829:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997352960 00000100:00100000:2.0:1788890999.425861:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997353472 00000100:00100000:2.0:1788890999.425864:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997353472 00000100:00100000:2.0:1788890999.425883:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788890999.425890:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875787997352960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890999.425936:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875787997352960:12345-0@lo:400:kworker.0 Request processed in 46us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890999.425955:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788890999.425971:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788890999.425977:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875787997353472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890999.426007:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875787997353472:12345-0@lo:400:kworker.0 Request processed in 30us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890999.426013:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788890999.426492:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788890999.426578:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997353344:0@lo:400:kworker.0 00010000:00080000:3.0:1788890999.426597:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf738a80 x1875787997353856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788891015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890999.426608:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997353856:0@lo:400:kworker.0 00000100:00100000:3.0:1788890999.426631:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1875787997352960:0@lo:400:kworker.0 00000100:00100000:3.0:1788890999.426641:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1875787997353472:0@lo:400:kworker.0 00000100:00100000:1.0:1788890999.427181:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997353088:0@lo:400:kworker.0 00000100:00100000:1.0:1788890999.427234:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890999.427278:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997353600:0@lo:400:kworker.0 00000100:00100000:1.0:1788890999.427301:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890999.427335:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788890999.427342:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997353216:0@lo:400:kworker.0 00000100:00100000:1.0:1788890999.427378:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890999.427436:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997353728:0@lo:400:kworker.0 00000100:00100000:1.0:1788890999.427460:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890999.427493:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997353216 00000100:00100000:1.0:1788890999.427499:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997353216 00000100:00100000:1.0:1788890999.427566:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997353728 00000100:00100000:1.0:1788890999.427570:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997353728 00000100:00100000:2.0:1788890999.427573:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997353088 00000100:00100000:2.0:1788890999.427580:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997353088 00000100:00100000:1.0:1788890999.427601:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788890999.427611:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997353216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890999.427659:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997353216:12345-0@lo:400:kworker.0 Request processed in 51us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890999.427665:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788890999.427683:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788890999.427688:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997353600 00000100:00100000:1.0:1788890999.427693:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997353728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890999.427694:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997353600 00000100:00100000:2.0:1788890999.427727:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788890999.427732:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997353728:12345-0@lo:400:kworker.0 Request processed in 41us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890999.427739:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997353088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890999.427743:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788890999.427783:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997353088:12345-0@lo:400:kworker.0 Request processed in 47us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890999.427790:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788890999.427803:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788890999.427809:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997353600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890999.427834:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997353600:12345-0@lo:400:kworker.0 Request processed in 26us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890999.427841:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:2.0:1788890999.427891:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788890999.427895:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788890999.427898:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788890999.427901:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788890999.427954:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997353216:0@lo:400:kworker.0 00010000:00080000:1.0:1788890999.427964:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf739f80 x1875787997353728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788891015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890999.427974:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997353728:0@lo:400:kworker.0 00010000:00080000:1.0:1788890999.428220:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf73b100 x1875787997353088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890999.428230:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997353088:0@lo:400:kworker.0 00010000:00080000:1.0:1788890999.428240:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf73a680 x1875787997353600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890999.428262:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997353600:0@lo:400:kworker.0 00000100:00100000:0.0:1788890999.428768:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788890999.428784:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997352832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890999.428852:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997352832:12345-0@lo:400:kworker.0 Request processed in 74us (4117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890999.428868:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788890999.428932:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997352832:0@lo:400:kworker.0 00010000:00010000:0.0:1788890999.739766:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890999.931856:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788890999.931880:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997353984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788890999.931961:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890999.932145:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997354112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788890999.933606:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890999.934025:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997353984 00000100:00100000:2.0:1788890999.934035:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997353984 00000100:00100000:2.0:1788890999.934081:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997354112 00000100:00100000:1.0:1788890999.934089:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788890999.934097:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997354112 00000100:00100000:1.0:1788890999.934100:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997353984:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788890999.934113:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788890999.934118:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997354112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788890999.934132:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1788890999.934133:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788890999.934280:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997353984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 182us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890999.934288:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1788890999.934407:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e74e00 x1875787997353984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890999.934428:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997353984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788890999.936871:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997354112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2744us (3261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890999.936885:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:3.0:1788890999.937023:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250baa2c000 x1875787997354112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890999.937134:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997354112:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788891000.765207:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891001.467897:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997354368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788891001.467970:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891001.467990:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997354240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788891001.468029:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891001.468081:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997354240 00000100:00100000:2.0:1788891001.468089:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997354240 00000100:00100000:0.0:1788891001.468096:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997354368 00000100:00100000:0.0:1788891001.468102:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997354368 00000100:00100000:0.0:1788891001.468153:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788891001.468154:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788891001.468167:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997354368:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788891001.468168:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997354240:12345-0@lo:13:osp-pre-0-0.0 00000004:00000024:0.0:1788891001.468205:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00002000:00000024:2.0:1788891001.468206:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788891001.468259:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997354240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891001.468266:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1788891001.468287:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788891001.468329:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997354240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788891001.468366:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997354368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 201us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891001.468375:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788891001.468397:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83891f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997354496:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788891001.468429:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891001.468485:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997354496 00000100:00100000:2.0:1788891001.468490:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997354496 00000100:00100000:3.0:1788891001.468501:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997354368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788891001.468604:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788891001.468613:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997354496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788891001.468625:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788891001.468667:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997354496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891001.468691:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1788891001.468723:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788891001.468761:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83891f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997354496:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788891001.787729:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891002.491842:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997354624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788891002.491915:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891002.492143:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997354624 00000100:00100000:0.0:1788891002.492151:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997354624 00000100:00100000:0.0:1788891002.492235:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788891002.492247:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997354624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788891002.492281:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788891002.492351:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997354624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891002.492365:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788891002.492438:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997354624:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788891002.811690:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891003.343067:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891003.343150:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891003.343185:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891003.343208:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891003.343232:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891003.343255:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987839872 00000100:00100000:1.0:1788891003.343275:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987839872 00000100:00100000:1.0:1788891003.343342:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987840128 00000100:00100000:1.0:1788891003.343346:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987840128 00000100:00100000:0.0:1788891003.343346:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987839744 00000100:00100000:0.0:1788891003.343352:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987839744 00000100:00100000:1.0:1788891003.343369:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987840000 00000100:00100000:1.0:1788891003.343374:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987840000 00000100:00100000:0.0:1788891003.343386:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 178 00000100:00100000:0.0:1788891003.343398:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+5:2394:x1875787987839872:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788891003.343403:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 179 00000100:00100000:1.0:1788891003.343413:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987840128:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891003.343473:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+5:2394:x1875787987839872:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 79us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891003.343491:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 178 00000100:00100000:0.0:1788891003.343512:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 180 00000100:00100000:0.0:1788891003.343518:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+5:2394:x1875787987839744:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891003.343558:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987839616 00000100:00100000:3.0:1788891003.343564:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987839616 00000100:00100000:3.0:1788891003.343597:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 357 00000100:00100000:3.0:1788891003.343605:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2394:x1875787987839616:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788891003.343662:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987840128:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 250us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891003.343669:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 179 00000100:00100000:1.0:1788891003.343692:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 181 00000100:00100000:1.0:1788891003.343699:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987840000:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788891003.343720:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987840000:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 23us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891003.343726:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 181 00000100:00080000:1.0:1788891003.343744:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788891003.343748:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788891003.345462:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2394:x1875787987839616:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 1849us (2396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891003.345474:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 357 00000100:00100000:0.0:1788891003.345770:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+5:2394:x1875787987839744:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 2249us (2558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891003.345778:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 180 00000001:00100000:0.0:1788891003.520843:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df03475d-d91a-4e91-8125-742ac4d4c589 00000020:00000080:0.0:1788891003.520857:0:8404:0:(genops.c:885:class_export_put()) final put ffff9250bf76a800/df03475d-d91a-4e91-8125-742ac4d4c589 00000020:00000080:3.0:1788891003.521054:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9250bf76a800/df03475d-d91a-4e91-8125-742ac4d4c589 for lustre-OST0000 00000020:00000080:3.0:1788891003.521137:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9250bf768000 for lustre-OST0000 00010000:00010000:3.0:1788891003.835679:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891004.540168:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997355008:0@lo:400:kworker.0 00000100:00100000:0.0:1788891004.540238:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997354880:0@lo:400:kworker.0 00000100:00100000:1.0:1788891004.540244:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891004.540295:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891004.540325:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1875787997355520:0@lo:400:kworker.0 00000100:00100000:0.0:1788891004.540326:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997355392:0@lo:400:kworker.0 00000100:00100000:3.0:1788891004.540338:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997355136:0@lo:400:kworker.0 00000100:00100000:1.0:1788891004.540365:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891004.540379:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997355008 00000100:00100000:0.0:1788891004.540387:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997355008 00000100:00100000:2.0:1788891004.540430:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997354752:0@lo:400:kworker.0 00000100:00100000:0.0:1788891004.540442:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788891004.540452:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997355008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891004.542224:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891004.542292:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997355648:0@lo:400:kworker.0 00000100:00100000:3.0:1788891004.542337:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891004.542364:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997356160:0@lo:400:kworker.0 00000100:00100000:3.0:1788891004.542386:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891004.542435:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997354880 00000100:00100000:3.0:1788891004.542441:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997354880 00000100:00100000:1.0:1788891004.542465:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997356032:0@lo:400:kworker.0 00000100:00100000:1.0:1788891004.542505:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891004.542555:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997355520 00000100:00100000:1.0:1788891004.542560:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997355520 00000100:00100000:1.0:1788891004.542588:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997355136 00000100:00100000:1.0:1788891004.542592:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997355136 00000100:00100000:1.0:1788891004.542625:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997356032 00000100:00100000:1.0:1788891004.542628:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997356032 00000100:00100000:1.0:1788891004.542646:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788891004.542654:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997354880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891004.542708:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997354880:12345-0@lo:400:kworker.0 Request processed in 54us (2424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891004.542716:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788891004.542734:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788891004.542741:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875787997355520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891004.543652:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788891004.543666:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997355136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891004.543736:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875787997355520:12345-0@lo:400:kworker.0 Request processed in 993us (3369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891004.543737:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997355136:12345-0@lo:400:kworker.0 Request processed in 76us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891004.543751:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788891004.543759:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788891004.543777:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788891004.543787:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875787997356032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891004.543799:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997355648 00000100:00100000:3.0:1788891004.543804:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997355648 00000100:00100000:1.0:1788891004.543829:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875787997356032:12345-0@lo:400:kworker.0 Request processed in 44us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891004.543837:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788891004.543842:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997356160 00000100:00100000:3.0:1788891004.543847:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997356160 00000100:00080000:1.0:1788891004.543863:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788891004.543870:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788891004.543874:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788891004.543876:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788891004.543883:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997355648:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788891004.543911:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82ff5880 x1875787997355520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891004.543922:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997355648:12345-0@lo:400:kworker.0 Request processed in 40us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891004.543930:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788891004.543933:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1875787997355520:0@lo:400:kworker.0 00000100:00100000:3.0:1788891004.543947:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1788891004.543952:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250a4885c00 x1875787997356032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891004.543957:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997356160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891004.543971:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997356032:0@lo:400:kworker.0 00000100:00100000:3.0:1788891004.544021:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997356160:12345-0@lo:400:kworker.0 Request processed in 66us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891004.544028:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788891004.544050:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891004.544079:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997355392 00000100:00100000:3.0:1788891004.544083:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997355392 00000100:00100000:1.0:1788891004.544110:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997355904:0@lo:400:kworker.0 00000100:00100000:3.0:1788891004.544118:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788891004.544127:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997355392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891004.544148:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891004.544173:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997355392:12345-0@lo:400:kworker.0 Request processed in 47us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891004.544181:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788891004.544190:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997354880:0@lo:400:kworker.0 00000100:00100000:3.0:1788891004.544194:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997355904 00000100:00100000:3.0:1788891004.544198:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997355904 00000100:00100000:1.0:1788891004.544205:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997355392:0@lo:400:kworker.0 00000100:00100000:3.0:1788891004.544228:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788891004.544236:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997355904:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788891004.544250:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891004.544272:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997355136:0@lo:400:kworker.0 00000100:00100000:1.0:1788891004.544301:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997355648:0@lo:400:kworker.0 00010000:00080000:1.0:1788891004.544312:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250a4884380 x1875787997356160/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788891020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891004.544321:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997356160:0@lo:400:kworker.0 00000100:00100000:1.0:1788891004.544370:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997355904:0@lo:400:kworker.0 00000100:00100000:3.0:1788891004.545207:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997355904:12345-0@lo:400:kworker.0 Request processed in 43us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891004.545221:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788891004.546780:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891004.546794:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997355008:12345-0@lo:400:kworker.0 Request processed in 6340us (6550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891004.546806:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788891004.546847:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997355264:0@lo:400:kworker.0 00000100:00100000:2.0:1788891004.546881:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891004.546904:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997355776:0@lo:400:kworker.0 00000100:00100000:2.0:1788891004.546933:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891004.546943:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997355264 00000100:00100000:0.0:1788891004.546952:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997355264 00000100:00100000:2.0:1788891004.546966:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997355776 00000100:00100000:2.0:1788891004.546972:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997355776 00000100:00100000:0.0:1788891004.546998:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788891004.547008:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997355264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891004.547022:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788891004.547031:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997355776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891004.547070:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997355264:12345-0@lo:400:kworker.0 Request processed in 63us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891004.547079:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997355776:12345-0@lo:400:kworker.0 Request processed in 49us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891004.547085:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788891004.547098:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:2.0:1788891004.547115:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788891004.547152:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997355776:0@lo:400:kworker.0 00000100:00100000:2.0:1788891004.547160:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997356288:0@lo:400:kworker.0 00000100:00100000:2.0:1788891004.547183:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891004.547238:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997355264:0@lo:400:kworker.0 00000100:00100000:0.0:1788891004.547311:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997356288 00000100:00100000:0.0:1788891004.547316:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997356288 00000100:00100000:0.0:1788891004.547352:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788891004.547359:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997356288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891004.547396:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997356288:12345-0@lo:400:kworker.0 Request processed in 37us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891004.547402:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788891004.547435:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997355008:0@lo:400:kworker.0 00000100:00080000:2.0:1788891004.547496:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788891004.547516:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f833bc000 x1875787997356288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788891020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891004.547547:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997356288:0@lo:400:kworker.0 00000100:00100000:3.0:1788891004.547632:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997354752 00000100:00100000:3.0:1788891004.547636:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997354752 00000100:00100000:3.0:1788891004.547672:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788891004.547679:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c09c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3628:x1875787997354752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891004.547729:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c09c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3628:x1875787997354752:12345-0@lo:400:kworker.0 Request processed in 50us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891004.547735:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788891004.547907:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997354752:0@lo:400:kworker.0 00000040:00080000:2.0:1788891004.604874:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788891004.605873:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788891004.859754:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891005.052300:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997356416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788891005.052381:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891005.052457:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788891005.052463:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997356544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788891005.052487:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891005.052565:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997356416 00000100:00100000:3.0:1788891005.052573:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997356416 00000100:00100000:3.0:1788891005.052621:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997356544 00000100:00100000:3.0:1788891005.052624:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997356544 00000100:00100000:3.0:1788891005.052638:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788891005.052645:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997356416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788891005.052674:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788891005.052730:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997356416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891005.052738:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788891005.052754:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788891005.052760:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997356544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788891005.052770:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788891005.052793:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997356544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891005.052799:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:1.0:1788891005.053675:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1e75500 x1875787997356544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891005.053699:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997356544:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788891005.053711:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f833b2680 x1875787997356416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891005.053729:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997356416:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1788891005.247899:0:14031:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:10:03 (1788891003) 00010000:00010000:2.0:1788891005.883992:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891006.216479:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891006.216865:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987840256 00000100:00100000:3.0:1788891006.216876:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987840256 00000100:00100000:3.0:1788891006.218314:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:3.0:1788891006.218329:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+5:11046:x1875787987840256:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788891006.218350:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891006.218373:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52fd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddde2 expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788891006.218396:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788891006.218444:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd52fdd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.218459:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd52fdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.218497:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd52fdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891006.218566:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788891006.218570:0:12407:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891006.218605:0:12407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd52fdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.218628:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd52fd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddde2 expref: 7 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.218644:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd52fdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddde2 expref: 6 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.218652:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250905a3300) 00010000:00010000:3.0:1788891006.218655:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788891006.218658:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8a600, rc 0) 00000100:00100000:3.0:1788891006.218769:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+6:11046:x1875787987840256:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 444us (2366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891006.218777:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:0.0:1788891006.232284:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891006.232425:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987840384 00000100:00100000:1.0:1788891006.232436:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987840384 00000100:00100000:1.0:1788891006.232510:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00100000:1.0:1788891006.232541:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:11047:x1875787987840384:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788891006.232571:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891006.232595:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd52fe4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddde9 expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.233403:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd52feb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.233423:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd52feb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.233434:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd52feb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.233450:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd52ff2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.233456:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd52ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.233462:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd52ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.233606:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd52ff9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.233695:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd52ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.233703:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd52ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891006.233752:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788891006.233755:0:9362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788891006.234169:0:9362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd52ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.234181:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd52feb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.234189:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd52feb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.234196:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd52feb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.234203:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7e00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891006.234207:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd52feb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.234215:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd52feb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.234228:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250905a3300) 00010000:00010000:1.0:1788891006.234231:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891006.234236:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd52feb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.234296:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd52feb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.234311:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd52ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.234317:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd52ff2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.234322:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd52ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.234326:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6e00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891006.234329:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd52ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.234335:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd52ff2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.234343:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9250b65fc900) 00010000:00010000:1.0:1788891006.234346:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891006.234349:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd52ff2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.234354:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd52ff2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.234392:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd52fe4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddde9 expref: 8 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.234408:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd52ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddde9 expref: 7 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891006.234421:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9250b65fcc00) 00010000:00010000:1.0:1788891006.234424:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788891006.234426:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6a00, rc 0) 00000100:00100000:1.0:1788891006.234626:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+7:11047:x1875787987840384:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 2106us (2352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891006.234636:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00100000:1.0:1788891006.237577:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891006.237777:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987840512 00000100:00100000:3.0:1788891006.237788:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987840512 00000100:00100000:3.0:1788891006.237849:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:3.0:1788891006.238036:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:df03475d-d91a-4e91-8125-742ac4d4c589+7:11047:x1875787987840512:12345-192.168.204.26@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788891006.238122:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:df03475d-d91a-4e91-8125-742ac4d4c589+7:11047:x1875787987840512:12345-192.168.204.26@tcp:900:lhsmtool_posix.0 Request processed in 198us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891006.238130:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:0.0:1788891006.241735:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891006.242603:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987840768 00000100:00100000:3.0:1788891006.242745:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987840768 00000100:00100000:3.0:1788891006.242851:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 41 00000100:00100000:3.0:1788891006.242865:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+7:11047:x1875787987840768:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788891006.242893:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891006.242930:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53000 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dddf0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.243058:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53007 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.243077:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53007 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.243094:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53007 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.244624:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd5300e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.244647:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd5300e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.244660:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd5300e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.244922:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522e00/0xa66601b03fd53015 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.244932:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522e00/0xa66601b03fd53015 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.244957:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522e00/0xa66601b03fd53015 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891006.244970:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788891006.245308:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53007 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.245317:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53007 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.245324:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53007 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.245331:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081523800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891006.245337:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53007 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.245344:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53007 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.245357:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9250b65fcc00) 00010000:00010000:3.0:1788891006.245361:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891006.245366:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53007 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.245372:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53007 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.245389:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd5300e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.245395:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd5300e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.245406:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd5300e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.245411:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891006.245414:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd5300e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.245420:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd5300e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.245429:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9250905a3d00) 00010000:00010000:3.0:1788891006.245436:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891006.245439:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd5300e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.245445:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd5300e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.246791:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53000 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddf0 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.246817:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522e00/0xa66601b03fd53015 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddf0 expref: 9 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891006.246827:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9250905a3b00) 00010000:00010000:3.0:1788891006.246829:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891006.246833:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925081522e00, rc 0) 00000100:00100000:3.0:1788891006.246917:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+9:11047:x1875787987840768:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 4055us (5192us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788891006.246944:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 41 00000100:00100000:0.0:1788891006.254980:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891006.257461:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987840896 00000100:00100000:3.0:1788891006.257479:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987840896 00000100:00100000:3.0:1788891006.257622:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:3.0:1788891006.257635:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+9:11047:x1875787987840896:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788891006.257775:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+9:11047:x1875787987840896:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 Request processed in 142us (2803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891006.257783:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:1.0:1788891006.260225:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891006.260332:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987841024 00000100:00100000:2.0:1788891006.260341:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987841024 00000100:00100000:2.0:1788891006.260457:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:2.0:1788891006.260468:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:11047:x1875787987841024:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1788891006.261499:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1788891006.264894:0:9362:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4387us 00000100:00100000:3.0:1788891006.280974:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:11047:x1875787987841024:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 Request processed in 20488us (20738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891006.280993:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:2.0:1788891006.588469:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997356672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788891006.588581:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891006.588631:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997356928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788891006.588649:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788891006.588659:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997356800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788891006.588672:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891006.588695:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891006.588730:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997356928 00000100:00100000:3.0:1788891006.588738:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997356928 00000100:00100000:2.0:1788891006.588745:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997356672 00000100:00100000:2.0:1788891006.588751:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997356672 00000100:00100000:3.0:1788891006.588794:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788891006.588797:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997356800 00000100:00100000:2.0:1788891006.588802:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997356800 00000100:00100000:3.0:1788891006.588807:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997356928:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788891006.588826:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788891006.588836:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997356672:12345-0@lo:13:osp-pre-0-1.0 00000004:00000024:3.0:1788891006.588849:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00002000:00000024:2.0:1788891006.588863:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788891006.588898:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788891006.588909:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997356928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891006.588913:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997356800:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788891006.588920:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997356672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891006.588923:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00002000:00000024:0.0:1788891006.588929:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788891006.588934:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788891006.588979:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997356928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788891006.591010:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997356800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2095us (2307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891006.591025:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1788891006.591057:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788891006.592549:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997356672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788891006.592623:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997356800:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788891006.653141:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788891006.654949:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788891006.908409:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891007.615799:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997357056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788891007.615896:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891007.616108:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997357056 00000100:00100000:0.0:1788891007.616118:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997357056 00000100:00100000:0.0:1788891007.616182:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788891007.616207:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997357056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788891007.616264:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788891007.616335:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997357056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891007.616343:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788891007.616399:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997357056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788891007.663641:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891007.663689:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987841152 00000100:00100000:0.0:1788891007.663700:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987841152 00000100:00100000:1.0:1788891007.663820:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 44 00000100:00100000:1.0:1788891007.663832:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+9:11090:x1875787987841152:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788891007.663856:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891007.663878:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6600/0xa66601b03fd53023 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dddf7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.663941:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd5302a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.663956:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd5302a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.663968:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd5302a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.663984:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd53031 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.664001:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd53031 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.664009:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd53031 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.664055:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd5302a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.664063:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd5302a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.664070:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd5302a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.664076:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7e00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891007.664079:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd5302a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.664087:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd5302a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.664100:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250905a3300) 00010000:00010000:1.0:1788891007.664104:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891007.664109:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd5302a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.664116:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd5302a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.664129:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd53031 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.664143:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd53031 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.664149:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd53031 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.664154:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6e00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891007.664158:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd53031 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.664164:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd53031 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.664175:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff925095f80900) 00010000:00010000:1.0:1788891007.664178:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891007.664180:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd53031 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.664186:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd53031 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.664231:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6600/0xa66601b03fd53023 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddf7 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.664242:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250905a3300) 00010000:00010000:1.0:1788891007.664245:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891007.664248:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6600/0xa66601b03fd53023 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddf7 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.664258:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6600, rc 0) 00000100:00100000:1.0:1788891007.664337:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+9:11090:x1875787987841152:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 507us (706us total) trans 0 rc 301/301 00000100:00100000:1.0:1788891007.664346:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 44 00000100:00100000:0.0:1788891007.672017:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891007.672116:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987841408 00000100:00100000:1.0:1788891007.672126:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987841408 00000100:00100000:1.0:1788891007.672198:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00100000:1.0:1788891007.672209:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+9:11090:x1875787987841408:12345-192.168.204.26@tcp:36:lfs.0 00010000:00010000:1.0:1788891007.672281:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891007.672310:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd52fdd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddde2 expref: 9 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.672328:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250905a3300) 00010000:00010000:1.0:1788891007.672338:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788891007.672394:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd53038 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.672408:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd53038 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.672417:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd53038 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.672429:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6c00/0xa66601b03fd5303f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.672436:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6c00/0xa66601b03fd5303f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.672443:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6c00/0xa66601b03fd5303f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.672977:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd53046 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.672988:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd53046 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.672997:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd53046 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788891007.673012:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e8abe6b reply state 00000000d0917a13 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd53046 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.673023:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd53046 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.673029:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:1.0:1788891007.673032:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788891007.673035:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788891007.673041:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788891007.673048:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd53038 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.673055:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd53038 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.673062:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd53038 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.673068:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891007.673073:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd53038 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.673091:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd53038 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.673101:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925095f80e00) 00010000:00010000:1.0:1788891007.673104:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891007.673107:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd53038 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.673114:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd53038 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788891007.673128:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e8abe6b reply state 00000000d0917a13 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6c00/0xa66601b03fd5303f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.673136:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6c00/0xa66601b03fd5303f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.673141:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff925095f80000) 00010000:00010000:1.0:1788891007.673144:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788891007.673146:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788891007.673267:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+10:11090:x1875787987841408:12345-192.168.204.26@tcp:36:lfs.0 Request processed in 1059us (1260us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788891007.673275:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00100000:0.0:1788891007.737708:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891007.738661:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987841536 00000100:00100000:1.0:1788891007.738677:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987841536 00000100:00100000:1.0:1788891007.738792:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 46 00000100:00100000:1.0:1788891007.738806:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+10:11098:x1875787987841536:12345-192.168.204.26@tcp:101:lctl.0 00010000:00010000:1.0:1788891007.738892:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891007.738919:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd5304d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dddfe expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.739006:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6600/0xa66601b03fd53054 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.739022:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6600/0xa66601b03fd53054 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.739035:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6600/0xa66601b03fd53054 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891007.739081:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788891007.739086:0:9362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788891007.739129:0:9362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6600/0xa66601b03fd53054 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.739156:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd5304d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddfe expref: 12 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.739171:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6600/0xa66601b03fd53054 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddfe expref: 11 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.739181:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925095f80e00) 00010000:00010000:1.0:1788891007.739184:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788891007.739188:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6600, rc 0) 00000100:00100000:1.0:1788891007.739275:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+11:11098:x1875787987841536:12345-192.168.204.26@tcp:101:lctl.0 Request processed in 472us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891007.739283:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 46 00000100:00100000:2.0:1788891007.787140:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891007.789869:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987841664 00000100:00100000:3.0:1788891007.789884:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987841664 00000100:00100000:2.0:1788891007.790085:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:2.0:1788891007.790098:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+11:11104:x1875787987841664:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788891007.790146:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891007.790174:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd5305b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde05 expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790261:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53062 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790278:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53062 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790294:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53062 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790306:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd53069 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790313:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd53069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790321:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd53069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790422:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd53070 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790431:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd53070 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790439:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd53070 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891007.790479:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788891007.790489:0:12407:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788891007.790564:0:12407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd53070 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790580:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53062 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790587:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53062 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790595:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53062 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790601:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891007.790606:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53062 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790615:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53062 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790628:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925095f80e00) 00010000:00010000:2.0:1788891007.790631:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891007.790636:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53062 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790643:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53062 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790654:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd53069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790659:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd53069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790675:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd53069 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790680:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891007.790683:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd53069 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790690:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd53069 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790697:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff925095f80000) 00010000:00010000:2.0:1788891007.790699:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891007.790702:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd53069 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790707:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd53069 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790734:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd5305b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde05 expref: 13 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790748:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd53070 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde05 expref: 12 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.790755:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:2.0:1788891007.790756:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788891007.790758:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311c00, rc 0) 00000100:00100000:2.0:1788891007.790834:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+12:11104:x1875787987841664:12345-192.168.204.26@tcp:101:bash.0 Request processed in 739us (3704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891007.790851:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:2.0:1788891007.795186:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891007.795277:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987841920 00000100:00100000:1.0:1788891007.795288:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987841920 00000100:00100000:1.0:1788891007.795363:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 48 00000100:00100000:1.0:1788891007.795374:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+12:11104:x1875787987841920:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1788891007.795396:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891007.795416:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd53077 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde0c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.795510:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5307e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.795544:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5307e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.795556:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5307e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.795627:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd53085 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.795635:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd53085 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.795642:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd53085 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788891007.796248:0:6495:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788891007.796383:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5308c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.796393:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5308c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.796402:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5308c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.796441:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5307e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.796449:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5307e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.796456:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5307e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.796463:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6e00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891007.796467:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5307e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.796474:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5307e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.796486:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:1.0:1788891007.796489:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891007.796493:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5307e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.796499:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5307e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788891007.796512:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7359aef reply state 00000000f3d9abab transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd53085 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.796541:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd53085 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.796549:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff925095f80900) 00010000:00010000:1.0:1788891007.796557:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788891007.796560:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788891007.796592:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd53077 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde0c expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.796607:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5308c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde0c expref: 14 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.796615:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80f00) 00010000:00010000:1.0:1788891007.796617:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788891007.796619:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ede00, rc 0) 00000100:00100000:1.0:1788891007.796739:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+15:11104:x1875787987841920:12345-192.168.204.26@tcp:101:bash.0 Request processed in 1366us (1560us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788891007.796748:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 48 00000100:00100000:0.0:1788891007.804974:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891007.805078:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987842048 00000100:00100000:1.0:1788891007.805093:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987842048 00000100:00100000:1.0:1788891007.805155:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:1.0:1788891007.805166:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1875787987842048:12345-192.168.204.26@tcp:8:bash.0 00010000:00080000:1.0:1788891007.805205:0:8411:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:1.0:1788891007.805252:0:8411:0:(genops.c:1385:class_connect()) connect: client df03475d-d91a-4e91-8125-742ac4d4c589, cookie 0xa66601b03fd5309a 00002000:00100000:1.0:1788891007.805264:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli df03475d-d91a-4e91-8125-742ac4d4c589/ffff924f8332f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788891007.805285:0:8411:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788891007.805365:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788891007.805399:0:8411:0:(import.c:65:import_set_state_nolock()) ffff924f832d8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788891007.805487:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+6:2390:x1875787987842048:12345-192.168.204.26@tcp:8:bash.0 Request processed in 321us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891007.805495:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:2.0:1788891007.808780:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891007.809161:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987842176 00000100:00100000:0.0:1788891007.809174:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987842176 00000100:00100000:0.0:1788891007.809269:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:0.0:1788891007.809280:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df03475d-d91a-4e91-8125-742ac4d4c589+6:0:x1875787987842176:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788891007.809297:0:11803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891007.809320:0:11803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd530a1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde13 expref: -99 pid: 11803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788891007.809347:0:11803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891007.809368:0:11803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=230s v=(0 0) 00010000:00010000:0.0:1788891007.809374:0:11803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891007.809384:0:11803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd530a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde13 expref: 7 pid: 11803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788891007.809479:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788891007.809702:0:11803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd530a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde13 expref: 7 pid: 11803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891007.809733:0:11803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4c00, rc 0) 00000100:00100000:0.0:1788891007.809831:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df03475d-d91a-4e91-8125-742ac4d4c589+7:0:x1875787987842176:12345-192.168.204.26@tcp:101:bash.0 Request processed in 553us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891007.809838:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:0.0:1788891007.814208:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891007.814317:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987842304 00000100:00100000:3.0:1788891007.814330:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987842304 00000100:00100000:3.0:1788891007.814403:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:3.0:1788891007.814414:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+7:11104:x1875787987842304:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:3.0:1788891007.814433:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891007.814454:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd530a8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde1a expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891007.814487:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd530a1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde13 expref: 8 pid: 11803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891007.814497:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891007.814501:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891007.814507:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd530a8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde1a expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891007.814583:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd530a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde13 expref: 8 pid: 11803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891007.814744:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd530a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde13 expref: 8 pid: 11803 timeout: 330 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891007.814761:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8408:1875787997357184:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788891007.815956:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891007.819101:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891007.819361:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987842432 00000100:00100000:0.0:1788891007.819372:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987842432 00010000:00010000:0.0:1788891007.819420:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd530a1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde13 expref: 9 pid: 11803 timeout: 330 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891007.819464:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:0.0:1788891007.819474:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087acf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+9:2393:x1875787987842432:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891007.819488:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891007.819511:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd530a1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde13 expref: 9 pid: 11803 timeout: 330 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891007.819562:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd530a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde13 expref: 9 pid: 11803 timeout: 330 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891007.819589:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891007.819593:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891007.819602:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd530a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde1a expref: 9 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891007.819633:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd530a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde1a expref: 9 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891007.819679:0:6481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd530a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde1a expref: 9 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891007.819695:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf793800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6481:1875787997357312:192.168.204.26@tcp:105: 00000100:00100000:0.0:1788891007.819793:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab09f00 going to sleep for 11 seconds 00010000:00010000:3.0:1788891007.819881:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd530a1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde13 expref: 9 pid: 11803 timeout: 330 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891007.819901:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8408:1875787997357184:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891007.819926:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd530a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde1a expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891007.819939:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925081522800, rc 0) 00000100:00100000:3.0:1788891007.819969:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+8:11104:x1875787987842304:12345-192.168.204.26@tcp:101:bash.0 Request processed in 5557us (5772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891007.820039:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:0.0:1788891007.824146:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf793800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6481:1875787997357312:192.168.204.26@tcp:105: 00010000:00010000:0.0:1788891007.824173:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891007.824292:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087acf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+7:2393:x1875787987842432:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 4819us (5201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891007.824304:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:2.0:1788891007.829967:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891007.830472:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987842688 00000100:00100000:0.0:1788891007.830483:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987842688 00000100:00100000:0.0:1788891007.830588:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:0.0:1788891007.830599:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+15:11104:x1875787987842688:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:0.0:1788891007.830943:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+16:11104:x1875787987842688:12345-192.168.204.26@tcp:35:bash.0 Request processed in 344us (985us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788891007.830951:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:1.0:1788891007.891275:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891007.891382:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987842944 00000100:00100000:3.0:1788891007.891393:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987842944 00000100:00100000:3.0:1788891007.891503:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 49 00000100:00100000:3.0:1788891007.891515:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+16:11114:x1875787987842944:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891007.891571:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891007.891593:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd530af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde21 expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891007.891710:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788891007.891815:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd530af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde21 expref: 18 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891007.891830:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925095f80e00) 00010000:00010000:3.0:1788891007.891833:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891007.891852:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd530af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde21 expref: 18 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891007.891866:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925081523800, rc 0) 00000100:00100000:3.0:1788891007.891929:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+17:11114:x1875787987842944:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 416us (664us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1788891007.891937:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 49 00000100:00100000:1.0:1788891007.896956:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891007.898337:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987843200 00000100:00100000:0.0:1788891007.898350:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987843200 00000100:00100000:0.0:1788891007.898417:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:0.0:1788891007.898429:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+17:11114:x1875787987843200:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788891007.899351:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+18:11114:x1875787987843200:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 922us (2402us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788891007.899360:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00010000:00010000:0.0:1788891007.932448:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891007.979272:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891007.980110:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987843328 00000100:00100000:2.0:1788891007.980123:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987843328 00000100:00100000:2.0:1788891007.980193:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 50 00000100:00100000:2.0:1788891007.980203:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+18:11120:x1875787987843328:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788891007.980245:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891007.980267:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd530bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde28 expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.980334:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd530c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.980349:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd530c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.980361:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd530c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891007.980404:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788891007.980408:0:12407:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788891007.980429:0:12407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd530c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.980456:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd530bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde28 expref: 20 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.980494:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd530c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde28 expref: 19 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.980503:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:2.0:1788891007.980506:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788891007.980510:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310c00, rc 0) 00000100:00100000:2.0:1788891007.980671:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+19:11120:x1875787987843328:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 468us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891007.980678:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 50 00000100:00100000:0.0:1788891007.984786:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891007.984877:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987843584 00000100:00100000:2.0:1788891007.984887:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987843584 00000100:00100000:2.0:1788891007.984952:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:2.0:1788891007.984963:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+19:11120:x1875787987843584:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788891007.984984:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891007.985006:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd530cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde2f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.985127:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd530d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.985143:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd530d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.985155:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd530d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891007.985167:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788891007.985311:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd530cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde2f expref: 22 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.985331:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd530d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde2f expref: 21 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891007.985340:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80f00) 00010000:00010000:2.0:1788891007.985343:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891007.985347:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310600, rc 0) 00000100:00100000:2.0:1788891007.985414:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+21:11120:x1875787987843584:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 452us (638us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788891007.985422:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:3.0:1788891007.989706:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891007.989757:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891007.989853:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987843840 00000100:00100000:1.0:1788891007.989863:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987843840 00000100:00100000:0.0:1788891007.989978:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987843968 00000100:00100000:0.0:1788891007.989983:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987843968 00000100:00100000:0.0:1788891007.990035:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:0.0:1788891007.990046:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+22:2394:x1875787987843968:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891007.990062:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891007.990089:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd530d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde2f expref: 22 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891007.990108:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80f00) 00010000:00010000:0.0:1788891007.990114:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891007.990171:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+21:2394:x1875787987843968:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 127us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891007.990179:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:1.0:1788891007.990294:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:1.0:1788891007.990304:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+20:11120:x1875787987843840:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788891007.990324:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891007.990341:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd530e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde36 expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.990470:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd530e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.990484:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd530e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.990496:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd530e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891007.990508:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788891007.990638:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd530e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde36 expref: 23 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.990653:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd530e7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde36 expref: 22 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.990661:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80f00) 00010000:00010000:1.0:1788891007.990678:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788891007.990681:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7000, rc 0) 00000100:00100000:1.0:1788891007.990711:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+22:11120:x1875787987843840:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 408us (1015us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788891007.990718:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:3.0:1788891007.995418:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891007.995563:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987844096 00000100:00100000:1.0:1788891007.995574:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987844096 00000100:00100000:1.0:1788891007.995633:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:1.0:1788891007.995644:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+7:2393:x1875787987844096:12345-192.168.204.26@tcp:1:lfs.0 00010000:00010000:1.0:1788891007.995720:0:8596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd530f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.995742:0:8596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd530a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde1a expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.995752:0:8596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891007.995757:0:8596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788891007.995761:0:8596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd530f5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.995818:0:8596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd530a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde1a expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891007.995999:0:8596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd530a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde1a expref: 7 pid: 8408 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891007.996016:0:8596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8596:1875787997357440:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891007.996367:0:8596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250863123c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788891008.000645:0:8596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8596:1875787997357440:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891008.000677:0:8596:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd530f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891008.004270:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891008.004365:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987844224 00000100:00100000:0.0:1788891008.004375:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987844224 00002000:00100000:0.0:1788891008.004421:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9250bf73bb80 x1875787987844224/t0(0) o4->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:59/0 lens 504/0 e 0 to 0 dl 1788891019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788891008.004433:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9250bf73bb80 with x1875787987844224 ext(0->12) 00010000:00010000:0.0:1788891008.004442:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd530a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde1a expref: 8 pid: 8408 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.004476:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd530a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde1a expref: 8 pid: 8408 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788891008.004484:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9250bf73bb80 00000100:00100000:0.0:1788891008.004517:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:0.0:1788891008.004546:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df03475d-d91a-4e91-8125-742ac4d4c589+8:2393:x1875787987844224:12345-192.168.204.26@tcp:4:lfs.0 00000001:00100000:1.0:1788891008.007573:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df03475d-d91a-4e91-8125-742ac4d4c589 00000100:00100000:0.0:1788891008.008331:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df03475d-d91a-4e91-8125-742ac4d4c589+9:2393:x1875787987844224:12345-192.168.204.26@tcp:4:lfs.0 Request processed in 3779us (4062us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788891008.008345:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00002000:00100000:0.0:1788891008.008359:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9250bf73bb80 x1875787987844224/t4294967300(0) o4->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:59/0 lens 504/448 e 0 to 0 dl 1788891019 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788891008.008372:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9250bf73bb80 with x1875787987844224 ext(0->12) 00010000:00010000:0.0:1788891008.008383:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd530a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde1a expref: 9 pid: 8408 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.008415:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd530a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde1a expref: 9 pid: 8408 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788891008.008425:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9250bf73bb80 00000100:00100000:0.0:1788891008.013657:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891008.013756:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987844352 00000100:00100000:2.0:1788891008.013767:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987844352 00010000:00010000:2.0:1788891008.013808:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd530a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde1a expref: 9 pid: 8408 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891008.013855:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 53 00000100:00100000:2.0:1788891008.013866:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+9:2391:x1875787987844352:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891008.013882:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788891008.013901:0:6483:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788891008.013904:0:6483:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788891007 00002000:00010000:2.0:1788891008.013906:0:6483:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788891007 00002000:00010000:2.0:1788891008.013921:0:6483:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788891007 00002000:00010000:2.0:1788891008.013924:0:6483:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788891008.013931:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd530a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde1a expref: 9 pid: 8408 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.013946:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd530a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde1a expref: 9 pid: 8408 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.013973:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd530a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde1a expref: 9 pid: 8408 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.013992:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788891008.013997:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788891008.014003:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd530f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.014014:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd530f5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.014049:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891008.014109:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+8:2391:x1875787987844352:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 245us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891008.014118:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 53 00010000:00010000:0.0:1788891008.014869:0:8596:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd530f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.014881:0:8596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd530f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.014915:0:8596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd530f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.014925:0:8596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd530f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.014934:0:8596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd530f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.014941:0:8596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857dfe00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891008.014945:0:8596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd530f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.014954:0:8596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd530f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.014969:0:8596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd530f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.014976:0:8596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd530f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891008.015090:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+7:2393:x1875787987844096:12345-192.168.204.26@tcp:1:lfs.0 Request processed in 19445us (19681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891008.015109:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:0.0:1788891008.024978:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891008.025066:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987844608 00000100:00100000:2.0:1788891008.025076:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987844608 00000100:00100000:2.0:1788891008.025153:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:2.0:1788891008.025165:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+22:11120:x1875787987844608:12345-192.168.204.26@tcp:35:lfs.0 00000004:00010000:2.0:1788891008.025260:0:6498:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd530e7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde36 expref: 22 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788891008.025499:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000100:00080000:1.0:1788891008.025749:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1788891008.025858:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788891008.026162:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1788891008.026200:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd530fc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.028701:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5308c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde0c expref: 26 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.028718:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd530fc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.028773:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5308c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde0c expref: 26 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.028789:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5308c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde0c expref: 26 pid: 6495 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891008.028806:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6498:1875787997357568:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891008.028913:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540a480 going to sleep for 11 seconds 00000100:00100000:1.0:1788891008.032844:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891008.032987:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6498:1875787997357568:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891008.033022:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd530fc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891008.033998:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987844736 00000100:00100000:0.0:1788891008.034008:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987844736 00010000:00010000:0.0:1788891008.034053:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5308c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde0c expref: 27 pid: 6495 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891008.034100:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 54 00000100:00100000:0.0:1788891008.034110:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+27:2393:x1875787987844736:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891008.034126:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891008.034133:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5308c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde0c expref: 27 pid: 6495 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.034146:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5308c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde0c expref: 27 pid: 6495 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.034244:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5308c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde0c expref: 27 pid: 6495 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.034262:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80f00) 00010000:00010000:0.0:1788891008.034267:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd530fc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.034276:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd530fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.034283:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd530fc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.034313:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891008.034454:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+26:2393:x1875787987844736:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 345us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891008.034462:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 54 00010000:00010000:2.0:1788891008.034738:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd530fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.034752:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd530fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788891008.034855:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1788891008.035044:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1788891008.035134:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6498:1875787997357696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788891008.035271:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891008.035307:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788891008.035430:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997357696 00000100:00100000:3.0:1788891008.035436:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997357696 00000100:00100000:3.0:1788891008.035486:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788891008.035493:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6498:x1875787997357696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1788891008.035671:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788891008.035909:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6498:x1875787997357696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 415us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891008.035917:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788891008.036036:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6498:1875787997357696:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788891008.036327:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1788891008.037273:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833b1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6498:1875787997357824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788891008.037330:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891008.037418:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788891008.037515:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997357824 00000100:00100000:0.0:1788891008.037551:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997357824 00000100:00100000:0.0:1788891008.037602:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788891008.037612:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6498:x1875787997357824:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788891008.037767:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6498:x1875787997357824:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 156us (436us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788891008.037774:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788891008.037863:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833b1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6498:1875787997357824:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788891008.037919:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1788891008.038034:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd530fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.038044:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd530fc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.038052:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd530fc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.038059:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891008.038063:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd530fc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.038088:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd530fc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.038104:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80f00) 00010000:00010000:2.0:1788891008.038107:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788891008.038112:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd530fc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.038118:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd530fc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788891008.039800:0:6498:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788891008.039888:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788891008.039900:0:6498:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 230284376875ns, next at 231284374359ns, rc = 0 00000001:00080000:2.0:1788891008.039911:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1788891008.040025:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80f00) 00010000:00010000:2.0:1788891008.040029:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788891008.040040:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd530e7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde36 expref: 30 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891008.040321:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+29:11120:x1875787987844608:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 15156us (15351us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1788891008.040331:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000020:00080000:2.0:1788891008.040337:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788891008.047128:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891008.047344:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987844864 00000100:00100000:0.0:1788891008.047359:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987844864 00000100:00100000:0.0:1788891008.047720:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 53 00000100:00100000:0.0:1788891008.047795:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+29:11120:x1875787987844864:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891008.047839:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891008.047874:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53103 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde3d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.047957:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53103 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde3d expref: 30 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.047973:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53103 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde3d expref: 30 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.047993:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:0.0:1788891008.047996:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788891008.048001:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5a00, rc 0) 00000100:00100000:0.0:1788891008.048162:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+30:11120:x1875787987844864:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 372us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891008.048170:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 53 00000100:00100000:3.0:1788891008.054613:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891008.054890:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987845120 00000100:00100000:0.0:1788891008.054900:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987845120 00000100:00100000:0.0:1788891008.054966:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:0.0:1788891008.055259:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509047b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+30:11120:x1875787987845120:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788891008.055847:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509047b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+31:11120:x1875787987845120:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 870us (1244us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788891008.055856:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:1.0:1788891008.131285:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891008.131377:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987845376 00000100:00100000:3.0:1788891008.131388:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987845376 00000100:00100000:3.0:1788891008.131452:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 54 00000100:00100000:3.0:1788891008.131464:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+31:11130:x1875787987845376:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891008.131488:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891008.131510:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd5310a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde44 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891008.131720:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788891008.131834:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd5310a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde44 expref: 33 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.131850:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925095f80e00) 00010000:00010000:3.0:1788891008.131853:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891008.131859:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd5310a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde44 expref: 33 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.131874:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925081523800, rc 0) 00000100:00100000:3.0:1788891008.131973:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+32:11130:x1875787987845376:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 511us (697us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1788891008.131988:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 54 00000100:00100000:1.0:1788891008.137785:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891008.137874:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987845504 00000100:00100000:3.0:1788891008.137885:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987845504 00000100:00100000:3.0:1788891008.137949:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00100000:3.0:1788891008.137960:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+32:11130:x1875787987845504:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:3.0:1788891008.138044:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53118 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138061:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53118 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138073:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53118 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138085:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5311f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138092:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5311f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138114:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5311f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138193:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53126 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138203:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53126 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138221:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53126 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788891008.138272:0:9362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53126 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138286:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53118 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138292:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53118 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138298:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53118 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138304:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081523800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891008.138308:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53118 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138316:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53118 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138327:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:3.0:1788891008.138335:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891008.138341:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53118 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138348:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53118 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138363:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5311f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138368:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5311f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138373:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5311f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138378:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891008.138381:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5311f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138387:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5311f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138395:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff925095f80900) 00010000:00010000:3.0:1788891008.138397:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891008.138400:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5311f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138406:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5311f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138416:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53126 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138428:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53126 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138434:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53126 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138439:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081523200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891008.138442:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53126 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138448:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53126 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138456:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:3.0:1788891008.138458:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891008.138461:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53126 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.138466:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53126 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891008.138579:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+32:11130:x1875787987845504:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 619us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891008.138587:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00100000:1.0:1788891008.141905:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891008.142129:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987845760 00000100:00100000:2.0:1788891008.142139:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987845760 00000100:00100000:2.0:1788891008.142197:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:2.0:1788891008.142206:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+32:11130:x1875787987845760:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788891008.142450:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+33:11130:x1875787987845760:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 243us (553us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788891008.142458:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:1.0:1788891008.179155:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891008.180044:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987846016 00000100:00100000:2.0:1788891008.180714:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987846016 00000100:00100000:2.0:1788891008.180907:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 56 00000100:00100000:2.0:1788891008.180918:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+33:11133:x1875787987846016:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788891008.180946:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891008.181039:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd5312d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde4b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181125:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53134 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181141:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53134 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181154:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53134 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181165:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5313b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181171:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5313b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181178:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5313b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181516:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53142 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181562:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181570:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891008.181582:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788891008.181660:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53134 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181668:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53134 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181676:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53134 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181682:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891008.181687:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53134 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181694:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53134 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181707:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:2.0:1788891008.181710:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891008.181716:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53134 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181722:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53134 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181737:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5313b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181750:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5313b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181764:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5313b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181770:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310e00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891008.181774:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5313b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181781:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5313b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181789:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff925095f80900) 00010000:00010000:2.0:1788891008.181792:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891008.181795:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5313b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181800:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5313b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181845:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd5312d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde4b expref: 36 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181859:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53142 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde4b expref: 35 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.181867:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:2.0:1788891008.181869:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891008.181878:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311600, rc 0) 00000100:00100000:2.0:1788891008.181955:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+35:11133:x1875787987846016:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1038us (2809us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788891008.181963:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 56 00000100:00100000:1.0:1788891008.185055:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891008.185142:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987846144 00000100:00100000:3.0:1788891008.185155:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987846144 00000100:00100000:3.0:1788891008.185297:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 57 00000100:00100000:3.0:1788891008.185308:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+35:11133:x1875787987846144:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:3.0:1788891008.185388:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53150 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.185562:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53150 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.185578:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53150 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.185618:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53150 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.185625:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53150 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.185632:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53150 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.185638:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081523200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891008.185642:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53150 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.185650:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53150 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.185661:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:3.0:1788891008.185665:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891008.185669:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53150 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891008.185675:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53150 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891008.185752:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+35:11133:x1875787987846144:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 445us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891008.185766:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 57 00000100:00100000:1.0:1788891008.189756:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891008.189852:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987846400 00000100:00100000:0.0:1788891008.189863:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987846400 00000100:00100000:0.0:1788891008.189918:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:0.0:1788891008.189927:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+35:11133:x1875787987846400:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788891008.190199:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+36:11133:x1875787987846400:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 272us (501us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788891008.190207:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:1.0:1788891008.385987:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891008.386564:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987846656 00000100:00100000:0.0:1788891008.386584:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987846656 00000100:00100000:0.0:1788891008.387336:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 58 00000100:00100000:0.0:1788891008.387351:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+36:11164:x1875787987846656:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:0.0:1788891008.387391:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891008.387418:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd53157 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde52 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.387559:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5315e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.387592:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5315e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.387604:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5315e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891008.387617:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788891008.387746:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd53157 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde52 expref: 39 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.387765:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5315e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde52 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.387774:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:0.0:1788891008.387777:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788891008.387780:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4400, rc 0) 00000100:00100000:0.0:1788891008.387850:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+38:11164:x1875787987846656:12345-192.168.204.26@tcp:101:cat.0 Request processed in 504us (1881us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788891008.387858:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 58 00000100:00100000:1.0:1788891008.393370:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891008.393448:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891008.393482:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987846784 00000100:00100000:3.0:1788891008.393496:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987846784 00000100:00100000:3.0:1788891008.393611:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:3.0:1788891008.393625:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+38:2394:x1875787987846784:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891008.393647:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891008.393680:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5315e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde52 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891008.393689:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987847040 00010000:00010000:3.0:1788891008.393705:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00000100:00100000:2.0:1788891008.393706:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987847040 00010000:00010000:3.0:1788891008.393713:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891008.393761:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:3.0:1788891008.393796:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+38:2394:x1875787987846784:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 174us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891008.393812:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:2.0:1788891008.393970:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+37:11164:x1875787987847040:12345-192.168.204.26@tcp:35:cat.0 00000100:00100000:2.0:1788891008.394252:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+38:11164:x1875787987847040:12345-192.168.204.26@tcp:35:cat.0 Request processed in 482us (803us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788891008.394271:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:3.0:1788891008.450108:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891008.454412:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987847296 00000100:00100000:2.0:1788891008.454435:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987847296 00000100:00100000:2.0:1788891008.454551:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:2.0:1788891008.454566:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+38:11170:x1875787987847296:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1788891008.454600:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891008.454603:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788891008.454637:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd530c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde28 expref: 38 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.454662:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:2.0:1788891008.454668:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891008.454686:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd5316c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde59 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.454828:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53173 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.454867:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53142 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde4b expref: 38 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.454876:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53173 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.454920:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53142 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde4b expref: 38 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.454936:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53142 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde4b expref: 38 pid: 6495 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891008.454954:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6495:1875787997357952:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891008.456042:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788891008.458952:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891008.459077:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6495:1875787997357952:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891008.459115:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53173 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891008.461506:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987847424 00000100:00100000:1.0:1788891008.461684:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987847424 00010000:00010000:1.0:1788891008.461753:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53142 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde4b expref: 39 pid: 6495 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891008.463044:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00100000:1.0:1788891008.463065:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+39:2394:x1875787987847424:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891008.463087:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891008.463098:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53142 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde4b expref: 39 pid: 6495 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.463132:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53142 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde4b expref: 39 pid: 6495 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.463187:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53142 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde4b expref: 39 pid: 6495 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.463221:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:1.0:1788891008.463228:0:7436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53173 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.463238:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53173 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.463247:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53173 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.463289:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891008.463393:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+38:2394:x1875787987847424:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 338us (4456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891008.463403:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 55 00010000:00010000:2.0:1788891008.463459:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53173 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.463471:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53173 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891008.463716:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788891008.463947:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd5316c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde59 expref: 39 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.463983:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53173 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde59 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.463992:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:2.0:1788891008.463996:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788891008.463998:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310e00, rc 0) 00000100:00100000:2.0:1788891008.464103:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+38:11170:x1875787987847296:12345-192.168.204.26@tcp:101:dd.0 Request processed in 9540us (14013us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788891008.464114:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:3.0:1788891008.465671:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891008.466516:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987847552 00000100:00100000:0.0:1788891008.466648:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987847552 00000100:00100000:0.0:1788891008.466754:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 359 00000100:00100000:0.0:1788891008.466777:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2394:x1875787987847552:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891008.466890:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2394:x1875787987847552:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 125us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891008.466907:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 359 00000100:00100000:0.0:1788891008.469872:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891008.469928:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891008.469961:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891008.470000:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891008.470045:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987847808 00000100:00100000:0.0:1788891008.470056:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987847808 00000100:00100000:0.0:1788891008.470126:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987847680 00000100:00100000:0.0:1788891008.470130:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987847680 00000100:00100000:0.0:1788891008.470164:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987847936 00000100:00100000:0.0:1788891008.470167:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987847936 00000100:00100000:0.0:1788891008.470184:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987848064 00000100:00100000:0.0:1788891008.470186:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987848064 00000100:00100000:0.0:1788891008.470241:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 188 00000100:00100000:0.0:1788891008.470253:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987847808:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891008.470347:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987847808:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 96us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891008.473020:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 189 00000100:00100000:1.0:1788891008.473056:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987847680:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788891008.473294:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987847680:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 258us (3364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891008.473304:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 189 00000100:00100000:1.0:1788891008.473351:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 190 00000100:00100000:1.0:1788891008.473360:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2393:x1875787987847936:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788891008.473390:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2393:x1875787987847936:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 32us (3429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891008.473419:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 190 00000100:00100000:1.0:1788891008.473435:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:1.0:1788891008.473444:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+38:11170:x1875787987848064:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1788891008.473465:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891008.473491:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd53181 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde60 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891008.473979:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 188 00010000:00010000:1.0:1788891008.473988:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd53188 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.474008:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd53188 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.474022:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd53188 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788891008.474023:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788891008.474029:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788891008.475248:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd53181 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde60 expref: 40 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.475278:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd53188 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde60 expref: 39 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.475288:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:1.0:1788891008.475291:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788891008.475294:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857df000, rc 0) 00000100:00100000:1.0:1788891008.475498:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+39:11170:x1875787987848064:12345-192.168.204.26@tcp:101:dd.0 Request processed in 1924us (5367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891008.475509:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:0.0:1788891008.485957:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891008.486133:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987848320 00000100:00100000:1.0:1788891008.486147:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987848320 00000100:00100000:1.0:1788891008.486228:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:1.0:1788891008.486239:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+39:11170:x1875787987848320:12345-192.168.204.26@tcp:36:dd.0 00010000:00010000:1.0:1788891008.486520:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd5318f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.486580:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd5318f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.486594:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd5318f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788891008.486643:0:9362:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:1.0:1788891008.486664:0:9362:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071823681 reply state 00000000f5daa94d transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd5318f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.486679:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd5318f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.486687:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:1.0:1788891008.486690:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788891008.486694:0:9362:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788891008.486818:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+42:11170:x1875787987848320:12345-192.168.204.26@tcp:36:dd.0 Request processed in 571us (1448us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1788891008.486826:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 61 00000020:00080000:1.0:1788891008.486833:0:9362:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788891008.688024:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891008.688282:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987848448 00000100:00100000:2.0:1788891008.688298:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987848448 00000100:00100000:2.0:1788891008.688387:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:2.0:1788891008.688400:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+42:11184:x1875787987848448:12345-192.168.204.26@tcp:101:stat.0 00010000:00010000:2.0:1788891008.688801:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891008.688830:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53196 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde67 expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.689594:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5319d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.689614:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5319d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.689629:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5319d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.689641:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd531a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.689665:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd531a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.689672:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd531a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.689961:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd531ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.689977:0:12407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53173 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde59 expref: 43 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.689986:0:12407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd531ab lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.690084:0:12407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53173 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde59 expref: 43 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891008.690102:0:12407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53173 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde59 expref: 43 pid: 6495 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891008.690119:0:12407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997358080:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891008.690304:0:12407:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788891008.693779:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891008.693879:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987848704 00000100:00100000:0.0:1788891008.693900:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987848704 00000100:00100000:0.0:1788891008.693978:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:0.0:1788891008.693990:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+44:6155:x1875787987848704:12345-192.168.204.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788891008.694371:0:12407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997358080:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891008.694406:0:12407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd531ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891008.694428:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+45:6155:x1875787987848704:12345-192.168.204.26@tcp:35:ldlm_bl.0 Request processed in 438us (664us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788891008.694438:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:0.0:1788891008.696502:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891008.696714:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987848832 00000100:00100000:1.0:1788891008.696726:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987848832 00010000:00010000:1.0:1788891008.696881:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53173 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde59 expref: 45 pid: 6495 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891008.696946:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 56 00000100:00100000:1.0:1788891008.696959:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+45:2394:x1875787987848832:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891008.696980:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891008.696988:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53173 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde59 expref: 45 pid: 6495 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.697003:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53173 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde59 expref: 45 pid: 6495 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.697031:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53173 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde59 expref: 45 pid: 6495 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.697052:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:1.0:1788891008.697059:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd531ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.697070:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd531ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.697078:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd531ab lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.697162:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891008.697238:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+44:2394:x1875787987848832:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 280us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891008.697247:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 56 00010000:00010000:0.0:1788891008.699088:0:12407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd531ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.699106:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd531ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891008.699181:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788891008.699187:0:12407:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788891008.699354:0:12407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd531ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.699518:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd531ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.701925:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5319d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.701936:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5319d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.701945:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5319d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.701952:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891008.701957:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5319d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.701966:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5319d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.701991:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:0.0:1788891008.701995:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891008.702000:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5319d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.702031:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5319d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.702054:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd531a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.702060:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd531a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.702066:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd531a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.702071:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891008.702075:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd531a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.702081:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd531a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.702090:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff925095f80900) 00010000:00010000:0.0:1788891008.702093:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891008.702096:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd531a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.702102:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd531a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.702165:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53196 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde67 expref: 44 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.702196:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd531ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde67 expref: 43 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.702217:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:0.0:1788891008.702220:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788891008.702222:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310200, rc 0) 00000100:00100000:0.0:1788891008.702435:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+43:11184:x1875787987848448:12345-192.168.204.26@tcp:101:stat.0 Request processed in 14035us (14435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891008.702447:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:0.0:1788891008.765517:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891008.765683:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987849088 00000100:00100000:1.0:1788891008.765704:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987849088 00000100:00100000:1.0:1788891008.765761:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:1.0:1788891008.765771:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+43:11190:x1875787987849088:12345-192.168.204.26@tcp:36:truncate.0 00010000:00010000:1.0:1788891008.765826:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891008.765854:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd531ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde67 expref: 43 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.765874:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:1.0:1788891008.765878:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788891008.766035:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dea00/0xa66601b03fd531b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.766049:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dea00/0xa66601b03fd531b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.766059:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dea00/0xa66601b03fd531b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788891008.766096:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1788891008.766112:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000556291c1 reply state 0000000046b56dd5 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dea00/0xa66601b03fd531b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.766124:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dea00/0xa66601b03fd531b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891008.766130:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:1.0:1788891008.766133:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788891008.766135:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788891008.766296:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+45:11190:x1875787987849088:12345-192.168.204.26@tcp:36:truncate.0 Request processed in 525us (786us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788891008.766304:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 63 00000020:00080000:1.0:1788891008.766315:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788891008.918384:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891008.918502:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987849216 00000100:00100000:0.0:1788891008.918513:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987849216 00000100:00100000:0.0:1788891008.918599:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:0.0:1788891008.918610:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+45:11204:x1875787987849216:12345-192.168.204.26@tcp:101:stat.0 00010000:00010000:0.0:1788891008.918637:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891008.918659:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd531b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde6e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.918729:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd531c0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.918745:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd531c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.918757:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd531c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.918788:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.918796:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.918804:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.918881:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd531ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.918891:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd531ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.918898:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd531ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891008.918943:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788891008.918948:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788891008.918966:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd531ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.918979:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd531ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.918988:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd531c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.918995:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd531c0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.919116:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd531c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.919124:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891008.919128:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd531c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.919137:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd531c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.919149:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:0.0:1788891008.919152:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891008.919241:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd531c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.919248:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd531c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.919263:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.919268:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.919274:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.919278:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891008.919281:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.919297:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.919306:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff925095f80900) 00010000:00010000:0.0:1788891008.919309:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891008.919312:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.919317:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.919342:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd531b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde6e expref: 47 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.919354:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd531ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde6e expref: 46 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.919361:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:0.0:1788891008.919363:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788891008.919365:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4400, rc 0) 00000100:00100000:0.0:1788891008.919475:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+46:11204:x1875787987849216:12345-192.168.204.26@tcp:101:stat.0 Request processed in 866us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891008.919483:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 64 00010000:00010000:3.0:1788891008.955782:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891008.985479:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891008.985597:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987849472 00000100:00100000:0.0:1788891008.985607:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987849472 00000100:00100000:0.0:1788891008.985671:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:0.0:1788891008.985681:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+46:11214:x1875787987849472:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891008.985734:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891008.985761:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd531d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde75 expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891008.985865:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788891008.985960:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd531d5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde75 expref: 48 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.985975:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925095f80e00) 00010000:00010000:0.0:1788891008.985978:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788891008.985984:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd531d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde75 expref: 48 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891008.985998:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5600, rc 0) 00000100:00100000:0.0:1788891008.986063:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+47:11214:x1875787987849472:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 383us (594us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1788891008.986071:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:3.0:1788891008.988582:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891008.989797:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987849728 00000100:00100000:2.0:1788891008.989838:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987849728 00000100:00100000:2.0:1788891008.989923:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:2.0:1788891008.989936:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+47:11214:x1875787987849728:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788891008.990270:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+48:11214:x1875787987849728:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 327us (1688us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1788891008.990280:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:2.0:1788891009.035091:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891009.035256:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987849984 00000100:00100000:0.0:1788891009.035270:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987849984 00000100:00100000:0.0:1788891009.035351:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:0.0:1788891009.035364:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+48:11220:x1875787987849984:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788891009.035400:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891009.035427:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd531e3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde7c expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.035619:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.035661:0:9362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd531ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde6e expref: 49 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.035672:0:9362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531ea lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.035806:0:9362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd531ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde6e expref: 49 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.035823:0:9362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd531ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde6e expref: 49 pid: 6495 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891009.035840:0:9362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf790700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9362:1875787997358208:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891009.036038:0:9362:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab09180 going to sleep for 11 seconds 00000100:00100000:3.0:1788891009.038490:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891009.038743:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987850112 00000100:00100000:1.0:1788891009.038755:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987850112 00010000:00010000:1.0:1788891009.038812:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd531ce lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde6e expref: 50 pid: 6495 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891009.038861:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 57 00000100:00100000:1.0:1788891009.038874:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087acd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+50:2393:x1875787987850112:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891009.038892:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891009.038910:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd531ce lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde6e expref: 50 pid: 6495 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.038926:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd531ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde6e expref: 50 pid: 6495 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.038955:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:1.0:1788891009.038961:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.038974:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.038983:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531ea lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.039009:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891009.039121:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087acd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+50:2393:x1875787987850112:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 250us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891009.039130:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 57 00010000:00010000:0.0:1788891009.039767:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd531ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde6e expref: 49 pid: 6495 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891009.039789:0:9362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf790700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9362:1875787997358208:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788891009.039813:0:9362:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.039824:0:9362:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.039829:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891009.039853:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788891009.040049:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd531e3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde7c expref: 50 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.040067:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde7c expref: 49 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.040076:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:0.0:1788891009.040079:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788891009.040082:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4c00, rc 0) 00000100:00100000:0.0:1788891009.040123:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+49:11220:x1875787987849984:12345-192.168.204.26@tcp:101:bash.0 Request processed in 4762us (5048us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788891009.040130:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:3.0:1788891009.046688:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891009.046842:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987850368 00000100:00100000:0.0:1788891009.046857:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987850368 00000100:00100000:0.0:1788891009.046955:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:0.0:1788891009.046969:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+49:11220:x1875787987850368:12345-192.168.204.26@tcp:36:bash.0 00010000:00010000:0.0:1788891009.047324:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd531f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.047346:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd531f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.047373:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd531f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788891009.047429:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1788891009.047453:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001842494c reply state 00000000ab971c70 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd531f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.047468:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd531f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.047483:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:0.0:1788891009.047486:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788891009.047491:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788891009.047627:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+52:11220:x1875787987850368:12345-192.168.204.26@tcp:36:bash.0 Request processed in 661us (956us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1788891009.047635:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 67 00000020:00080000:0.0:1788891009.047642:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788891009.055418:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891009.055730:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987850496 00000100:00100000:1.0:1788891009.055746:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987850496 00000100:00100000:1.0:1788891009.055867:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:1.0:1788891009.055879:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+52:11220:x1875787987850496:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1788891009.055915:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891009.055943:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd531ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde83 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.056072:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53206 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.056103:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531ea lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde7c expref: 53 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.056114:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53206 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.056161:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde7c expref: 53 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.056177:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde7c expref: 53 pid: 9362 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891009.056205:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c17480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6496:1875787997358336:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891009.056336:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250863123c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891009.062455:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891009.062855:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987850624 00000100:00100000:0.0:1788891009.062869:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987850624 00010000:00010000:0.0:1788891009.062941:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531ea lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde7c expref: 54 pid: 9362 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891009.062995:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 58 00000100:00100000:0.0:1788891009.063008:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83840380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+54:2394:x1875787987850624:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891009.063028:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891009.063036:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531ea lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde7c expref: 54 pid: 9362 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.063054:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde7c expref: 54 pid: 9362 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.063082:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:0.0:1788891009.063101:0:7436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53206 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.063113:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53206 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.063146:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53206 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.063171:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891009.063482:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83840380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+54:2394:x1875787987850624:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 475us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891009.063493:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 58 00010000:00010000:1.0:1788891009.064620:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd531ea lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde7c expref: 53 pid: 9362 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891009.064647:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c17480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6496:1875787997358336:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891009.064703:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53206 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.064716:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53206 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.064723:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53206 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891009.064799:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788891009.064804:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788891009.064831:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53206 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.064873:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd531ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde83 expref: 53 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.064891:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53206 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde83 expref: 52 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.064900:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:1.0:1788891009.064903:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788891009.064906:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857df800, rc 0) 00000100:00100000:1.0:1788891009.064972:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+52:11220:x1875787987850496:12345-192.168.204.26@tcp:101:bash.0 Request processed in 9095us (9569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891009.064982:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:3.0:1788891009.070790:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891009.070835:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987850880 00000100:00100000:1.0:1788891009.070849:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987850880 00000100:00100000:1.0:1788891009.070985:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:1.0:1788891009.070998:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090478c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+52:11220:x1875787987850880:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:1.0:1788891009.071374:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090478c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+53:11220:x1875787987850880:12345-192.168.204.26@tcp:35:bash.0 Request processed in 377us (597us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788891009.071382:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:2.0:1788891009.136097:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891009.137172:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987851136 00000100:00100000:0.0:1788891009.137187:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987851136 00000100:00100000:0.0:1788891009.137291:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:0.0:1788891009.137304:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+53:11230:x1875787987851136:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891009.137337:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891009.137372:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5320d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde8a expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891009.137613:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788891009.137778:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5320d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde8a expref: 55 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.137884:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925095f80e00) 00010000:00010000:0.0:1788891009.137888:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788891009.137926:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5320d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde8a expref: 55 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.137944:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4400, rc 0) 00000100:00100000:0.0:1788891009.138072:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+54:11230:x1875787987851136:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 770us (1990us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1788891009.138089:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:3.0:1788891009.147671:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891009.148611:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987851264 00000100:00100000:2.0:1788891009.148627:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987851264 00000100:00100000:2.0:1788891009.148714:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:2.0:1788891009.148728:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+54:11230:x1875787987851264:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:2.0:1788891009.148842:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd5321b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.148864:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd5321b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.148879:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd5321b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.148892:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53222 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.148899:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.148905:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149014:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53229 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149024:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53229 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149030:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53229 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788891009.149090:0:12407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53229 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149106:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd5321b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149113:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd5321b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149119:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd5321b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149126:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891009.149130:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd5321b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149137:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd5321b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149151:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:2.0:1788891009.149154:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891009.149158:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd5321b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149171:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd5321b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149185:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149202:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53222 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149208:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53222 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149212:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891009.149216:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53222 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149221:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53222 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149229:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff925095f80900) 00010000:00010000:2.0:1788891009.149231:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891009.149234:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53222 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149240:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53222 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149249:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53229 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149254:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53229 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149264:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53229 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149269:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310e00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891009.149271:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53229 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149277:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53229 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149283:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:2.0:1788891009.149286:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891009.149288:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53229 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.149294:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53229 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891009.149407:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+54:11230:x1875787987851264:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 679us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891009.149417:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:3.0:1788891009.151220:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891009.151431:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987851520 00000100:00100000:2.0:1788891009.151445:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987851520 00000100:00100000:2.0:1788891009.151599:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:2.0:1788891009.151628:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+54:11230:x1875787987851520:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788891009.152018:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+55:11230:x1875787987851520:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 393us (813us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788891009.152028:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:0.0:1788891009.196981:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891009.197104:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987851776 00000100:00100000:1.0:1788891009.197118:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987851776 00000100:00100000:1.0:1788891009.197212:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 71 00000100:00100000:1.0:1788891009.197227:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+55:11233:x1875787987851776:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788891009.197276:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891009.197306:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53230 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde91 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197418:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd53237 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197442:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd53237 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197456:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd53237 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197469:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df200/0xa66601b03fd5323e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197477:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df200/0xa66601b03fd5323e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197495:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df200/0xa66601b03fd5323e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197691:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53245 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197722:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53245 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197730:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53245 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891009.197744:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788891009.197853:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd53237 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197866:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd53237 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197873:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd53237 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197880:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891009.197886:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd53237 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197894:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd53237 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197907:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:1.0:1788891009.197911:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891009.197916:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd53237 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197924:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd53237 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197942:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df200/0xa66601b03fd5323e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197955:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df200/0xa66601b03fd5323e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197962:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df200/0xa66601b03fd5323e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197968:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891009.197971:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df200/0xa66601b03fd5323e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197978:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df200/0xa66601b03fd5323e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197986:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff925095f80900) 00010000:00010000:1.0:1788891009.197990:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891009.197993:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df200/0xa66601b03fd5323e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.197999:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df200/0xa66601b03fd5323e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.198053:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53230 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde91 expref: 58 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.198072:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53245 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde91 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.198080:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:1.0:1788891009.198083:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788891009.198094:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857de200, rc 0) 00000100:00100000:1.0:1788891009.198199:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+57:11233:x1875787987851776:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 966us (1224us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788891009.198208:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 71 00000100:00100000:3.0:1788891009.203502:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891009.203625:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891009.203814:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987851904 00000100:00100000:0.0:1788891009.203829:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987851904 00000100:00100000:0.0:1788891009.203920:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 72 00000100:00100000:0.0:1788891009.203933:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+57:11233:x1875787987851904:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:0.0:1788891009.204034:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53253 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.204057:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53253 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.204073:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53253 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.204122:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53253 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.204130:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53253 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.204137:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53253 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.204144:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891009.204150:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53253 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.204158:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53253 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.204204:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:0.0:1788891009.204208:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788891009.204215:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53253 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.204222:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53253 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891009.204328:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+57:11233:x1875787987851904:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 396us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891009.204337:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 72 00000100:00100000:1.0:1788891009.205094:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987852032 00000100:00100000:1.0:1788891009.205102:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987852032 00000100:00100000:1.0:1788891009.205161:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:1.0:1788891009.205171:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83840a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+57:2391:x1875787987852032:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891009.205186:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891009.205220:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53245 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde91 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.205236:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:1.0:1788891009.205240:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891009.205281:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83840a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+56:2391:x1875787987852032:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 112us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891009.205288:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:3.0:1788891009.209068:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891009.209270:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987852288 00000100:00100000:1.0:1788891009.209284:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987852288 00000100:00100000:1.0:1788891009.209409:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:1.0:1788891009.209421:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+56:11233:x1875787987852288:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:1.0:1788891009.209783:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+57:11233:x1875787987852288:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 363us (732us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788891009.209792:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:0.0:1788891009.370695:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891009.370796:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987852544 00000100:00100000:3.0:1788891009.370811:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987852544 00000100:00100000:3.0:1788891009.370897:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00100000:3.0:1788891009.370909:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+57:11251:x1875787987852544:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:3.0:1788891009.370945:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891009.370971:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5325a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde98 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.371117:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53261 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.371135:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53261 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.371151:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53261 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891009.371165:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788891009.371309:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5325a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde98 expref: 60 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.371333:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53261 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde98 expref: 59 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.371344:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:3.0:1788891009.371364:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788891009.371369:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925081523200, rc 0) 00000100:00100000:3.0:1788891009.371452:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+59:11251:x1875787987852544:12345-192.168.204.26@tcp:101:cat.0 Request processed in 546us (774us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1788891009.371460:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00100000:3.0:1788891009.397854:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891009.398009:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987852672 00000100:00100000:2.0:1788891009.398024:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987852672 00000100:00100000:2.0:1788891009.398209:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 74 00000100:00100000:2.0:1788891009.398223:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+59:11252:x1875787987852672:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788891009.398260:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891009.398287:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5326f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dde9f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.398450:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53276 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.398468:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53276 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.398483:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53276 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891009.398585:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788891009.398590:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788891009.398617:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53276 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.398653:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5326f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde9f expref: 61 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.398675:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53276 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde9f expref: 60 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.398685:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:2.0:1788891009.398689:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788891009.398713:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311000, rc 0) 00000100:00100000:2.0:1788891009.398806:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+60:11252:x1875787987852672:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 585us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891009.398814:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 74 00000100:00100000:2.0:1788891009.404874:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891009.405070:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987853056 00000100:00100000:3.0:1788891009.405086:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987853056 00000100:00100000:3.0:1788891009.405164:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:3.0:1788891009.405176:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+60:11252:x1875787987853056:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:3.0:1788891009.405638:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+61:11252:x1875787987853056:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 462us (781us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788891009.405647:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:0.0:1788891009.408291:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891009.408403:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987853184 00000100:00100000:3.0:1788891009.408417:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987853184 00000100:00100000:3.0:1788891009.408508:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:3.0:1788891009.408558:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf793b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+61:11252:x1875787987853184:12345-192.168.204.26@tcp:103:lfs.0 00010000:00010000:3.0:1788891009.408581:0:10317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788891009.408618:0:10317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53206 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde83 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.408648:0:10317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53261 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde98 expref: 60 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.408667:0:10317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53103 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde3d expref: 59 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.408708:0:10317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:3.0:1788891009.408716:0:10317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891009.408812:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf793b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+58:11252:x1875787987853184:12345-192.168.204.26@tcp:103:lfs.0 Request processed in 292us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891009.408821:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:0.0:1788891009.416192:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891009.418322:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987853312 00000100:00100000:2.0:1788891009.418343:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987853312 00000100:00100000:2.0:1788891009.418600:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 75 00000100:00100000:2.0:1788891009.418614:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+58:11252:x1875787987853312:12345-192.168.204.26@tcp:58:lfs.0 00010000:00010000:2.0:1788891009.418779:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5327d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.418800:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5327d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.418815:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5327d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788891009.419120:0:12407:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788891009.419313:0:12407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788891009.419418:0:12407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788891009.419558:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+58:11252:x1875787987853312:12345-192.168.204.26@tcp:58:lfs.0 Request processed in 945us (3389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891009.419569:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 75 00000100:00100000:0.0:1788891009.442753:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891009.443750:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987853440 00000100:00100000:3.0:1788891009.443779:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987853440 00000100:00100000:3.0:1788891009.443930:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 76 00000100:00100000:3.0:1788891009.443945:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+58:11254:x1875787987853440:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891009.444049:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891009.444079:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53284 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddea6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444182:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5328b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444212:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5328b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444225:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5328b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444240:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53292 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444249:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53292 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444280:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53292 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444452:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53299 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444463:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444471:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891009.444632:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788891009.444638:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891009.444666:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444684:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444694:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5328b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444701:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5328b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444709:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5328b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444715:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891009.444720:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5328b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444739:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5328b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444756:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:3.0:1788891009.444759:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891009.444833:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5328b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444842:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5328b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444860:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53292 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444867:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53292 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444873:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53292 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444878:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081523800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891009.444882:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53292 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444888:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53292 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444897:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff925095f80900) 00010000:00010000:3.0:1788891009.444901:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891009.444904:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53292 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.444919:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53292 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.445017:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53284 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddea6 expref: 60 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.445035:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53299 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddea6 expref: 59 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.445043:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:3.0:1788891009.445046:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788891009.445049:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925081522800, rc 0) 00000100:00100000:3.0:1788891009.445137:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+59:11254:x1875787987853440:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1196us (2409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891009.445145:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 76 00000100:00100000:1.0:1788891009.659859:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997358720:0@lo:400:kworker.0 00000100:00100000:1.0:1788891009.659927:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891009.659992:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997359232:0@lo:400:kworker.0 00000100:00100000:1.0:1788891009.660016:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891009.660037:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997359744:0@lo:400:kworker.0 00000100:00100000:1.0:1788891009.660055:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891009.660079:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788891009.660086:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997358848:0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.660100:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997358592:0@lo:400:kworker.0 00000100:00100000:1.0:1788891009.660111:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891009.660136:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997359360:0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.660143:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891009.660169:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891009.660174:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997359104:0@lo:400:kworker.0 00000100:00100000:1.0:1788891009.660208:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997359872:0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.660216:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891009.660243:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891009.660249:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1875787997359616:0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.660276:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891009.660289:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997358720 00000100:00100000:0.0:1788891009.660295:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788891009.660298:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997358720 00000100:00100000:0.0:1788891009.660303:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997358464:0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.660336:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891009.660363:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997358976:0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.660384:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891009.660410:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997359488:0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.660457:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891009.660478:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997358976 00000100:00100000:2.0:1788891009.660484:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997358976 00000100:00100000:0.0:1788891009.660485:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f82e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997360000:0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.660514:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891009.660519:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788891009.660570:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997359360 00000100:00100000:0.0:1788891009.660574:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997359360 00000100:00100000:0.0:1788891009.660621:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997359872 00000100:00100000:0.0:1788891009.660625:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997359872 00000100:00100000:0.0:1788891009.660641:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997359488 00000100:00100000:0.0:1788891009.660643:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997359488 00000100:00100000:0.0:1788891009.660653:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997360000 00000100:00100000:0.0:1788891009.660655:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997360000 00000100:00100000:0.0:1788891009.660668:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788891009.660676:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997359360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.660730:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997359360:12345-0@lo:400:kworker.0 Request processed in 54us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891009.660737:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788891009.660754:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788891009.660760:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997359872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.660784:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997359872:12345-0@lo:400:kworker.0 Request processed in 25us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891009.660790:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788891009.660798:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788891009.660803:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997359488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.660828:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997359488:12345-0@lo:400:kworker.0 Request processed in 25us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891009.660835:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788891009.660852:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788891009.660858:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3628:x1875787997360000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.660886:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3628:x1875787997360000:12345-0@lo:400:kworker.0 Request processed in 28us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891009.660892:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1788891009.660910:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788891009.660914:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891009.660944:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997359360:0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.660956:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997359872:0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.660984:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997359488:0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.660993:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997360000:0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.661024:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997359232 00000100:00100000:0.0:1788891009.661028:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997359232 00000100:00100000:0.0:1788891009.661051:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997359744 00000100:00100000:0.0:1788891009.661054:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997359744 00000100:00100000:0.0:1788891009.661064:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997358848 00000100:00100000:0.0:1788891009.661066:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997358848 00000100:00100000:0.0:1788891009.661075:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997358592 00000100:00100000:0.0:1788891009.661077:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997358592 00000100:00100000:0.0:1788891009.661084:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997359104 00000100:00100000:0.0:1788891009.661086:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997359104 00000100:00100000:0.0:1788891009.661097:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997359616 00000100:00100000:0.0:1788891009.661099:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997359616 00000100:00100000:0.0:1788891009.661111:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788891009.661117:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997359232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.661154:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997359232:12345-0@lo:400:kworker.0 Request processed in 37us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891009.661170:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788891009.661196:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788891009.661202:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997359744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.661231:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997359744:12345-0@lo:400:kworker.0 Request processed in 29us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891009.661237:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788891009.661248:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788891009.661253:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997358848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.661278:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997358848:12345-0@lo:400:kworker.0 Request processed in 25us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891009.661284:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788891009.661293:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788891009.661298:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997358592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.661324:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997358592:12345-0@lo:400:kworker.0 Request processed in 25us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891009.661329:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788891009.661338:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788891009.661344:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875787997359104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.661366:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875787997359104:12345-0@lo:400:kworker.0 Request processed in 23us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891009.661372:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788891009.661380:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788891009.661385:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875787997359616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.661407:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875787997359616:12345-0@lo:400:kworker.0 Request processed in 22us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891009.661418:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:0.0:1788891009.661436:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788891009.661439:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788891009.661460:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997358848:0@lo:400:kworker.0 00010000:00080000:0.0:1788891009.661473:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf739f80 x1875787997359232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891009.661483:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997359232:0@lo:400:kworker.0 00010000:00080000:0.0:1788891009.661492:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f82e51c00 x1875787997359744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891009.661499:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997359744:0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.661540:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997358592:0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.661550:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997359104:0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.661559:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82e51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1875787997359616:0@lo:400:kworker.0 00000100:00100000:1.0:1788891009.662508:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997358720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891009.662581:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997358720:12345-0@lo:400:kworker.0 Request processed in 82us (2653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891009.663469:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788891009.663480:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997358976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891009.663542:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997358976:12345-0@lo:400:kworker.0 Request processed in 65us (3157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891009.663560:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788891009.663589:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997358464 00000100:00100000:2.0:1788891009.663595:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997358464 00000100:00100000:2.0:1788891009.663624:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788891009.663630:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3628:x1875787997358464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891009.663658:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3628:x1875787997358464:12345-0@lo:400:kworker.0 Request processed in 28us (3322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891009.663663:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788891009.663798:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997358464:0@lo:400:kworker.0 00000100:00100000:2.0:1788891009.663811:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f82ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997358976:0@lo:400:kworker.0 00000100:00100000:0.0:1788891009.663954:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997358720:0@lo:400:kworker.0 00000100:00100000:1.0:1788891009.666462:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000040:00080000:1.0:1788891009.723705:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788891009.723714:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788891009.723748:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788891009.723756:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788891009.723887:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875787997360128:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788891009.724032:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bf6c7180 going to sleep for 11 seconds 00000100:00100000:1.0:1788891009.727755:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875787997360128:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788891009.728672:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891009.728824:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987853568 00000100:00100000:2.0:1788891009.728832:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987853568 00000100:00100000:2.0:1788891009.728913:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00100000:2.0:1788891009.728925:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+59:11265:x1875787987853568:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788891009.728958:0:12407:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788891009.729075:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+59:11265:x1875787987853568:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 151us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891009.729085:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00100000:2.0:1788891009.735454:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891009.735555:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987853696 00000100:00100000:3.0:1788891009.735566:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987853696 00000100:00100000:3.0:1788891009.735623:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00100000:3.0:1788891009.735632:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+59:11265:x1875787987853696:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788891009.735717:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd532a0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.735734:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd532a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.735747:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd532a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.735818:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd532a7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.735826:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd532a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.735833:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd532a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.735866:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd532ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.735875:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd532ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.735881:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd532ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891009.735928:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788891009.735933:0:9362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891009.735947:0:9362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd532ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.735958:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd532a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.735964:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd532a0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.735971:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd532a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.735987:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081523200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891009.735992:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd532a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.736000:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd532a0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.736013:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9250905a3b00) 00010000:00010000:3.0:1788891009.736016:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891009.736021:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd532a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.736027:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd532a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.736041:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd532a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.736046:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd532a7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.736052:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd532a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.736056:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081523800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891009.736058:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd532a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.736063:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd532a7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.736078:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9250905a3d00) 00010000:00010000:3.0:1788891009.736080:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891009.736082:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd532a7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.736088:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd532a7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.736099:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd532ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.736104:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd532ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.736109:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd532ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.736113:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891009.736116:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd532ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.736121:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd532ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.736126:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:3.0:1788891009.736128:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891009.736130:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd532ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.736135:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd532ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891009.736217:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+59:11265:x1875787987853696:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 Request processed in 585us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891009.736224:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00100000:1.0:1788891009.742820:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891009.742902:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987853952 00000100:00100000:3.0:1788891009.742914:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987853952 00000100:00100000:3.0:1788891009.742976:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 79 00000100:00100000:3.0:1788891009.742986:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+59:11265:x1875787987853952:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788891009.743007:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891009.743025:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd532b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddead expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.743140:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd532bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.743157:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd532bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.743170:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd532bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891009.743194:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788891009.743285:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd532bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.743293:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd532bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.743301:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd532bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.743319:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ec600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891009.743324:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd532bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.743333:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd532bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.743346:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:3.0:1788891009.743350:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788891009.743355:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd532bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.743361:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd532bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.743403:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd532b5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddead expref: 61 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.743413:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9250905a3b00) 00010000:00010000:3.0:1788891009.743415:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891009.743418:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd532b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddead expref: 61 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.743427:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ede00, rc 0) 00000100:00100000:3.0:1788891009.743496:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+60:11265:x1875787987853952:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 510us (684us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1788891009.743503:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 79 00000100:00100000:0.0:1788891009.753243:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891009.753556:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987854080 00000100:00100000:2.0:1788891009.754717:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987854080 00000100:00100000:2.0:1788891009.754790:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 80 00000100:00100000:2.0:1788891009.754800:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+60:11265:x1875787987854080:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788891009.754838:0:12407:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788891009.754981:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+60:11265:x1875787987854080:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 182us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891009.754989:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 80 00000100:00100000:2.0:1788891009.761142:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891009.762310:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987854336 00000100:00100000:3.0:1788891009.762333:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987854336 00000100:00100000:3.0:1788891009.762419:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 81 00000100:00100000:3.0:1788891009.762431:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+60:11265:x1875787987854336:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788891009.762452:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891009.762455:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788891009.762485:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53276 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde9f expref: 60 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.762501:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:3.0:1788891009.762506:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891009.762607:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd532ca lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddeb4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788891009.762967:0:6495:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788891009.763113:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd532d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.763126:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd532d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.763135:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd532d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.763195:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd532ca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddeb4 expref: 62 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.763210:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd532d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddeb4 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.763218:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff924f82e39000) 00010000:00010000:2.0:1788891009.763221:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891009.763223:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310000, rc 0) 00000100:00100000:2.0:1788891009.763333:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+61:11265:x1875787987854336:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 903us (2200us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788891009.763341:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 81 00000100:00100000:2.0:1788891009.769926:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891009.769957:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987854592 00000100:00100000:0.0:1788891009.769968:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987854592 00000100:00100000:0.0:1788891009.770032:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 82 00000100:00100000:0.0:1788891009.770044:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+61:11265:x1875787987854592:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788891009.770107:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891009.770135:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd532d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddeb4 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770161:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff924f82e39000) 00010000:00010000:0.0:1788891009.770171:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788891009.770205:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532df lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770219:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532df lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770230:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532df lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770245:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd532e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x5542682e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770252:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd532e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x5542682e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770258:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd532e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x5542682e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770306:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532df lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770313:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532df lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770318:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532df lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770324:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891009.770328:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532df lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770341:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532df lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770364:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:0.0:1788891009.770367:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891009.770371:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532df lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770376:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532df lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770386:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd532e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x5542682e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770392:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd532e6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5542682e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770398:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd532e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5542682e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770403:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891009.770406:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd532e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5542682e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770412:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd532e6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5542682e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770419:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x5542682e (ffff9250c130ba00) 00010000:00010000:0.0:1788891009.770421:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891009.770423:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd532e6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x5542682e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.770440:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd532e6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x5542682e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891009.770552:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+60:11265:x1875787987854592:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 511us (633us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788891009.770560:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 82 00000100:00100000:0.0:1788891009.781110:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891009.785556:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987854720 00000100:00100000:3.0:1788891009.785572:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987854720 00000100:00100000:0.0:1788891009.785820:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 83 00000100:00100000:0.0:1788891009.785833:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+60:11265:x1875787987854720:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788891009.785856:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891009.786031:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd532ed lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddebb expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.786073:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.786087:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.786099:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.786767:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd532ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddebb expref: 62 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.786785:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddebb expref: 61 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.786806:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9250c130ba00) 00010000:00010000:0.0:1788891009.786809:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788891009.786813:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5800, rc 0) 00000100:00100000:0.0:1788891009.786976:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+61:11265:x1875787987854720:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 1145us (5878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891009.786984:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 83 00000100:00100000:1.0:1788891009.795312:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891009.795349:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987854976 00000100:00100000:1.0:1788891009.795359:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987854976 00000100:00100000:1.0:1788891009.795420:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 84 00000100:00100000:1.0:1788891009.795432:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+61:11265:x1875787987854976:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788891009.795514:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd532fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.795553:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd532fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.795566:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd532fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788891009.795743:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788891009.795755:0:6495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 232040230792ns, next at 233040227260ns, rc = 0 00000004:00010000:1.0:1788891009.795829:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2a9e160 reply state 00000000dda7fa47 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd532fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.795844:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd532fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.795852:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9250c130ba00) 00010000:00010000:1.0:1788891009.795855:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788891009.795859:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788891009.796078:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+63:11265:x1875787987854976:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 646us (773us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788891009.796087:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 84 00000100:00100000:3.0:1788891009.804711:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891009.804931:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987855104 00000100:00100000:0.0:1788891009.804941:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987855104 00000100:00100000:0.0:1788891009.805003:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 85 00000100:00100000:0.0:1788891009.805015:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+63:11265:x1875787987855104:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788891009.805040:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891009.805062:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53302 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddec2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.805241:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53302 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddec2 expref: 64 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.805258:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53302 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddec2 expref: 64 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.805277:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9250c130ba00) 00010000:00010000:0.0:1788891009.805280:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788891009.805285:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5a00, rc 0) 00000100:00100000:0.0:1788891009.805401:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+64:11265:x1875787987855104:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 388us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891009.805418:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 85 00000100:00100000:1.0:1788891009.808352:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891009.808449:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987855232 00000100:00100000:2.0:1788891009.808459:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987855232 00000100:00100000:2.0:1788891009.808578:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:2.0:1788891009.808586:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1875787987855232:12345-192.168.204.26@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788891009.808618:0:8408:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:2.0:1788891009.808652:0:8408:0:(genops.c:1385:class_connect()) connect: client df03475d-d91a-4e91-8125-742ac4d4c589, cookie 0xa66601b03fd53309 00002000:00100000:2.0:1788891009.808665:0:8408:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli df03475d-d91a-4e91-8125-742ac4d4c589/ffff924f839d0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788891009.808684:0:8408:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788891009.808762:0:8408:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788891009.808795:0:8408:0:(import.c:65:import_set_state_nolock()) ffff924f839d1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788891009.808938:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+6:2390:x1875787987855232:12345-192.168.204.26@tcp:8:lhsmtool_posix.0 Request processed in 283us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891009.808948:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:3.0:1788891009.812069:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891009.816147:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987855360 00000100:00100000:0.0:1788891009.816162:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987855360 00000100:00100000:0.0:1788891009.816492:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:0.0:1788891009.816503:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:0:x1875787987855360:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788891009.817089:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788891009.817925:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1788891009.817931:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df03475d-d91a-4e91-8125-742ac4d4c589 00000100:00100000:1.0:1788891009.818130:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:0:x1875787987855360:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 1624us (6067us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788891009.818151:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:0.0:1788891009.822257:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891009.822415:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987855616 00000100:00100000:3.0:1788891009.822424:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987855616 00000100:00100000:3.0:1788891009.822509:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:3.0:1788891009.822520:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+64:11265:x1875787987855616:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788891009.822793:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+65:11265:x1875787987855616:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 275us (551us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788891009.822801:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:0.0:1788891009.829420:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891009.829583:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987855872 00000100:00100000:2.0:1788891009.829594:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987855872 00000100:00100000:2.0:1788891009.829656:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 86 00000100:00100000:2.0:1788891009.829667:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+65:11265:x1875787987855872:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788891009.829922:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+65:11265:x1875787987855872:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 255us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891009.829930:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 86 00000100:00100000:0.0:1788891009.832763:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891009.832855:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987856000 00000100:00100000:1.0:1788891009.832865:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987856000 00000100:00100000:1.0:1788891009.833688:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 87 00000100:00100000:1.0:1788891009.833701:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+65:11265:x1875787987856000:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788891009.833720:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891009.833742:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df200/0xa66601b03fd53310 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddec9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.833811:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd53317 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.833825:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd53317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.833838:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd53317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891009.833884:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788891009.833902:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd53317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.833931:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df200/0xa66601b03fd53310 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddec9 expref: 67 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.833948:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd53317 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddec9 expref: 66 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.833968:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9250c130ba00) 00010000:00010000:1.0:1788891009.833971:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788891009.833975:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857df600, rc 0) 00000100:00100000:1.0:1788891009.834041:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+66:11265:x1875787987856000:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 344us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891009.834050:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 87 00000100:00100000:1.0:1788891009.837794:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891009.837862:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987856128 00000100:00100000:2.0:1788891009.837871:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987856128 00000100:00100000:2.0:1788891009.837951:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:2.0:1788891009.837962:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df03475d-d91a-4e91-8125-742ac4d4c589+5:2394:x1875787987856128:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891009.837989:0:11803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891009.838011:0:11803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd5331e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dded0 expref: -99 pid: 11803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891009.838036:0:11803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa04f81, blocks: 0x0 00010000:00010000:2.0:1788891009.838067:0:11803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=232s v=(0 0) 00010000:00010000:2.0:1788891009.838072:0:11803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891009.838082:0:11803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd5331e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded0 expref: 6 pid: 11803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.838103:0:11803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd5331e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded0 expref: 6 pid: 11803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.838117:0:11803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310400, rc 0) 00000100:00100000:2.0:1788891009.838174:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df03475d-d91a-4e91-8125-742ac4d4c589+6:2394:x1875787987856128:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 214us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891009.838194:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:0.0:1788891009.848345:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891009.848425:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987856384 00000100:00100000:1.0:1788891009.848436:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987856384 00000100:00100000:1.0:1788891009.848500:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 88 00000100:00100000:1.0:1788891009.848512:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+66:11265:x1875787987856384:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788891009.848764:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+66:11265:x1875787987856384:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 253us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891009.848772:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 88 00000100:00100000:0.0:1788891009.864223:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891009.864395:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987856512 00000100:00100000:2.0:1788891009.864406:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987856512 00000100:00100000:2.0:1788891009.864468:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:2.0:1788891009.864479:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+6:11265:x1875787987856512:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891009.864496:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891009.864515:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb2ab282/0xa66601b03fd53325 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204dded7 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.864616:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd5331e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded0 expref: 7 pid: 11803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.864633:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891009.864638:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891009.864644:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb2ab282/0xa66601b03fd53325 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded7 expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.864678:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd5331e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded0 expref: 7 pid: 11803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.864692:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd5331e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded0 expref: 7 pid: 11803 timeout: 332 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891009.864707:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf785880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8408:1875787997360256:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891009.864843:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891009.869723:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891009.869805:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987856640 00000100:00100000:0.0:1788891009.869814:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987856640 00010000:00010000:0.0:1788891009.869853:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd5331e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded0 expref: 8 pid: 11803 timeout: 332 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891009.869894:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:0.0:1788891009.869903:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+8:2394:x1875787987856640:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891009.869916:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891009.869936:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd5331e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded0 expref: 8 pid: 11803 timeout: 332 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.869950:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd5331e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded0 expref: 8 pid: 11803 timeout: 332 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.869992:0:7436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891009.869997:0:7436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891009.870005:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb2ab282/0xa66601b03fd53325 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded7 expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.870016:0:7436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb2ab282/0xa66601b03fd53325 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded7 expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.870047:0:7436:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fb2ab282/0xa66601b03fd53325 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded7 expref: 8 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891009.870071:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7436:1875787997360384:192.168.204.26@tcp:105: 00000100:00100000:0.0:1788891009.870154:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab09600 going to sleep for 11 seconds 00010000:00010000:2.0:1788891009.870166:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd5331e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded0 expref: 8 pid: 11803 timeout: 332 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891009.870193:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf785880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8408:1875787997360256:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891009.870218:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fb2ab282/0xa66601b03fd53325 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded7 expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.870228:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311e00, rc 0) 00000100:00100000:2.0:1788891009.870256:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+7:11265:x1875787987856512:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 5778us (6045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891009.870272:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:1.0:1788891009.877299:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7436:1875787997360384:192.168.204.26@tcp:105: 00010000:00010000:1.0:1788891009.877330:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891009.877583:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:2394:x1875787987856640:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 7678us (7866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891009.877597:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:3.0:1788891009.878736:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891009.879805:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987856768 00000100:00100000:0.0:1788891009.879815:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987856768 00002000:00100000:0.0:1788891009.879866:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9250c12a6680 x1875787987856768/t0(0) o4->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:60/0 lens 504/0 e 0 to 0 dl 1788891020 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788891009.879878:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9250c12a6680 with x1875787987856768 ext(0->8) 00002000:00010000:0.0:1788891009.879884:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9250c12a6680 00000100:00100000:0.0:1788891009.879919:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:0.0:1788891009.879931:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df03475d-d91a-4e91-8125-742ac4d4c589+6:2394:x1875787987856768:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788891009.881082:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df03475d-d91a-4e91-8125-742ac4d4c589+8:2394:x1875787987856768:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 Request processed in 1148us (2345us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788891009.881105:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00002000:00100000:0.0:1788891009.881115:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9250c12a6680 x1875787987856768/t4294967303(0) o4->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:60/0 lens 504/448 e 0 to 0 dl 1788891020 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788891009.881124:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9250c12a6680 with x1875787987856768 ext(0->8) 00002000:00010000:0.0:1788891009.881130:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9250c12a6680 00000100:00100000:3.0:1788891009.884959:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891009.885079:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987856896 00000100:00100000:0.0:1788891009.885089:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987856896 00000100:00100000:0.0:1788891009.885157:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 89 00000100:00100000:0.0:1788891009.885167:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+66:11265:x1875787987856896:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788891009.888163:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1788891009.888186:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:1.0:1788891009.888246:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788891009.888274:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92508540a240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788891009.888279:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff924f833fa000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92508540aa80 00000020:00080000:1.0:1788891009.888291:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff924f833fa500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92509893bc00 00000020:00080000:1.0:1788891009.888332:0:6527:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788891009.888503:0:6527:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788891009.888678:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788891009.888700:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997360512:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788891009.888778:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891009.888831:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997360512 00000100:00100000:0.0:1788891009.888839:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997360512 00000100:00100000:0.0:1788891009.888882:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788891009.888891:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3627:x1875787997360512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788891009.888922:0:8596:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1788891009.888957:0:8596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa04f7f, atime: 0x6aa04f7f, ctime: 0x6aa04f7f, blocks: 0x8 00010000:00010000:0.0:1788891009.888966:0:8596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd5332c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.888982:0:8596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=232s v=(0 0) 00010000:00010000:0.0:1788891009.888986:0:8596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891009.888993:0:8596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd5332c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.889022:0:8596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd5332c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.889032:0:8596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd5332c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.889040:0:8596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd5332c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.889058:0:8596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788891009.889193:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3627:x1875787997360512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 302us (414us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788891009.889202:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1788891009.889230:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891009.889236:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd5332c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891009.889460:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+20:11265:x1875787987856896:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 Request processed in 4293us (4509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891009.889468:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 89 00000004:00080000:1.0:1788891009.889515:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff924f83a72a00/2, rc 0, transno 4294967302 00000100:00100000:1.0:1788891009.889549:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997360512:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788891009.890138:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4c00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891009.890145:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd5332c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.890155:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd5332c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.890185:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd5332c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.890201:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd5332c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.890222:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891009.890224:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891009.890226:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891009.891182:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997360640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788891009.891233:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891009.891366:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997360640 00000100:00100000:3.0:1788891009.891373:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997360640 00000100:00100000:3.0:1788891009.891417:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788891009.891427:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997360640:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788891009.891575:0:11803:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788891009.891578:0:11803:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788891009 00002000:00010000:3.0:1788891009.891581:0:11803:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788891009.891582:0:11803:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788891009 -> 1788891009 00002000:00010000:3.0:1788891009.891584:0:11803:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788891009.891627:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3629:x1875787997360640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 202us (393us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788891009.891633:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:3.0:1788891009.891668:0:3629:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9250c12a5500/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788891009.891673:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997360640:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788891009.891902:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6c00/0xa66601b03fd5303f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.891912:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6c00/0xa66601b03fd5303f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.891920:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6c00/0xa66601b03fd5303f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.891927:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891009.891931:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6c00/0xa66601b03fd5303f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.891938:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6c00/0xa66601b03fd5303f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.891953:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff925095f80000) 00010000:00010000:2.0:1788891009.891955:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891009.891960:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6c00/0xa66601b03fd5303f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.891966:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6c00/0xa66601b03fd5303f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.891984:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd53046 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.891990:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd53046 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892006:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd53046 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892010:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891009.892013:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd53046 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892018:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd53046 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892026:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:2.0:1788891009.892029:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891009.892031:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd53046 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892036:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6800/0xa66601b03fd53046 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892048:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd53085 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892053:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd53085 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892058:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd53085 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892062:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7e00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891009.892065:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd53085 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892079:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd53085 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892088:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff925095f80900) 00010000:00010000:2.0:1788891009.892090:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891009.892093:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd53085 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892098:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd53085 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892111:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd5318f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892117:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd5318f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892123:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd5318f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892128:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857de600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891009.892130:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd5318f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892135:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd5318f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892142:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:2.0:1788891009.892144:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891009.892223:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd5318f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892239:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd5318f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892252:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dea00/0xa66601b03fd531b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892258:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dea00/0xa66601b03fd531b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892263:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dea00/0xa66601b03fd531b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892268:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857dea00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891009.892270:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dea00/0xa66601b03fd531b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892276:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dea00/0xa66601b03fd531b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892284:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:2.0:1788891009.892286:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891009.892288:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dea00/0xa66601b03fd531b2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892293:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dea00/0xa66601b03fd531b2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892302:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd531f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892308:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd531f8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892319:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd531f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892324:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891009.892327:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd531f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892333:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd531f8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892342:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:2.0:1788891009.892344:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891009.892406:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd531f8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892413:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd531f8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892425:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd532fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892431:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd532fb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892436:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd532fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892441:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857de200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891009.892444:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd532fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892459:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd532fb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892467:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9250c130ba00) 00010000:00010000:2.0:1788891009.892470:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788891009.892473:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd532fb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.892478:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd532fb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891009.893828:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891009.894035:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987857024 00000100:00100000:2.0:1788891009.894044:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987857024 00000100:00100000:2.0:1788891009.894099:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:2.0:1788891009.894109:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+8:2394:x1875787987857024:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788891009.897302:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1788891009.897316:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1788891009.897741:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+6:2394:x1875787987857024:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 Request processed in 3627us (3912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891009.897753:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:3.0:1788891009.905680:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891009.905726:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987857280 00000100:00100000:1.0:1788891009.905736:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987857280 00000100:00100000:1.0:1788891009.905795:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 90 00000100:00100000:1.0:1788891009.905806:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+14:11265:x1875787987857280:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788891009.905861:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891009.905889:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd53317 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddec9 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.905906:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9250c130ba00) 00010000:00010000:1.0:1788891009.905912:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788891009.905942:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dec00/0xa66601b03fd53333 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.905954:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dec00/0xa66601b03fd53333 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.905964:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dec00/0xa66601b03fd53333 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788891009.906086:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d234130d reply state 000000002d10bf0b transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dec00/0xa66601b03fd53333 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.906099:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dec00/0xa66601b03fd53333 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.906106:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9250c130ba00) 00010000:00010000:1.0:1788891009.906108:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788891009.906111:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788891009.906257:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+15:11265:x1875787987857280:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 453us (583us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1788891009.906266:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 90 00000100:00100000:3.0:1788891009.910423:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891009.910552:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987857408 00000100:00100000:0.0:1788891009.910563:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987857408 00000100:00100000:0.0:1788891009.910624:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:0.0:1788891009.910634:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+6:2392:x1875787987857408:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788891009.911057:0:8410:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788891009.911061:0:8410:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788891009 -> 1788891008 00002000:00010000:0.0:1788891009.911064:0:8410:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788891007 00002000:00010000:0.0:1788891009.911067:0:8410:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788891009 -> 1788891008 00002000:00010000:0.0:1788891009.911069:0:8410:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788891009.911186:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+7:2392:x1875787987857408:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 541us (762us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788891009.911196:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:0.0:1788891009.917771:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891009.917961:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987857664 00000100:00100000:1.0:1788891009.917971:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987857664 00000100:00100000:1.0:1788891009.918027:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 91 00000100:00100000:1.0:1788891009.918037:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+15:11265:x1875787987857664:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788891009.918102:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd5333a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.918119:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddebb expref: 15 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.918128:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd5333a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.918160:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddebb expref: 15 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.918194:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddebb expref: 15 pid: 9362 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891009.918210:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6496:1875787997360768:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891009.918288:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830a9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788891009.928105:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891009.928132:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6496:1875787997360768:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891009.928163:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd5333a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891009.928198:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987857792 00000100:00100000:3.0:1788891009.928205:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987857792 00010000:00010000:3.0:1788891009.928236:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddebb expref: 16 pid: 9362 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891009.928279:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:3.0:1788891009.928288:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+16:2394:x1875787987857792:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891009.928302:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891009.928308:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddebb expref: 16 pid: 9362 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.928320:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddebb expref: 16 pid: 9362 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.928340:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd532f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddebb expref: 16 pid: 9362 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.928361:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9250c130ba00) 00010000:00010000:3.0:1788891009.928365:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd5333a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.928375:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd5333a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.928382:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd5333a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.928625:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd5333a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.928635:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd5333a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.928675:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd5333a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.928683:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd5333a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.928689:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd5333a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.928694:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857dfa00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891009.928698:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd5333a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.928705:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd5333a lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.928722:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9250c130ba00) 00010000:00010000:1.0:1788891009.928724:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788891009.928728:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd5333a lrc: 3/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891009.928799:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+15:11265:x1875787987857664:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 Request processed in 10763us (11035us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788891009.928808:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 91 00010000:00010000:3.0:1788891009.928944:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd5333a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.928956:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891009.930371:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+14:2394:x1875787987857792:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 2075us (2268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891009.930383:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:0.0:1788891009.934833:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891009.934934:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987857920 00000100:00100000:2.0:1788891009.934946:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987857920 00000100:00100000:2.0:1788891009.935031:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00100000:2.0:1788891009.935042:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+7:2394:x1875787987857920:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788891009.935089:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53341 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.935109:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb2ab282/0xa66601b03fd53325 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded7 expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.935130:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891009.935134:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788891009.935139:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53341 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.935187:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb2ab282/0xa66601b03fd53325 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded7 expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.935202:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb2ab282/0xa66601b03fd53325 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded7 expref: 7 pid: 8408 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891009.935217:0:8411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf785880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8411:1875787997360896:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891009.935454:0:8411:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891009.938109:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891009.938456:0:8411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf785880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8411:1875787997360896:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788891009.938484:0:8411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53341 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891009.938785:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987858048 00000100:00100000:3.0:1788891009.938793:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987858048 00010000:00010000:3.0:1788891009.938829:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb2ab282/0xa66601b03fd53325 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded7 expref: 8 pid: 8408 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891009.938916:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:3.0:1788891009.938927:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+8:2393:x1875787987858048:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891009.938943:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891009.938971:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb2ab282/0xa66601b03fd53325 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded7 expref: 8 pid: 8408 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.938998:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb2ab282/0xa66601b03fd53325 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded7 expref: 8 pid: 8408 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.939023:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb2ab282/0xa66601b03fd53325 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dded7 expref: 8 pid: 8408 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.939038:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788891009.939043:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788891009.939049:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53341 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.939060:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53341 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.939087:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891009.939136:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+7:2393:x1875787987858048:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 211us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891009.939144:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 61 00010000:00010000:0.0:1788891009.939420:0:8411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53341 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.939431:0:8411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53341 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.939450:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53341 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.939459:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53341 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.939468:0:8411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53341 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.939476:0:8411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310400 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891009.939481:0:8411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53341 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.939490:0:8411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53341 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.939517:0:8411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53341 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.939758:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53341 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891009.939825:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+6:2394:x1875787987857920:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 Request processed in 4785us (5008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891009.939834:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00100000:3.0:1788891009.952390:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891009.952520:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987858304 00000100:00100000:0.0:1788891009.952566:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987858304 00000100:00100000:0.0:1788891009.952619:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 92 00000100:00100000:0.0:1788891009.952628:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+14:11265:x1875787987858304:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788891009.952705:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53348 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.952723:0:12407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd53188 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde60 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.952733:0:12407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53348 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.952766:0:12407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd53188 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde60 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.952782:0:12407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd53188 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde60 expref: 14 pid: 6496 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891009.952804:0:12407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a70380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997361024:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891009.952885:0:12407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab096c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891009.955764:0:12407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a70380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997361024:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788891009.955790:0:12407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53348 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891009.956714:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891009.956837:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987858432 00000100:00100000:0.0:1788891009.956844:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987858432 00010000:00010000:0.0:1788891009.956880:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd53188 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde60 expref: 15 pid: 6496 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891009.956946:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:0.0:1788891009.956960:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087acdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+15:2393:x1875787987858432:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891009.956974:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891009.956982:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd53188 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde60 expref: 15 pid: 6496 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.956995:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd53188 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde60 expref: 15 pid: 6496 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.957018:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd53188 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde60 expref: 15 pid: 6496 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.957032:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:0.0:1788891009.957037:0:7436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53348 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.957058:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.957066:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53348 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.957172:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891009.957243:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087acdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+14:2393:x1875787987858432:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 284us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891009.957251:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 62 00010000:00010000:2.0:1788891009.958212:0:12407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.958222:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.960225:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5334f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.960247:0:12407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53302 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddec2 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.960256:0:12407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5334f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.960300:0:12407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53302 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddec2 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891009.960316:0:12407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53302 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddec2 expref: 14 pid: 6496 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891009.960332:0:12407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf785f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997361152:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891009.960426:0:12407:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788891009.967361:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891009.967709:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987858560 00000100:00100000:0.0:1788891009.967719:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987858560 00010000:00010000:0.0:1788891009.967761:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53302 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddec2 expref: 15 pid: 6496 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891009.967810:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:0.0:1788891009.967821:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf785c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+15:2394:x1875787987858560:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891009.967836:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891009.967843:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53302 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddec2 expref: 15 pid: 6496 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.967857:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53302 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddec2 expref: 15 pid: 6496 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.967879:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9250c130ba00) 00010000:00010000:0.0:1788891009.967885:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5334f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.967904:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5334f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.967911:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5334f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.967931:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891009.967989:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf785c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+15:2394:x1875787987858560:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 168us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891009.967998:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 63 00010000:00010000:3.0:1788891009.968651:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53302 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddec2 expref: 14 pid: 6496 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891009.968671:0:12407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf785f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997361152:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891009.968694:0:12407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5334f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.968713:0:12407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5334f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.968719:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5334f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788891009.969283:0:12407:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1788891009.969501:0:12407:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1788891009.969560:0:12407:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1788891009.969641:0:12407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839cd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12407:1875787997361280:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788891009.969696:0:12407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891009.969734:0:12407:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788891009.969739:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997361280 00000100:00100000:0.0:1788891009.969748:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997361280 00000100:00100000:0.0:1788891009.969807:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788891009.969818:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12407:x1875787997361280:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788891009.969905:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12407:x1875787997361280:12345-0@lo:1000:mdt00_004.0 Request processed in 89us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891009.969912:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788891009.970017:0:12407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788891009.970023:0:12407:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9250c12a5500, transno 4294967304 00000100:00100000:3.0:1788891009.970044:0:12407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839cd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12407:1875787997361280:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1788891009.970471:0:12407:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1788891009.970508:0:12407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839cd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12407:1875787997361408:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788891009.970564:0:12407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891009.970588:0:12407:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788891009.970608:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997361408 00000100:00100000:1.0:1788891009.970615:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997361408 00000100:00100000:1.0:1788891009.970655:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788891009.970663:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:12407:x1875787997361408:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788891009.970785:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12407:x1875787997361408:12345-0@lo:1000:mdt00_004.0 Request processed in 121us (219us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788891009.970792:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788891009.970854:0:12407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839cd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12407:1875787997361408:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788891009.970890:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5334f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.970900:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5334f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.970908:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5334f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.970914:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891009.970925:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5334f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.970933:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5334f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.970950:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9250c130ba00) 00010000:00010000:0.0:1788891009.970953:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788891009.970958:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5334f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.970964:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5334f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.970993:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5327d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.970999:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5327d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.971005:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5327d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.971422:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891009.971426:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5327d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.971433:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5327d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.971443:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:0.0:1788891009.971446:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788891009.971456:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5327d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.971462:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd5327d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.971487:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53356 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.971952:0:12407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53299 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddea6 expref: 17 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.971963:0:12407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53356 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.971996:0:12407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53299 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddea6 expref: 17 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.972012:0:12407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53299 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddea6 expref: 17 pid: 6497 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891009.972025:0:12407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997361536:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891009.972112:0:12407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab09000 going to sleep for 11 seconds 00000100:00100000:3.0:1788891009.978570:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891009.978602:0:12407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997361536:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788891009.978608:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987858688 00000100:00100000:3.0:1788891009.978617:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987858688 00010000:00010000:1.0:1788891009.978638:0:12407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53356 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.978660:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53299 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddea6 expref: 18 pid: 6497 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891009.978704:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:3.0:1788891009.978714:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+18:2393:x1875787987858688:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891009.978738:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891009.978746:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53299 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddea6 expref: 18 pid: 6497 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.978758:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53299 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddea6 expref: 18 pid: 6497 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.978780:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53299 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddea6 expref: 18 pid: 6497 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.978795:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:3.0:1788891009.978799:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53356 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.978808:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53356 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.978815:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53356 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.978844:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788891009.978874:0:12407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53356 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.978884:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53356 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.978896:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53356 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891009.978899:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+17:2393:x1875787987858688:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 186us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891009.978914:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 64 00010000:00010000:1.0:1788891009.978915:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53356 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.978934:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53356 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.978940:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891009.978945:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53356 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.978951:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53356 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.978961:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:1.0:1788891009.978964:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891009.978968:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53356 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.978974:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53356 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.978984:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.978990:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53348 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.978996:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53348 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.979000:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891009.979010:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53348 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.979016:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53348 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.979025:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250c130bf00) 00010000:00010000:1.0:1788891009.979027:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788891009.979030:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53348 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.979036:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53348 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891009.979593:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+16:11265:x1875787987858304:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 26963us (27209us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788891009.979603:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 92 00000020:00080000:1.0:1788891009.979607:0:12407:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788891009.980049:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788891009.980054:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788891009.980074:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788891009.980080:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788891009.980945:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891009.983444:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891009.983497:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987858944 00000100:00100000:1.0:1788891009.983508:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987858944 00000100:00100000:1.0:1788891009.983577:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:1.0:1788891009.983588:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+16:11265:x1875787987858944:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788891009.983829:0:6499:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788891009.983861:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1788891009.983894:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd5335d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.983909:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd5335d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.983920:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd5335d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.983935:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd5335d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.983942:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd5335d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.983948:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd5335d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891009.983973:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788891009.984055:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+18:11265:x1875787987858944:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 468us (620us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788891009.984063:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 20 00000020:00080000:1.0:1788891009.984068:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788891009.984216:0:10314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891009.984223:0:10314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd5335d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.984231:0:10314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857de200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891009.984235:0:10314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd5335d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.984248:0:10314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd5335d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.984261:0:10314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9250c130ba00) 00010000:00010000:0.0:1788891009.984264:0:10314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788891009.984269:0:10314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd5335d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.984275:0:10314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd5335d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.984285:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891009.984286:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891009.984288:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788891010.016633:0:14178:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788891010.016643:0:14178:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788891010.016669:0:14178:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788891010.016675:0:14178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788891010.092357:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891010.092430:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987859200 00000100:00100000:2.0:1788891010.092440:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987859200 00000100:00100000:2.0:1788891010.092505:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 93 00000100:00100000:2.0:1788891010.092515:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+18:11275:x1875787987859200:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788891010.092565:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891010.092586:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53364 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddede expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.092688:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311e00/0xa66601b03fd5336b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.092702:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311e00/0xa66601b03fd5336b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.092724:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311e00/0xa66601b03fd5336b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891010.092735:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788891010.092831:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53364 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddede expref: 21 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.092847:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311e00/0xa66601b03fd5336b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddede expref: 20 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.092856:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:2.0:1788891010.092858:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788891010.092862:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311e00, rc 0) 00000100:00100000:2.0:1788891010.092916:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+20:11275:x1875787987859200:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 403us (566us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788891010.092923:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 93 00000100:00080000:0.0:1788891010.093085:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891010.096816:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891010.096889:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987859328 00000100:00100000:3.0:1788891010.096899:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987859328 00000100:00100000:3.0:1788891010.096960:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 94 00000100:00100000:3.0:1788891010.096970:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+20:11275:x1875787987859328:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:3.0:1788891010.097056:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53379 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097073:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53379 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097084:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53379 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097098:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53380 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097105:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097110:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097193:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53387 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097200:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097206:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788891010.097247:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097259:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53379 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097274:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53379 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097281:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53379 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097287:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ec600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891010.097291:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53379 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097297:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53379 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097309:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:3.0:1788891010.097312:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891010.097317:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53379 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097322:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53379 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097335:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097340:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53380 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097346:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53380 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097352:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ede00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891010.097360:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53380 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097366:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53380 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097374:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9250905a3d00) 00010000:00010000:3.0:1788891010.097376:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891010.097378:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53380 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097384:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53380 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097397:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097403:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53387 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097409:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53387 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097415:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891010.097417:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53387 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097424:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53387 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097430:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9250905a3c00) 00010000:00010000:3.0:1788891010.097432:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891010.097440:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53387 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.097445:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53387 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891010.097520:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+20:11275:x1875787987859328:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 551us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891010.097551:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 94 00000100:00100000:2.0:1788891010.152422:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891010.152508:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987859584 00000100:00100000:1.0:1788891010.152564:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987859584 00000100:00100000:1.0:1788891010.152623:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 95 00000100:00100000:1.0:1788891010.152633:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+20:11278:x1875787987859584:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788891010.152655:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891010.152676:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd5338e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddee5 expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.152754:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53395 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.152781:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53395 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.152793:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53395 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.152810:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd5339c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.152818:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd5339c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.152824:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd5339c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.152939:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.152948:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.152956:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891010.152965:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788891010.153041:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53395 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.153049:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53395 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.153055:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53395 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.153069:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891010.153073:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53395 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.153081:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53395 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.153093:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:1.0:1788891010.153095:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891010.153099:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53395 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.153105:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53395 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.153118:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd5339c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.153123:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd5339c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.153128:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd5339c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.153133:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857de800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891010.153135:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd5339c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.153141:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd5339c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.153159:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff925095f80800) 00010000:00010000:1.0:1788891010.153162:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891010.153164:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd5339c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.153180:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd5339c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.153218:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd5338e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddee5 expref: 23 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.153232:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddee5 expref: 22 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.153239:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80300) 00010000:00010000:1.0:1788891010.153242:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788891010.153244:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857de000, rc 0) 00000100:00100000:1.0:1788891010.153308:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+22:11278:x1875787987859584:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 677us (896us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788891010.153315:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 95 00000100:00100000:3.0:1788891010.160410:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.160485:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987859712 00000100:00100000:0.0:1788891010.160495:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987859712 00000100:00100000:0.0:1788891010.160571:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 96 00000100:00100000:0.0:1788891010.160582:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+22:11278:x1875787987859712:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:0.0:1788891010.160650:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd533b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.160667:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd533b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.160684:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd533b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.160721:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd533b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.160746:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd533b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.160753:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd533b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.160759:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891010.160775:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd533b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.160783:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd533b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.160796:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80300) 00010000:00010000:0.0:1788891010.160799:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788891010.160803:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd533b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.160810:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd533b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891010.161002:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+22:11278:x1875787987859712:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 421us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891010.161011:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 96 00000100:00100000:1.0:1788891010.162899:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.163061:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987859968 00000100:00100000:0.0:1788891010.163070:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987859968 00000100:00100000:0.0:1788891010.163118:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:0.0:1788891010.163128:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509047bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+22:11278:x1875787987859968:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788891010.163342:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509047bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+23:11278:x1875787987859968:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 215us (449us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1788891010.163361:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:0.0:1788891010.172031:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788891010.172056:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997361664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788891010.172061:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788891010.172075:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997361792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788891010.172757:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891010.172854:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891010.173062:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997361792 00000100:00100000:3.0:1788891010.173071:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997361792 00000100:00100000:3.0:1788891010.173136:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997361664 00000100:00100000:3.0:1788891010.173140:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997361664 00000100:00100000:3.0:1788891010.173157:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788891010.173166:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3628:x1875787997361792:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788891010.173204:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00002000:00000024:3.0:1788891010.173208:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788891010.173216:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997361664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788891010.173230:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788891010.173269:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3628:x1875787997361792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891010.173279:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997361664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891010.173280:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788891010.173291:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788891010.173338:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997361792:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788891010.173363:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788891010.173390:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997361664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788891010.191808:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891010.191928:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987860224 00000100:00100000:1.0:1788891010.191938:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987860224 00000100:00100000:1.0:1788891010.192041:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 97 00000100:00100000:1.0:1788891010.192053:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+23:10806:x1875787987860224:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1788891010.192080:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891010.192100:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd533b8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddeec expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.192302:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd533bf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.192748:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddee5 expref: 24 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.192760:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd533bf lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.192797:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddee5 expref: 24 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.192812:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddee5 expref: 24 pid: 12407 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891010.192826:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6495:1875787997361920:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891010.192964:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830a9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788891010.196682:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.196760:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987860352 00000100:00100000:0.0:1788891010.196769:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987860352 00010000:00010000:0.0:1788891010.196808:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533a3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddee5 expref: 25 pid: 12407 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891010.196853:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:0.0:1788891010.196863:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+25:2394:x1875787987860352:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891010.196877:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891010.196884:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533a3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddee5 expref: 25 pid: 12407 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.196897:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddee5 expref: 25 pid: 12407 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.196918:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80300) 00010000:00010000:0.0:1788891010.196923:0:7436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd533bf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.196932:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd533bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.196957:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd533bf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.196976:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891010.197029:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+25:2394:x1875787987860352:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 168us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891010.197037:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 65 00010000:00010000:1.0:1788891010.199424:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddee5 expref: 24 pid: 12407 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891010.199447:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6495:1875787997361920:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891010.199489:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd533bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.202634:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd533bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.202651:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd533bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891010.202674:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788891010.202822:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd533b8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddeec expref: 25 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.202842:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd533bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddeec expref: 24 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.202850:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80300) 00010000:00010000:0.0:1788891010.202853:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788891010.202856:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857de800, rc 0) 00000100:00100000:0.0:1788891010.202978:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+24:10806:x1875787987860224:12345-192.168.204.26@tcp:101:bash.0 Request processed in 10926us (11178us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1788891010.202988:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 97 00000100:00100000:3.0:1788891010.205181:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891010.205269:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987860480 00000100:00100000:2.0:1788891010.205283:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987860480 00000100:00100000:2.0:1788891010.205355:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 98 00000100:00100000:2.0:1788891010.205369:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+24:10806:x1875787987860480:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788891010.205394:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891010.205428:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd533cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddef3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.205462:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd533d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.205475:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd533d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.205487:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd533d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.205636:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd533cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddef3 expref: 26 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.205654:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd533d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddef3 expref: 25 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.205663:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80300) 00010000:00010000:2.0:1788891010.205667:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788891010.205670:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311600, rc 0) 00000100:00100000:2.0:1788891010.205725:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+25:10806:x1875787987860480:12345-192.168.204.26@tcp:101:bash.0 Request processed in 360us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891010.205732:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 98 00000100:00100000:2.0:1788891010.208924:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.209003:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987860736 00000100:00100000:0.0:1788891010.209019:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987860736 00000100:00100000:0.0:1788891010.209112:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 99 00000100:00100000:0.0:1788891010.209123:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+25:10806:x1875787987860736:12345-192.168.204.26@tcp:36:bash.0 00010000:00010000:0.0:1788891010.209489:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd533db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.209506:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd533db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.209517:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd533db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788891010.209646:0:9362:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1788891010.209667:0:9362:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f6ce27b reply state 000000001032411e transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd533db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.209679:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd533db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.209687:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80300) 00010000:00010000:0.0:1788891010.209690:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788891010.209693:0:9362:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788891010.209728:0:9362:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1788891010.209891:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+29:10806:x1875787987860736:12345-192.168.204.26@tcp:36:bash.0 Request processed in 768us (980us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788891010.209898:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 99 00000020:00080000:0.0:1788891010.209904:0:9362:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788891010.218067:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891010.218589:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987860864 00000100:00100000:2.0:1788891010.218610:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987860864 00000100:00100000:2.0:1788891010.218699:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 100 00000100:00100000:2.0:1788891010.218711:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+29:10806:x1875787987860864:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788891010.218764:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891010.218792:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd533e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddefa expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.218874:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd533e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddefa expref: 30 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.218892:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd533e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddefa expref: 30 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.218916:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80300) 00010000:00010000:2.0:1788891010.218919:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788891010.218924:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311000, rc 0) 00000100:00100000:2.0:1788891010.219010:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+30:10806:x1875787987860864:12345-192.168.204.26@tcp:101:bash.0 Request processed in 300us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891010.219017:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 100 00000100:00100000:3.0:1788891010.222681:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891010.222838:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987860992 00000100:00100000:2.0:1788891010.222855:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987860992 00000100:00100000:2.0:1788891010.222950:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 41 00000100:00100000:2.0:1788891010.222965:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+6:10806:x1875787987860992:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788891010.222990:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891010.223018:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd533e9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf01 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891010.223053:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa04f80, atime: 0x6aa04f7f, ctime: 0x6aa04f80, blocks: 0x8 00010000:00010000:2.0:1788891010.223082:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=232s v=(0 0) 00010000:00010000:2.0:1788891010.223089:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891010.223121:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd533e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf01 expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.223142:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd533e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf01 expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.223180:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310e00, rc 0) 00000100:00100000:2.0:1788891010.223970:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+7:10806:x1875787987860992:12345-192.168.204.26@tcp:101:bash.0 Request processed in 1006us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891010.223980:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 41 00000100:00100000:1.0:1788891010.227700:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.227797:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987861120 00000100:00100000:0.0:1788891010.227806:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987861120 00002000:00010000:0.0:1788891010.227844:0:8414:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1788891010.227849:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f8314bb80 with x1875787987861120 ext(0->18446744073709551615) 00002000:00010000:0.0:1788891010.227873:0:8414:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924f8314bb80. 00000100:00100000:0.0:1788891010.227905:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:0.0:1788891010.227915:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df03475d-d91a-4e91-8125-742ac4d4c589+7:2394:x1875787987861120:12345-192.168.204.26@tcp:10:bash.0 00002000:00010000:0.0:1788891010.228193:0:8414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788891010.228197:0:8414:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788891008 -> 1788891009 00002000:00010000:0.0:1788891010.228199:0:8414:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788891007 -> 1788891007 00002000:00010000:0.0:1788891010.228201:0:8414:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788891008 -> 1788891009 00002000:00010000:0.0:1788891010.228204:0:8414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788891010.228271:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df03475d-d91a-4e91-8125-742ac4d4c589+8:2394:x1875787987861120:12345-192.168.204.26@tcp:10:bash.0 Request processed in 356us (579us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788891010.228280:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1 00002000:00010000:0.0:1788891010.228283:0:8414:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1788891010.228286:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f8314bb80 with x1875787987861120 ext(0->18446744073709551615) 00002000:00010000:0.0:1788891010.228290:0:8414:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924f8314bb80. 00000100:00100000:0.0:1788891010.281498:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891010.281754:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987861248 00000100:00100000:1.0:1788891010.281815:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987861248 00000100:00100000:1.0:1788891010.281918:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 101 00000100:00100000:1.0:1788891010.281929:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+30:11292:x1875787987861248:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:1.0:1788891010.281999:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd533f0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282015:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd533f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282026:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd533f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282041:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd533f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282048:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd533f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282055:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd533f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282127:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282137:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282161:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788891010.282215:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282236:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd533f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282243:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd533f0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282250:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd533f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282256:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857dfc00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891010.282260:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd533f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282268:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd533f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282279:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:1.0:1788891010.282282:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891010.282287:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd533f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282294:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd533f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282307:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd533f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282319:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd533f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282325:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd533f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282330:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891010.282333:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd533f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282340:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd533f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282348:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff925095f80800) 00010000:00010000:1.0:1788891010.282350:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891010.282353:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd533f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282360:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd533f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282373:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282380:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282386:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282391:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857de000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891010.282398:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282405:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282413:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80300) 00010000:00010000:1.0:1788891010.282416:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891010.282418:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.282425:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd533fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891010.282502:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+30:11292:x1875787987861248:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 573us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891010.282510:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 101 00000100:00100000:1.0:1788891010.321781:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.322020:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987861504 00000100:00100000:0.0:1788891010.322033:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987861504 00000100:00100000:0.0:1788891010.322111:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 102 00000100:00100000:0.0:1788891010.322122:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+30:11295:x1875787987861504:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891010.322152:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891010.322188:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd53405 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf08 expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322285:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5340c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322303:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5340c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322335:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5340c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322362:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53413 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322370:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322377:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322691:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd5341a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322703:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd5341a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322709:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd5341a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891010.322731:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788891010.322839:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5340c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322848:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5340c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322855:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5340c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322862:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891010.322874:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5340c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322883:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5340c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322898:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:0.0:1788891010.322902:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891010.322907:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5340c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322915:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5340c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322932:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322939:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53413 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322944:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322950:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891010.322953:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322958:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53413 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322966:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9250c130be00) 00010000:00010000:0.0:1788891010.322968:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891010.322979:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53413 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.322985:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53413 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.323043:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd53405 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf08 expref: 33 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.323059:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd5341a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf08 expref: 32 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.323066:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80300) 00010000:00010000:0.0:1788891010.323069:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788891010.323071:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5a00, rc 0) 00000100:00100000:0.0:1788891010.323232:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+32:11295:x1875787987861504:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1110us (1465us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788891010.323242:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 102 00000100:00100000:2.0:1788891010.325667:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891010.325828:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987861632 00000100:00100000:3.0:1788891010.325842:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987861632 00000100:00100000:3.0:1788891010.325912:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 103 00000100:00100000:3.0:1788891010.325925:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+32:11295:x1875787987861632:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:3.0:1788891010.326030:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53428 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.326052:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd533bf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddeec expref: 32 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.326063:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53428 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.326115:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd533bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddeec expref: 32 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.326135:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd533bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddeec expref: 32 pid: 6495 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891010.326155:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6497:1875787997362048:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788891010.326293:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891010.333987:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.335354:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987861888 00000100:00100000:0.0:1788891010.335372:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987861888 00000100:00100000:0.0:1788891010.335460:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:0.0:1788891010.335473:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+33:6154:x1875787987861888:12345-192.168.204.26@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788891010.335924:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+34:6154:x1875787987861888:12345-192.168.204.26@tcp:35:ldlm_bl.0 Request processed in 452us (1953us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788891010.335933:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:3.0:1788891010.337101:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6497:1875787997362048:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891010.337141:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53428 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891010.339785:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.340080:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987862016 00000100:00100000:0.0:1788891010.340093:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987862016 00010000:00010000:0.0:1788891010.340149:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd533bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddeec expref: 34 pid: 6495 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891010.340228:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:0.0:1788891010.340241:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+34:2393:x1875787987862016:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891010.340264:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891010.340272:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd533bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddeec expref: 34 pid: 6495 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.340289:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd533bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddeec expref: 34 pid: 6495 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.340317:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd533bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddeec expref: 34 pid: 6495 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.340349:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80300) 00010000:00010000:0.0:1788891010.340356:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53428 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.340369:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53428 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.340378:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53428 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.340416:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788891010.340603:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53428 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.340614:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53428 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.340668:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53428 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.340689:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53428 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.340697:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53428 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.340704:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891010.340710:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53428 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.340731:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53428 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.340742:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80300) 00010000:00010000:3.0:1788891010.340745:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891010.340750:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53428 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.340757:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53428 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891010.340881:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+33:2393:x1875787987862016:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 640us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891010.340892:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:3.0:1788891010.342349:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+32:11295:x1875787987861632:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 16406us (16676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891010.342364:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 103 00000100:00100000:2.0:1788891010.345861:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.346182:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987862272 00000100:00100000:0.0:1788891010.346214:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987862272 00000100:00100000:0.0:1788891010.346329:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:0.0:1788891010.346353:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+32:11295:x1875787987862272:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788891010.346695:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+33:11295:x1875787987862272:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 354us (852us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788891010.346704:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:2.0:1788891010.446362:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891010.446742:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987862528 00000100:00100000:1.0:1788891010.446760:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987862528 00000100:00100000:1.0:1788891010.446881:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 104 00000100:00100000:1.0:1788891010.446895:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+33:11306:x1875787987862528:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:1.0:1788891010.446930:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891010.446957:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5342f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf0f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447158:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53436 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447214:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53436 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447229:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53436 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447247:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd5343d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447255:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd5343d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447262:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd5343d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447408:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dea00/0xa66601b03fd53444 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447418:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dea00/0xa66601b03fd53444 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447425:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dea00/0xa66601b03fd53444 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891010.447438:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788891010.447680:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53436 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447689:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53436 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447697:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53436 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447711:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891010.447718:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53436 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447727:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53436 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447742:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:1.0:1788891010.447745:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891010.447751:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53436 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447758:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53436 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447775:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd5343d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447780:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd5343d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447786:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd5343d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447792:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857dfe00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891010.447795:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd5343d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447801:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd5343d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447820:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff925095f80800) 00010000:00010000:1.0:1788891010.447823:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891010.447826:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd5343d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447832:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd5343d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447888:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5342f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf0f expref: 36 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447904:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dea00/0xa66601b03fd53444 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf0f expref: 35 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.447912:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80300) 00010000:00010000:1.0:1788891010.447915:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788891010.447917:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857dea00, rc 0) 00000100:00100000:1.0:1788891010.448393:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+35:11306:x1875787987862528:12345-192.168.204.26@tcp:101:cat.0 Request processed in 1497us (2046us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788891010.448403:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 104 00000100:00100000:1.0:1788891010.454125:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891010.455129:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987862784 00000100:00100000:3.0:1788891010.455148:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987862784 00000100:00100000:3.0:1788891010.455252:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:3.0:1788891010.455267:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+35:11306:x1875787987862784:12345-192.168.204.26@tcp:35:cat.0 00000100:00100000:2.0:1788891010.456778:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+36:11306:x1875787987862784:12345-192.168.204.26@tcp:35:cat.0 Request processed in 1506us (2659us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788891010.456794:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:2.0:1788891010.474302:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.474426:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987863040 00000100:00100000:0.0:1788891010.474439:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987863040 00000100:00100000:0.0:1788891010.474688:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 105 00000100:00100000:0.0:1788891010.474702:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+36:11307:x1875787987863040:12345-192.168.204.26@tcp:36:rm.0 00010000:00010000:0.0:1788891010.474787:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788891010.474830:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd533e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddefa expref: 36 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.474853:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dea00/0xa66601b03fd53444 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf0f expref: 35 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.474863:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd5341a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf08 expref: 34 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.474873:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd533d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddef3 expref: 33 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.474880:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80300) 00010000:00010000:0.0:1788891010.474884:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788891010.474906:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd53452 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475107:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd53452 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475121:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd53452 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475137:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53459 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475142:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53459 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475147:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53459 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475265:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53460 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475273:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53460 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475279:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53460 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788891010.475600:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00010000:00010000:0.0:1788891010.475667:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53467 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475676:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53467 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475684:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53467 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475700:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53467 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475708:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53467 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475715:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53467 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475749:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891010.475793:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53460 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475810:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53460 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.475816:0:10316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891010.475825:0:10316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53467 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475826:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53460 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.475834:0:10316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891010.475834:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891010.475838:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53460 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.475839:0:10316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53467 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475847:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53460 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.475858:0:10316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53467 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475858:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80300) 00010000:00010000:0.0:1788891010.475861:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788891010.475866:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53460 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.475867:0:10316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80300) 00010000:00010000:1.0:1788891010.475870:0:10316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788891010.475873:0:10316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53467 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.475879:0:10316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53467 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475881:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53460 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.475894:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891010.475895:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891010.475897:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891010.475899:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd53452 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475905:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd53452 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475910:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd53452 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475925:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891010.475929:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd53452 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.475935:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd53452 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.476097:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:0.0:1788891010.476099:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891010.476103:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd53452 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.476120:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd53452 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788891010.476133:0:6495:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b8b6317 reply state 00000000e04b8ecf transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53459 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.476147:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53459 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.476162:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9250c130be00) 00010000:00010000:0.0:1788891010.476175:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788891010.476179:0:6495:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788891010.476316:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+34:11307:x1875787987863040:12345-192.168.204.26@tcp:36:rm.0 Request processed in 1614us (2027us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788891010.476325:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 105 00000100:00100000:1.0:1788891010.515790:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891010.517769:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987863296 00000100:00100000:3.0:1788891010.517810:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987863296 00000100:00100000:3.0:1788891010.517910:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 106 00000100:00100000:3.0:1788891010.517932:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+34:11313:x1875787987863296:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:3.0:1788891010.517966:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891010.517995:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd5346e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf16 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.518134:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53475 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.518153:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53475 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.518181:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53475 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.518196:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd5347c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.518203:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd5347c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.518210:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd5347c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788891010.518787:0:6497:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788891010.518974:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53483 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.518993:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.519012:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.519057:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53475 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.519064:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53475 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.519071:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53475 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.519078:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891010.519082:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53475 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.519091:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53475 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.519105:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:3.0:1788891010.519108:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891010.519114:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53475 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.519120:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53475 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788891010.519138:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004eea66ad reply state 000000005fb48fc9 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd5347c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.519152:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd5347c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.519178:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9250c130be00) 00010000:00010000:3.0:1788891010.519181:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788891010.519185:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788891010.519222:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd5346e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf16 expref: 37 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.519238:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53483 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf16 expref: 36 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.519247:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9250905a3c00) 00010000:00010000:3.0:1788891010.519249:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788891010.519252:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925081523200, rc 0) 00000100:00100000:3.0:1788891010.519353:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+37:11313:x1875787987863296:12345-192.168.204.26@tcp:101:bash.0 Request processed in 1431us (3576us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788891010.519361:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 106 00000100:00100000:1.0:1788891010.525294:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.525450:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987863424 00000100:00100000:0.0:1788891010.525464:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987863424 00000100:00080000:1.0:1788891010.525796:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788891010.526154:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:0.0:1788891010.526179:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+7:2391:x1875787987863424:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788891010.526213:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891010.526253:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd53491 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf1d expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788891010.526296:0:8410:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891010.526328:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=232s v=(0 0) 00010000:00010000:0.0:1788891010.526334:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891010.526346:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd53491 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf1d expref: 8 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.526366:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd53491 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf1d expref: 8 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.526381:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5800, rc 0) 00000100:00100000:0.0:1788891010.526480:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+8:2391:x1875787987863424:12345-192.168.204.26@tcp:101:bash.0 Request processed in 313us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891010.526547:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:2.0:1788891010.534304:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.534739:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987863552 00000100:00100000:0.0:1788891010.534752:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987863552 00000100:00100000:0.0:1788891010.534919:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:0.0:1788891010.534936:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+8:11313:x1875787987863552:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788891010.534963:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891010.534987:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd53498 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf24 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.535025:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd53491 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf1d expref: 9 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.535036:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891010.535041:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891010.535046:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd53498 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf24 expref: 9 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.535096:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd53491 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf1d expref: 9 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.535111:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd53491 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf1d expref: 9 pid: 8410 timeout: 332 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891010.535126:0:8411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8411:1875787997362176:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891010.535250:0:8411:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab09480 going to sleep for 11 seconds 00000100:00100000:2.0:1788891010.539302:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.540492:0:8411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8411:1875787997362176:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788891010.540578:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd53498 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf24 expref: 9 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.540610:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5000, rc 0) 00000100:00100000:3.0:1788891010.540668:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987863680 00000100:00100000:3.0:1788891010.540687:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987863680 00010000:00010000:3.0:1788891010.540736:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd53491 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf1d expref: 10 pid: 8410 timeout: 332 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891010.540787:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:3.0:1788891010.540802:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+10:2393:x1875787987863680:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891010.540825:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788891010.540836:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+10:11313:x1875787987863552:12345-192.168.204.26@tcp:101:bash.0 Request processed in 5902us (6545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891010.540849:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 43 00010000:00010000:3.0:1788891010.540858:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd53491 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf1d expref: 10 pid: 8410 timeout: 332 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.540902:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd53491 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf1d expref: 9 pid: 8410 timeout: 332 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.540941:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd53491 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf1d expref: 9 pid: 8410 timeout: 332 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.540962:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891010.540966:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891010.540975:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd53498 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf24 expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.540996:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd53498 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf24 expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.541043:0:6481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd53498 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf24 expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891010.542140:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839ce680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6481:1875787997362304:192.168.204.26@tcp:105: 00000100:00100000:3.0:1788891010.542264:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891010.546135:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839ce680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6481:1875787997362304:192.168.204.26@tcp:105: 00010000:00010000:3.0:1788891010.546191:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891010.546268:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+8:2393:x1875787987863680:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 5469us (6984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891010.546282:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:2.0:1788891010.547785:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.547961:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987863936 00000100:00100000:0.0:1788891010.547973:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987863936 00000100:00100000:0.0:1788891010.548150:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:0.0:1788891010.548176:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+37:11313:x1875787987863936:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:0.0:1788891010.548724:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+38:11313:x1875787987863936:12345-192.168.204.26@tcp:35:bash.0 Request processed in 563us (948us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788891010.548733:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:2.0:1788891010.679590:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891010.679928:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987864064 00000100:00100000:1.0:1788891010.679942:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987864064 00000100:00100000:1.0:1788891010.680026:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 107 00000100:00100000:1.0:1788891010.680039:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+38:11329:x1875787987864064:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788891010.680074:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891010.680102:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd5349f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf2b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.680201:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd534a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.680218:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd534a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.680252:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd534a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891010.680424:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788891010.680429:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788891010.680471:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd534a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.680504:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd5349f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf2b expref: 40 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.681390:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd534a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf2b expref: 39 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.681404:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:1.0:1788891010.681407:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788891010.681411:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857dee00, rc 0) 00000100:00100000:1.0:1788891010.681580:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+39:11329:x1875787987864064:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1543us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891010.681590:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 107 00000100:00100000:2.0:1788891010.688008:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.688106:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987864320 00000100:00100000:0.0:1788891010.688119:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987864320 00000100:00100000:0.0:1788891010.688412:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 108 00000100:00100000:0.0:1788891010.688426:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+39:11329:x1875787987864320:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891010.688462:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891010.688487:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd534ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf32 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.688673:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd534b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.688692:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd534b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.688727:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd534b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891010.688743:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788891010.688876:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd534ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf32 expref: 42 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.688895:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd534b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf32 expref: 41 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.688905:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9250905a3c00) 00010000:00010000:0.0:1788891010.688909:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788891010.688912:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5800, rc 0) 00000100:00100000:0.0:1788891010.688986:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+41:11329:x1875787987864320:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 564us (993us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788891010.688993:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 108 00000100:00100000:2.0:1788891010.697262:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891010.697334:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891010.697575:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987864704 00000100:00100000:1.0:1788891010.697589:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987864704 00000100:00100000:1.0:1788891010.697679:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:1.0:1788891010.697694:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+41:2394:x1875787987864704:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891010.697716:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891010.697750:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd534b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf32 expref: 41 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.697806:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9250905a3c00) 00010000:00010000:1.0:1788891010.697813:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891010.697890:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+40:2394:x1875787987864704:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 199us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891010.697899:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:0.0:1788891010.698007:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987864576 00000100:00100000:0.0:1788891010.698013:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987864576 00000100:00100000:0.0:1788891010.698057:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 109 00000100:00100000:0.0:1788891010.698066:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+40:11329:x1875787987864576:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891010.698093:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891010.698112:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd534c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf39 expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.698338:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd534c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.698366:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd534c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.698388:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd534c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891010.698416:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788891010.698586:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd534c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf39 expref: 43 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.698979:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd534c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf39 expref: 42 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.698991:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9250905a3c00) 00010000:00010000:0.0:1788891010.698995:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788891010.698998:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5200, rc 0) 00000100:00100000:0.0:1788891010.699111:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+42:11329:x1875787987864576:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1045us (1775us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1788891010.699119:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 109 00000100:00100000:2.0:1788891010.705237:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.705497:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987864832 00000100:00100000:0.0:1788891010.705512:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987864832 00000100:00100000:0.0:1788891010.705642:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 44 00000100:00100000:0.0:1788891010.705660:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+8:2393:x1875787987864832:12345-192.168.204.26@tcp:1:lfs.0 00010000:00010000:0.0:1788891010.705726:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd534d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.705753:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd53498 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf24 expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.705865:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891010.705870:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788891010.705874:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd534d7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.705921:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd53498 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf24 expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.705937:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd53498 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf24 expref: 8 pid: 8411 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891010.706093:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8408:1875787997362432:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891010.706232:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab09300 going to sleep for 11 seconds 00000100:00100000:0.0:1788891010.710209:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8408:1875787997362432:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788891010.710256:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd534d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891010.711984:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.712246:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987864960 00000100:00100000:0.0:1788891010.712258:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987864960 00002000:00100000:0.0:1788891010.712327:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff924f831d8a80 x1875787987864960/t0(0) o4->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:61/0 lens 504/0 e 0 to 0 dl 1788891021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788891010.712340:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f831d8a80 with x1875787987864960 ext(0->8) 00010000:00010000:0.0:1788891010.712361:0:8416:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd53498 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf24 expref: 9 pid: 8411 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.712407:0:8416:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd53498 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf24 expref: 9 pid: 8411 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788891010.712416:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff924f831d8a80 00000100:00100000:0.0:1788891010.712463:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:0.0:1788891010.712475:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df03475d-d91a-4e91-8125-742ac4d4c589+9:2393:x1875787987864960:12345-192.168.204.26@tcp:4:lfs.0 00000100:00100000:0.0:1788891010.714067:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df03475d-d91a-4e91-8125-742ac4d4c589+11:2393:x1875787987864960:12345-192.168.204.26@tcp:4:lfs.0 Request processed in 1581us (2082us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788891010.714081:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1 00002000:00100000:0.0:1788891010.714092:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff924f831d8a80 x1875787987864960/t4294967303(0) o4->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:61/0 lens 504/448 e 0 to 0 dl 1788891021 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788891010.714103:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f831d8a80 with x1875787987864960 ext(0->8) 00010000:00010000:0.0:1788891010.714115:0:8416:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd53498 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf24 expref: 11 pid: 8411 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.714133:0:8416:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd53498 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf24 expref: 11 pid: 8411 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788891010.714140:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff924f831d8a80 00000100:00100000:2.0:1788891010.717986:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.720199:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987865088 00000100:00100000:0.0:1788891010.720219:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987865088 00010000:00010000:0.0:1788891010.720287:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd53498 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf24 expref: 11 pid: 8411 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891010.720973:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:0.0:1788891010.720989:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087acf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+11:2394:x1875787987865088:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891010.721011:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788891010.721035:0:6482:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788891010.721039:0:6482:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788891010 00002000:00010000:0.0:1788891010.721042:0:6482:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788891010 00002000:00010000:0.0:1788891010.721044:0:6482:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788891010 00002000:00010000:0.0:1788891010.721046:0:6482:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788891010.721055:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd53498 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf24 expref: 11 pid: 8411 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.721075:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd53498 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf24 expref: 11 pid: 8411 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.721105:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd53498 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf24 expref: 11 pid: 8411 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.721127:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788891010.721133:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788891010.721140:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd534d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.721151:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd534d7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.721226:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891010.721318:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087acf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+10:2394:x1875787987865088:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 333us (3345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891010.721327:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 68 00010000:00010000:2.0:1788891010.721877:0:8408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd534d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.721892:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd534d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.721923:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd534d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.721932:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd534d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.721941:0:8408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd534d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.721950:0:8408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4c00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891010.721955:0:8408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd534d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.721965:0:8408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd534d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.721981:0:8408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd534d7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.721989:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd534d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891010.722105:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+10:2393:x1875787987864832:12345-192.168.204.26@tcp:1:lfs.0 Request processed in 16451us (16883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891010.722115:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 44 00000100:00100000:2.0:1788891010.731048:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891010.731192:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987865344 00000100:00100000:1.0:1788891010.731207:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987865344 00000100:00100000:1.0:1788891010.731324:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 26 00000100:00100000:1.0:1788891010.731347:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090478450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+42:11329:x1875787987865344:12345-192.168.204.26@tcp:35:lfs.0 00000004:00010000:1.0:1788891010.731440:0:6498:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd534c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf39 expref: 42 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788891010.731714:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1788891010.731749:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788891010.732179:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1788891010.732223:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd534de lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.732242:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53483 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf16 expref: 46 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.732253:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd534de lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.732306:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53483 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf16 expref: 46 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.732337:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53483 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf16 expref: 46 pid: 6497 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891010.732356:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6498:1875787997362560:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891010.732470:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830a9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788891010.736402:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6498:1875787997362560:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891010.736446:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd534de lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891010.738968:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891010.739110:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987865472 00000100:00100000:3.0:1788891010.739118:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987865472 00010000:00010000:3.0:1788891010.739151:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53483 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf16 expref: 47 pid: 6497 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891010.739201:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:3.0:1788891010.739211:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+47:2393:x1875787987865472:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891010.739226:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891010.739235:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53483 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf16 expref: 47 pid: 6497 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.739249:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53483 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf16 expref: 47 pid: 6497 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.739268:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53483 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf16 expref: 47 pid: 6497 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.739282:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9250905a3c00) 00010000:00010000:3.0:1788891010.739286:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd534de lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.739293:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd534de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.739297:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd534de lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.739320:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788891010.739366:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd534de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891010.739381:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+46:2393:x1875787987865472:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 171us (422us total) trans 0 rc 0/0 00010000:00010000:1.0:1788891010.739393:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd534de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891010.739481:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 69 00000001:00080000:1.0:1788891010.739592:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1788891010.739758:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1788891010.740008:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6498:1875787997362688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788891010.740115:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891010.740178:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830a9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788891010.740295:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997362688 00000100:00100000:3.0:1788891010.740304:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997362688 00000100:00100000:3.0:1788891010.740351:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788891010.740359:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6498:x1875787997362688:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788891010.740482:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6498:x1875787997362688:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 123us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891010.740495:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788891010.740556:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6498:1875787997362688:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788891010.740748:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1788891010.740802:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf7f8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6498:1875787997362816:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788891010.740837:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891010.740867:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788891010.740971:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997362816 00000100:00100000:3.0:1788891010.740978:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997362816 00000100:00100000:3.0:1788891010.741022:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788891010.741031:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6498:x1875787997362816:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788891010.741903:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6498:x1875787997362816:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 868us (1061us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788891010.741913:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788891010.742240:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf7f8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6498:1875787997362816:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788891010.742322:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1788891010.742371:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd534de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.742382:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd534de lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.742391:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd534de lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.742398:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891010.742403:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd534de lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.742411:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd534de lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.742430:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9250905a3c00) 00010000:00010000:1.0:1788891010.742434:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788891010.742439:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd534de lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.742445:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd534de lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788891010.742586:0:6498:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788891010.742666:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1788891010.742680:0:6498:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 232987156446ns, next at 233987153291ns, rc = 0 00000001:00080000:1.0:1788891010.742687:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1788891010.742712:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9250905a3c00) 00010000:00010000:1.0:1788891010.742716:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788891010.742730:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd534c9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf39 expref: 50 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891010.742873:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090478450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+49:11329:x1875787987865344:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 11538us (11839us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788891010.742885:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 26 00000020:00080000:1.0:1788891010.742900:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788891010.745271:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891010.745355:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987865600 00000100:00100000:1.0:1788891010.745365:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987865600 00000100:00100000:1.0:1788891010.745486:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 110 00000100:00100000:1.0:1788891010.745495:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+49:11329:x1875787987865600:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788891010.745520:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891010.745664:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd534e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf40 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.745717:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd534e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf40 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.745731:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd534e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf40 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.745746:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:1.0:1788891010.745749:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788891010.745753:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857de600, rc 0) 00000100:00100000:1.0:1788891010.745840:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+50:11329:x1875787987865600:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 346us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891010.745848:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 110 00000100:00100000:3.0:1788891010.749773:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.749878:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987865856 00000100:00100000:0.0:1788891010.749887:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987865856 00000100:00100000:0.0:1788891010.749941:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:0.0:1788891010.749952:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+50:11329:x1875787987865856:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788891010.750595:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+51:11329:x1875787987865856:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 572us (759us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788891010.750604:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:2.0:1788891010.813993:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891010.814070:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987865984 00000100:00100000:3.0:1788891010.814083:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987865984 00000100:00100000:3.0:1788891010.814148:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 111 00000100:00100000:3.0:1788891010.814171:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+51:11339:x1875787987865984:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:3.0:1788891010.814249:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd534ec lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814266:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd534ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814280:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd534ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814308:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd534f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814316:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd534f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814322:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd534f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814407:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd534fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814415:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd534fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814421:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd534fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788891010.814470:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd534fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814483:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd534ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814489:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd534ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814496:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd534ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814502:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891010.814507:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd534ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814549:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd534ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814563:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:3.0:1788891010.814566:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891010.814572:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd534ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814579:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd534ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814594:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd534f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814600:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd534f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814606:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd534f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814611:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081523200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891010.814614:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd534f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814620:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd534f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814627:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9250c130be00) 00010000:00010000:3.0:1788891010.814630:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891010.814633:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd534f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814648:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd534f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814660:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd534fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814665:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd534fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814671:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd534fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814676:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891010.814679:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd534fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814684:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd534fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814692:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:3.0:1788891010.814694:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891010.814697:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd534fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.814703:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd534fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891010.814784:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+51:11339:x1875787987865984:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 625us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891010.814791:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 111 00000100:00100000:2.0:1788891010.849619:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.849672:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987866240 00000100:00100000:0.0:1788891010.849683:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987866240 00000100:00100000:0.0:1788891010.849755:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 112 00000100:00100000:0.0:1788891010.849766:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+51:11342:x1875787987866240:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891010.849787:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891010.849808:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53501 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf47 expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.849912:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53508 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.849929:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53508 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.849941:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53508 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.849960:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd5350f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.849969:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd5350f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.849976:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd5350f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.850090:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53516 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.850099:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53516 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.850106:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53516 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891010.850554:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788891010.852762:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53508 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.852782:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53508 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.852790:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53508 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.852797:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891010.852801:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53508 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.852830:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53508 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.852850:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:0.0:1788891010.852853:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891010.852859:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53508 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.852865:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53508 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.852882:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd5350f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.852888:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd5350f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.852894:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd5350f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.852900:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891010.852902:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd5350f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.852909:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd5350f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.852915:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9250c130be00) 00010000:00010000:0.0:1788891010.852918:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891010.852921:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd5350f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.852937:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd5350f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.852995:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53501 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf47 expref: 54 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.853010:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53516 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf47 expref: 53 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.853018:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:0.0:1788891010.853021:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788891010.853023:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4c00, rc 0) 00000100:00100000:0.0:1788891010.853149:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+53:11342:x1875787987866240:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 3383us (3539us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788891010.853170:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 112 00000100:00100000:2.0:1788891010.855940:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891010.856040:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987866368 00000100:00100000:1.0:1788891010.856064:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987866368 00000100:00100000:1.0:1788891010.856182:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 113 00000100:00100000:1.0:1788891010.856193:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+53:11342:x1875787987866368:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:1.0:1788891010.856263:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53524 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.856279:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53524 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.856291:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53524 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.856341:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53524 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.856348:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53524 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.856356:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53524 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.856370:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891010.856375:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53524 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.856382:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53524 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.856394:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:1.0:1788891010.856397:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788891010.856403:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53524 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.856420:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53524 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891010.856496:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+53:11342:x1875787987866368:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 305us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891010.856508:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 113 00000100:00100000:2.0:1788891010.858987:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891010.859065:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987866624 00000100:00100000:3.0:1788891010.859074:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987866624 00000100:00100000:3.0:1788891010.859137:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:3.0:1788891010.859148:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+53:11342:x1875787987866624:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:3.0:1788891010.859417:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+54:11342:x1875787987866624:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 270us (437us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1788891010.859424:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:2.0:1788891010.920253:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891010.920371:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987866880 00000100:00100000:1.0:1788891010.920382:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987866880 00000100:00100000:1.0:1788891010.920444:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 114 00000100:00100000:1.0:1788891010.920454:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+54:11352:x1875787987866880:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1788891010.920484:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891010.920488:0:12407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788891010.920566:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd534a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf2b expref: 54 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.920591:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:1.0:1788891010.920596:0:12407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788891010.920612:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd5352b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf4e expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.920725:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53532 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.920740:0:12407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53516 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf47 expref: 54 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.920748:0:12407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53532 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.920805:0:12407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53516 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf47 expref: 54 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.920819:0:12407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53516 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf47 expref: 54 pid: 9362 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891010.920833:0:12407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf7f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997362944:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891010.920942:0:12407:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847300 going to sleep for 11 seconds 00000100:00100000:2.0:1788891010.927272:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891010.927362:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987867008 00000100:00100000:3.0:1788891010.927372:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987867008 00010000:00010000:3.0:1788891010.927413:0:10317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53516 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf47 expref: 55 pid: 9362 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891010.927461:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:3.0:1788891010.927472:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+55:2394:x1875787987867008:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891010.927488:0:10317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891010.927496:0:10317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53516 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf47 expref: 55 pid: 9362 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.927512:0:10317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53516 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf47 expref: 55 pid: 9362 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.927574:0:10317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:3.0:1788891010.927580:0:10317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53532 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.927590:0:10317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53532 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.927619:0:10317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53532 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.927640:0:10317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891010.927691:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+55:2394:x1875787987867008:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 221us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891010.927699:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 70 00010000:00010000:1.0:1788891010.929699:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53516 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf47 expref: 54 pid: 9362 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891010.929725:0:12407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf7f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997362944:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891010.929749:0:12407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53532 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.929760:0:12407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53532 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.929766:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53532 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891010.929790:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788891010.929936:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd5352b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf4e expref: 55 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.929952:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53532 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf4e expref: 54 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.929977:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:1.0:1788891010.929980:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788891010.929983:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857de200, rc 0) 00000100:00100000:1.0:1788891010.930103:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+54:11352:x1875787987866880:12345-192.168.204.26@tcp:101:bash.0 Request processed in 9649us (9859us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788891010.930112:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 114 00000100:00100000:2.0:1788891010.937223:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.938204:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987867136 00000100:00100000:0.0:1788891010.938215:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987867136 00000100:00100000:0.0:1788891010.938275:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 115 00000100:00100000:0.0:1788891010.938286:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+54:11352:x1875787987867136:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788891010.938311:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891010.938333:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53540 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf55 expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.938370:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53547 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.938385:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53547 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.938422:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53547 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.938543:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53540 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf55 expref: 56 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.938561:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53547 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf55 expref: 55 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.938570:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:0.0:1788891010.938573:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788891010.938577:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5200, rc 0) 00000100:00100000:0.0:1788891010.938709:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+55:11352:x1875787987867136:12345-192.168.204.26@tcp:101:bash.0 Request processed in 424us (1499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891010.938718:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 115 00000100:00100000:2.0:1788891010.943120:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891010.943195:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987867392 00000100:00100000:1.0:1788891010.943205:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987867392 00000100:00100000:1.0:1788891010.943261:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 116 00000100:00100000:1.0:1788891010.943270:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+55:11352:x1875787987867392:12345-192.168.204.26@tcp:36:bash.0 00010000:00010000:1.0:1788891010.943486:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd5354e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.943502:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd5354e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.943513:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd5354e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788891010.943599:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1788891010.943621:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f21af19 reply state 00000000bc2bada3 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd5354e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.943634:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd5354e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.943641:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:1.0:1788891010.943644:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788891010.943661:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788891010.943740:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+58:11352:x1875787987867392:12345-192.168.204.26@tcp:36:bash.0 Request processed in 471us (630us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788891010.943747:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 116 00000020:00080000:1.0:1788891010.943752:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788891010.950413:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891010.950568:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987867520 00000100:00100000:1.0:1788891010.950581:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987867520 00000100:00100000:1.0:1788891010.950657:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 117 00000100:00100000:1.0:1788891010.950668:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+58:11352:x1875787987867520:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1788891010.950696:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891010.950718:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53555 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf5c expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.950959:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd5355c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.950974:0:12407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53532 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf4e expref: 59 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.950982:0:12407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd5355c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.951016:0:12407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53532 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf4e expref: 59 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.951031:0:12407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53532 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf4e expref: 59 pid: 12407 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891010.951046:0:12407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf7f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997363072:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891010.951151:0:12407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830a9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788891010.955681:0:12407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf7f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997363072:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891010.955717:0:12407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd5355c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891010.956989:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.957220:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987867648 00000100:00100000:0.0:1788891010.957229:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987867648 00010000:00010000:0.0:1788891010.957267:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53532 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf4e expref: 60 pid: 12407 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891010.957310:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 71 00000100:00100000:0.0:1788891010.957331:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+60:2394:x1875787987867648:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891010.957348:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891010.957355:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53532 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf4e expref: 60 pid: 12407 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.957389:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53532 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf4e expref: 60 pid: 12407 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.957411:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53532 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf4e expref: 60 pid: 12407 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.957427:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:0.0:1788891010.957432:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd5355c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.957441:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd5355c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.957449:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd5355c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.957483:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891010.957574:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+59:2394:x1875787987867648:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 245us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891010.957582:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 71 00010000:00010000:2.0:1788891010.957696:0:12407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd5355c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.957704:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd5355c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891010.957755:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788891010.957759:0:12407:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788891010.957841:0:12407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd5355c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.957873:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53555 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf5c expref: 59 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.957903:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd5355c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf5c expref: 58 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891010.957911:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:2.0:1788891010.957914:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891010.957917:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857df000, rc 0) 00000100:00100000:2.0:1788891010.958141:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+58:11352:x1875787987867520:12345-192.168.204.26@tcp:101:bash.0 Request processed in 7473us (7740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891010.958150:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 117 00000100:00100000:2.0:1788891010.962376:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891010.962603:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987867904 00000100:00100000:0.0:1788891010.962613:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987867904 00000100:00100000:0.0:1788891010.962665:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:0.0:1788891010.962675:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+58:11352:x1875787987867904:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:0.0:1788891010.962947:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+59:11352:x1875787987867904:12345-192.168.204.26@tcp:35:bash.0 Request processed in 273us (589us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788891010.962962:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:2.0:1788891011.001376:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891011.002279:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987868032 00000100:00100000:3.0:1788891011.002291:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987868032 00000100:00100000:3.0:1788891011.002361:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 118 00000100:00100000:3.0:1788891011.002372:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+59:11358:x1875787987868032:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891011.002399:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891011.002420:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53563 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf63 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891011.002484:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd5356a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891011.002498:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd5356a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891011.002508:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd5356a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891011.002568:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788891011.002572:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891011.002590:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd5356a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891011.002633:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53563 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf63 expref: 61 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891011.002652:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd5356a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf63 expref: 60 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891011.002661:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:3.0:1788891011.002663:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788891011.002668:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925081523200, rc 0) 00000100:00100000:3.0:1788891011.002738:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+60:11358:x1875787987868032:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 367us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891011.002746:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 118 00010000:00010000:3.0:1788891011.004010:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891011.007501:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891011.011268:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987868160 00000100:00100000:0.0:1788891011.011295:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987868160 00000100:00100000:0.0:1788891011.011400:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 119 00000100:00100000:0.0:1788891011.011642:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+60:11358:x1875787987868160:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891011.011673:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891011.011708:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53571 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf6a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.011812:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53578 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.011832:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53578 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.011847:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53578 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.011862:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5357f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.011871:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5357f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.011879:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5357f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.011977:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53586 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.011988:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.012020:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891011.012076:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788891011.012082:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788891011.012105:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.012122:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.012132:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53578 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.012140:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53578 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.012147:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53578 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.012168:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891011.012174:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53578 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.012183:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53578 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.012199:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:0.0:1788891011.012202:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891011.012208:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53578 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.012226:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53578 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.012241:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5357f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.012247:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5357f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.012253:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5357f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.012258:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891011.012262:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5357f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.012269:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5357f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.012278:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9250c130be00) 00010000:00010000:0.0:1788891011.012281:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891011.012283:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5357f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.012290:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5357f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.012322:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53571 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf6a expref: 62 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.012339:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53586 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf6a expref: 61 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.012353:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:0.0:1788891011.012355:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788891011.012358:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4c00, rc 0) 00000100:00100000:0.0:1788891011.012761:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+61:11358:x1875787987868160:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1124us (5271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891011.013758:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 119 00000100:00100000:2.0:1788891011.016170:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891011.018482:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987868416 00000100:00100000:1.0:1788891011.018499:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987868416 00000100:00100000:1.0:1788891011.018602:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 120 00000100:00100000:1.0:1788891011.018614:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+61:11358:x1875787987868416:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788891011.018722:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891011.018754:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd5358d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf71 expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.018891:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.018909:0:12407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd5355c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf5c expref: 62 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.018917:0:12407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53586 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf6a expref: 62 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.018924:0:12407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.018963:0:12407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53586 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf6a expref: 62 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.018976:0:12407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53586 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf6a expref: 62 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891011.019006:0:12407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf7f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997363200:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891011.019443:0:12407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd5355c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf5c expref: 62 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.019455:0:12407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd5355c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf5c expref: 62 pid: 12407 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891011.019465:0:12407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf7f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997363328:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891011.019497:0:12407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830a9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788891011.019507:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891011.019573:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987868544 00000100:00100000:1.0:1788891011.019587:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987868544 00010000:00010000:1.0:1788891011.019631:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53586 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf6a expref: 63 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891011.019659:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 72 00000100:00100000:1.0:1788891011.019667:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+63:2394:x1875787987868544:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891011.019687:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891011.019693:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53586 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf6a expref: 63 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.019703:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53586 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf6a expref: 63 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.019723:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:1.0:1788891011.019727:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.019738:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.019742:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891011.019762:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+63:2394:x1875787987868544:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 98us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891011.019767:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 72 00010000:00010000:1.0:1788891011.023504:0:12407:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.26@tcp) returned -22 from blocking AST (req@000000004dfe2f04 x1875787997363200) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53586 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf6a expref: 62 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.023772:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53586 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf6a expref: 62 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891011.023805:0:12407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf7f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997363200:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891011.023826:0:12407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf7f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997363328:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891011.023864:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:1.0:1788891011.023872:0:12407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.023884:0:12407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891011.023893:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:1.0:1788891011.023900:0:12407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891011.024128:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987868672 00000100:00100000:2.0:1788891011.024136:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987868672 00010000:00010000:2.0:1788891011.024192:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd5355c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf5c expref: 62 pid: 12407 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891011.024240:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00100000:2.0:1788891011.024251:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+62:2392:x1875787987868672:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891011.024272:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891011.024278:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd5355c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf5c expref: 62 pid: 12407 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891011.024320:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd5355c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf5c expref: 62 pid: 12407 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891011.024353:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd5355c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf5c expref: 62 pid: 12407 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891011.024366:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:2.0:1788891011.024370:0:7436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891011.024378:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891011.024387:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891011.024418:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891011.024487:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+61:2392:x1875787987868672:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 236us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891011.024496:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 73 00010000:00010000:1.0:1788891011.025295:0:12407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.025319:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891011.025513:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788891011.025915:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd5358d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf71 expref: 62 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.025943:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf71 expref: 61 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.025955:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:1.0:1788891011.025958:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788891011.025962:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857dfa00, rc 0) 00000100:00100000:1.0:1788891011.026091:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+61:11358:x1875787987868416:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 7477us (9945us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788891011.026100:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 120 00000100:00100000:0.0:1788891011.028655:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891011.028721:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987868928 00000100:00100000:1.0:1788891011.028740:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987868928 00000100:00100000:1.0:1788891011.028832:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:1.0:1788891011.028846:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf785880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+61:11358:x1875787987868928:12345-192.168.204.26@tcp:103:lfs.0 00010000:00010000:1.0:1788891011.028869:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891011.028904:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd534e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf40 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.028930:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:1.0:1788891011.028936:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891011.029030:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf785880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+60:11358:x1875787987868928:12345-192.168.204.26@tcp:103:lfs.0 Request processed in 186us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891011.029039:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:3.0:1788891011.030901:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891011.030987:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987869056 00000100:00100000:1.0:1788891011.030998:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987869056 00000100:00100000:1.0:1788891011.031057:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 121 00000100:00100000:1.0:1788891011.031065:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+60:11358:x1875787987869056:12345-192.168.204.26@tcp:58:lfs.0 00010000:00010000:1.0:1788891011.031235:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd535a2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.031257:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd535a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.031272:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd535a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788891011.031653:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788891011.031755:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+60:11358:x1875787987869056:12345-192.168.204.26@tcp:58:lfs.0 Request processed in 689us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891011.031764:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 121 00000100:00100000:3.0:1788891011.033874:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891011.033946:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987869184 00000100:00100000:0.0:1788891011.033958:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987869184 00000100:00100000:0.0:1788891011.034036:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 122 00000100:00100000:0.0:1788891011.034047:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+60:11358:x1875787987869184:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891011.034072:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891011.034098:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd535a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf78 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.034183:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd535a2 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.034196:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd535a9 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf78 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.034289:0:6495:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd535a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.034308:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd535a9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf78 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.034466:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:0.0:1788891011.034470:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788891011.034476:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd535a9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf78 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.034485:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5800, rc 0) 00000100:00100000:0.0:1788891011.034715:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+61:11358:x1875787987869184:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 669us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891011.034723:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 122 00000004:00080000:3.0:1788891011.708443:0:8593:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 233952916949ns, next at 234952913835ns, rc = 0 00000100:00100000:3.0:1788891011.708468:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788891011.708488:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997363456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788891011.708575:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891011.708613:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997363584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788891011.708648:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997363456 00000100:00100000:3.0:1788891011.708656:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997363456 00000100:00100000:0.0:1788891011.708677:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891011.708715:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788891011.708725:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997363584 00000100:00100000:3.0:1788891011.708727:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1875787997363456:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788891011.708731:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997363584 00002000:00000024:3.0:1788891011.708753:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1788891011.708772:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788891011.708782:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997363584:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788891011.708806:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1875787997363456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (230us total) trans 0 rc 0/0 00000004:00000024:0.0:1788891011.708810:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788891011.708827:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788891011.708889:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997363456:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788891011.708958:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891011.709356:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997363584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 575us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891011.709364:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788891011.709396:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8382ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997363712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788891011.709424:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891011.709514:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997363712 00000100:00100000:3.0:1788891011.709519:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997363712 00000100:00100000:3.0:1788891011.709579:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788891011.709586:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997363712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788891011.709598:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1788891011.709633:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997363712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891011.709640:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1788891011.709714:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891011.709740:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8382ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997363712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788891011.712626:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997363584:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788891012.027759:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00010000:00010000:0.0:1788891012.027767:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788891012.027771:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788891012.027817:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788891012.027827:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788891012.027953:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8382e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875787997363840:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788891012.028100:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788891012.031060:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891012.031343:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987869312 00000100:00100000:1.0:1788891012.031353:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987869312 00000100:00100000:2.0:1788891012.031364:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8382e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875787997363840:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788891012.031475:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 123 00000100:00100000:1.0:1788891012.031486:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+61:11359:x1875787987869312:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788891012.031557:0:12407:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788891012.031697:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+61:11359:x1875787987869312:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 212us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891012.031711:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 123 00000100:00080000:0.0:1788891012.032220:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891012.034649:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891012.034787:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987869440 00000100:00100000:1.0:1788891012.034797:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987869440 00000100:00100000:1.0:1788891012.034851:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 124 00000100:00100000:1.0:1788891012.034860:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+61:11359:x1875787987869440:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788891012.034928:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd535b0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.034944:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd535b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.034954:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd535b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.034969:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd535b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.034975:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd535b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.034982:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd535b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035005:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd535be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035014:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd535be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035020:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd535be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891012.035076:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788891012.035080:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788891012.035093:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd535be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035103:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd535b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035109:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd535b0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035116:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd535b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035123:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857de600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891012.035141:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd535b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035149:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd535b0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035162:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9250905a3b00) 00010000:00010000:1.0:1788891012.035164:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891012.035169:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd535b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035175:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd535b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035188:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd535b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035203:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd535b7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035207:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd535b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035212:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891012.035215:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd535b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035220:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd535b7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035227:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff925095f80400) 00010000:00010000:1.0:1788891012.035230:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891012.035232:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd535b7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035237:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd535b7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035250:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd535be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035254:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd535be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035259:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd535be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035263:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891012.035270:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd535be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035276:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd535be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035282:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:1.0:1788891012.035284:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891012.035287:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd535be lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.035293:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd535be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891012.035376:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+61:11359:x1875787987869440:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 Request processed in 516us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891012.035386:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 124 00000100:00100000:2.0:1788891012.037624:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891012.037691:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987869696 00000100:00100000:0.0:1788891012.037701:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987869696 00000100:00100000:0.0:1788891012.037775:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 125 00000100:00100000:0.0:1788891012.037789:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+61:11359:x1875787987869696:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788891012.037817:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891012.037838:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd535c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf7f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.037941:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd535cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.037955:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd535cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.037966:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd535cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891012.037977:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788891012.038058:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd535cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.038066:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd535cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.038072:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd535cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.038078:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891012.038081:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd535cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.038102:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd535cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.038115:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:0.0:1788891012.038118:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788891012.038123:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd535cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.038129:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd535cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.038186:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd535c5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf7f expref: 63 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.038197:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9250905a3b00) 00010000:00010000:0.0:1788891012.038199:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788891012.038203:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd535c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf7f expref: 63 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.038212:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5a00, rc 0) 00000100:00100000:0.0:1788891012.038281:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+62:11359:x1875787987869696:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 493us (664us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1788891012.038288:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 125 00000100:00100000:0.0:1788891012.041612:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891012.041748:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987869824 00000100:00100000:3.0:1788891012.041758:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987869824 00000100:00100000:3.0:1788891012.041833:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 126 00000100:00100000:3.0:1788891012.041844:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+62:11359:x1875787987869824:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788891012.041883:0:9362:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788891012.042142:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+62:11359:x1875787987869824:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 290us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891012.042151:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 126 00000100:00100000:3.0:1788891012.046417:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891012.046968:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987870080 00000100:00100000:0.0:1788891012.046979:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987870080 00000100:00100000:0.0:1788891012.047091:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 127 00000100:00100000:0.0:1788891012.047102:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+62:11359:x1875787987870080:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788891012.047150:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891012.047154:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788891012.047185:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd5356a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf63 expref: 62 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.047206:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:0.0:1788891012.047211:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788891012.047225:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd535da lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf86 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788891012.047708:0:6497:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788891012.047924:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd535e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.047937:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd535e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.047947:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd535e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.048001:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd535da lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf86 expref: 64 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.048017:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd535e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf86 expref: 63 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.048025:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9250c130b000) 00010000:00010000:0.0:1788891012.048028:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788891012.048037:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4c00, rc 0) 00000100:00100000:0.0:1788891012.048123:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+63:11359:x1875787987870080:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 1022us (1714us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788891012.048130:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 127 00000100:00100000:3.0:1788891012.051807:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891012.052262:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987870336 00000100:00100000:2.0:1788891012.052276:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987870336 00000100:00100000:2.0:1788891012.052376:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 128 00000100:00100000:2.0:1788891012.052387:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+63:11359:x1875787987870336:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788891012.052448:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891012.052476:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd535e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf86 expref: 63 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052494:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9250c130b000) 00010000:00010000:2.0:1788891012.052517:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891012.052562:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd535ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052576:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd535ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052586:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd535ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052601:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd535f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xcfe945ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052608:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd535f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xcfe945ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052613:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd535f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xcfe945ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052661:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd535ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052683:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd535ef lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052690:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd535ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052696:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891012.052701:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd535ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052709:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd535ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052718:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:2.0:1788891012.052721:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891012.052725:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd535ef lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052731:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd535ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052742:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd535f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xcfe945ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052748:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd535f6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcfe945ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052753:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd535f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcfe945ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052758:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891012.052785:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd535f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcfe945ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052792:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd535f6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcfe945ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052800:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xcfe945ae (ffff924f82e36600) 00010000:00010000:2.0:1788891012.052803:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891012.052806:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd535f6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xcfe945ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.052812:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd535f6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xcfe945ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891012.052912:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+62:11359:x1875787987870336:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 525us (1112us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788891012.052920:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 128 00000100:00100000:2.0:1788891012.055290:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891012.055432:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987870464 00000100:00100000:3.0:1788891012.055443:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987870464 00000100:00100000:3.0:1788891012.055511:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 129 00000100:00100000:3.0:1788891012.055546:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+62:11359:x1875787987870464:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788891012.055583:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891012.055608:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd535fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf8d expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.055645:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53604 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.055659:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53604 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.055669:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53604 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.055793:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd535fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf8d expref: 64 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.055813:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53604 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf8d expref: 63 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.055822:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9250905a3d00) 00010000:00010000:3.0:1788891012.055825:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788891012.055828:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925081522a00, rc 0) 00000100:00100000:3.0:1788891012.055882:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+63:11359:x1875787987870464:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 362us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891012.055889:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 129 00000100:00100000:3.0:1788891012.058175:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891012.058251:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987870720 00000100:00100000:1.0:1788891012.058261:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987870720 00000100:00100000:1.0:1788891012.058315:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 130 00000100:00100000:1.0:1788891012.058326:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+63:11359:x1875787987870720:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788891012.058827:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd5360b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.058844:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd5360b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.058855:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd5360b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788891012.059197:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:1.0:1788891012.059274:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007da7f0b1 reply state 000000000ea15c65 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd5360b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.059289:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd5360b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.059296:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9250905a3d00) 00010000:00010000:1.0:1788891012.059299:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788891012.059303:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788891012.059412:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+65:11359:x1875787987870720:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 1085us (1244us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788891012.059420:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 130 00000100:00100000:3.0:1788891012.061669:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891012.061724:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987870848 00000100:00100000:2.0:1788891012.061733:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987870848 00000100:00100000:2.0:1788891012.061797:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 131 00000100:00100000:2.0:1788891012.061809:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+65:11359:x1875787987870848:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891012.061832:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891012.061853:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53612 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf94 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.061907:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53612 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf94 expref: 66 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.061920:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53612 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf94 expref: 66 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.061947:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9250905a3d00) 00010000:00010000:2.0:1788891012.061950:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788891012.061953:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310800, rc 0) 00000100:00100000:2.0:1788891012.062014:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+66:11359:x1875787987870848:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 208us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891012.062020:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 131 00000100:00100000:2.0:1788891012.064806:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891012.065064:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987870976 00000100:00100000:0.0:1788891012.065073:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987870976 00000100:00100000:0.0:1788891012.065220:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00100000:0.0:1788891012.065232:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+8:2391:x1875787987870976:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788891012.065502:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+9:2391:x1875787987870976:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 271us (708us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788891012.065511:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00080000:1.0:1788891012.065893:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788891012.067374:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891012.067759:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987871232 00000100:00100000:1.0:1788891012.067771:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987871232 00000100:00100000:1.0:1788891012.067821:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:1.0:1788891012.067831:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+66:11359:x1875787987871232:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788891012.068143:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+67:11359:x1875787987871232:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 300us (765us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1788891012.068152:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:2.0:1788891012.069938:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891012.070027:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987871488 00000100:00100000:1.0:1788891012.070035:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987871488 00000100:00100000:1.0:1788891012.070087:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 132 00000100:00100000:1.0:1788891012.070095:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+67:11359:x1875787987871488:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788891012.070217:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+67:11359:x1875787987871488:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 122us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891012.070226:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 132 00000100:00100000:2.0:1788891012.073882:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891012.074163:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987871616 00000100:00100000:1.0:1788891012.074188:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987871616 00000100:00100000:1.0:1788891012.074287:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 133 00000100:00100000:1.0:1788891012.074299:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+67:11359:x1875787987871616:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788891012.074335:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891012.074359:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd53619 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddf9b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.074434:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53620 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.074449:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53620 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.074461:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53620 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891012.074560:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788891012.074585:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53620 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.074615:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd53619 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf9b expref: 69 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.074633:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53620 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf9b expref: 68 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.074644:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9250905a3d00) 00010000:00010000:1.0:1788891012.074647:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788891012.074651:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857df400, rc 0) 00000100:00100000:1.0:1788891012.074763:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+68:11359:x1875787987871616:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 466us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891012.074786:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 133 00000100:00100000:0.0:1788891012.078495:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891012.078758:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987871744 00000100:00100000:2.0:1788891012.078769:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987871744 00000100:00100000:2.0:1788891012.078858:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 46 00000100:00100000:2.0:1788891012.078871:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+9:2393:x1875787987871744:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891012.078888:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891012.078909:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53627 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddfa2 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891012.078934:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa04f83, blocks: 0x0 00010000:00010000:2.0:1788891012.078955:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=234s v=(0 0) 00010000:00010000:2.0:1788891012.078959:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891012.078969:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53627 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa2 expref: 10 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.078987:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53627 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa2 expref: 10 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.079021:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310400, rc 0) 00000100:00100000:2.0:1788891012.079083:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+10:2393:x1875787987871744:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 215us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891012.079095:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 46 00000100:00100000:3.0:1788891012.080692:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891012.080767:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987872000 00000100:00100000:0.0:1788891012.080777:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987872000 00000100:00100000:0.0:1788891012.080878:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 134 00000100:00100000:0.0:1788891012.080892:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+68:11359:x1875787987872000:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788891012.080998:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+68:11359:x1875787987872000:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 111us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891012.081007:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 134 00000100:00100000:3.0:1788891012.084937:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891012.085063:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987872128 00000100:00100000:2.0:1788891012.085075:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987872128 00000100:00100000:2.0:1788891012.085181:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:2.0:1788891012.085192:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+10:11359:x1875787987872128:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891012.085211:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891012.085231:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6fa1513/0xa66601b03fd5362e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddfa9 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.085266:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53627 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa2 expref: 11 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.085276:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891012.085280:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891012.085286:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6fa1513/0xa66601b03fd5362e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa9 expref: 11 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.085322:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53627 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa2 expref: 11 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.085338:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53627 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa2 expref: 11 pid: 8411 timeout: 334 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891012.085374:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8382df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8408:1875787997363968:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891012.085466:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788891012.088396:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891012.088835:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987872256 00000100:00100000:0.0:1788891012.088845:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987872256 00010000:00010000:0.0:1788891012.088886:0:10317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53627 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa2 expref: 12 pid: 8411 timeout: 334 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891012.088960:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 74 00000100:00100000:0.0:1788891012.088971:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087accc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+12:2394:x1875787987872256:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891012.089002:0:10317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891012.089028:0:10317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53627 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa2 expref: 12 pid: 8411 timeout: 334 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.089043:0:10317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53627 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa2 expref: 12 pid: 8411 timeout: 334 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.089072:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891012.089077:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891012.089085:0:10317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6fa1513/0xa66601b03fd5362e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa9 expref: 12 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.089096:0:10317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6fa1513/0xa66601b03fd5362e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa9 expref: 12 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.089147:0:10317:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f6fa1513/0xa66601b03fd5362e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa9 expref: 12 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891012.089162:0:10317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83840380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10317:1875787997364096:192.168.204.26@tcp:105: 00000100:00100000:0.0:1788891012.089252:0:10317:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab09000 going to sleep for 11 seconds 00010000:00010000:2.0:1788891012.089340:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53627 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa2 expref: 12 pid: 8411 timeout: 334 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891012.089354:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8382df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8408:1875787997363968:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891012.089376:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6fa1513/0xa66601b03fd5362e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa9 expref: 11 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.089387:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311800, rc 0) 00000100:00100000:2.0:1788891012.089412:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+11:11359:x1875787987872128:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 4224us (4487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891012.089419:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:0.0:1788891012.092802:0:10317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83840380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10317:1875787997364096:192.168.204.26@tcp:105: 00010000:00010000:0.0:1788891012.092830:0:10317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891012.092893:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087accc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+10:2394:x1875787987872256:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 3923us (4507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891012.092905:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 74 00000100:00100000:3.0:1788891012.098004:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891012.098637:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987872384 00000100:00100000:0.0:1788891012.098649:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987872384 00002000:00100000:0.0:1788891012.098701:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff924f8318ea00 x1875787987872384/t0(0) o4->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:63/0 lens 504/0 e 0 to 0 dl 1788891023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788891012.098725:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f8318ea00 with x1875787987872384 ext(0->12) 00002000:00010000:0.0:1788891012.098731:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924f8318ea00 00000100:00100000:0.0:1788891012.098763:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:0.0:1788891012.098772:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df03475d-d91a-4e91-8125-742ac4d4c589+10:2393:x1875787987872384:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788891012.100908:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df03475d-d91a-4e91-8125-742ac4d4c589+12:2393:x1875787987872384:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 Request processed in 2122us (2901us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788891012.100926:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2 00002000:00100000:0.0:1788891012.100939:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff924f8318ea00 x1875787987872384/t4294967309(0) o4->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:63/0 lens 504/448 e 0 to 0 dl 1788891023 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788891012.100949:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f8318ea00 with x1875787987872384 ext(0->12) 00002000:00010000:0.0:1788891012.100956:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924f8318ea00 00000100:00100000:3.0:1788891012.103853:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891012.106593:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987872512 00000100:00100000:0.0:1788891012.106611:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987872512 00000100:00100000:0.0:1788891012.106696:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 135 00000100:00100000:0.0:1788891012.106709:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+68:11359:x1875787987872512:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788891012.113719:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1788891012.113742:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:1.0:1788891012.113764:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:0.0:1788891012.114093:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788891012.114114:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997364224:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788891012.114195:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788891012.114278:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff924f83847540 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788891012.114284:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff925088efde00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff924f83847f00 00000020:00080000:1.0:1788891012.114287:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff925088efd900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff924f838fce00 00000020:00080000:2.0:1788891012.114341:0:6527:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000020:00080000:1.0:1788891012.114494:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff924f8388d000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788891012.114499:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff924f839b3e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff924f8388da80 00000020:00080000:1.0:1788891012.114502:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff924f839b3a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff924f8338e000 00000020:00080000:2.0:1788891012.114537:0:6527:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 0 00010000:00010000:3.0:1788891012.114551:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dec00/0xa66601b03fd53333 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114561:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dec00/0xa66601b03fd53333 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114569:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dec00/0xa66601b03fd53333 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114574:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857dec00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891012.114579:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dec00/0xa66601b03fd53333 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114585:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dec00/0xa66601b03fd53333 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788891012.114588:0:6527:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:3.0:1788891012.114600:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9250c130ba00) 00000100:00100000:2.0:1788891012.114602:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1788891012.114604:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891012.114608:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dec00/0xa66601b03fd53333 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891012.114612:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8382df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997364352:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788891012.114615:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dec00/0xa66601b03fd53333 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114637:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd533db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114643:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd533db lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114663:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd533db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114667:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891012.114670:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd533db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114676:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd533db lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114684:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff925095f80300) 00010000:00010000:3.0:1788891012.114687:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891012.114690:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd533db lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114695:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd533db lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788891012.114710:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:3.0:1788891012.114711:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53459 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114717:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53459 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114722:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53459 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114727:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891012.114730:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53459 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114745:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53459 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114753:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9250c130be00) 00010000:00010000:3.0:1788891012.114755:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891012.114758:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53459 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114763:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53459 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114773:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd5347c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114778:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd5347c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114782:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd5347c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114787:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081523800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891012.114789:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd5347c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114795:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd5347c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114802:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9250c130be00) 00010000:00010000:3.0:1788891012.114804:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891012.114807:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd5347c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114818:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd5347c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114834:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd5354e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114840:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd5354e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114845:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd5354e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114849:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857dee00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891012.114853:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd5354e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114858:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd5354e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114866:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:3.0:1788891012.114868:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891012.114871:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd5354e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114876:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd5354e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114887:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd5360b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114893:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd5360b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114905:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd5360b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114910:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891012.114913:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd5360b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114919:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd5360b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114927:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9250905a3d00) 00010000:00010000:3.0:1788891012.114929:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788891012.114932:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd5360b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.114938:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd5360b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891012.114961:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997364224 00000100:00100000:3.0:1788891012.114967:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997364224 00000100:00100000:3.0:1788891012.115010:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788891012.115020:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3628:x1875787997364224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788891012.115045:0:11803:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:3.0:1788891012.115065:0:11803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53635 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.115084:0:11803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd533e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf01 expref: 11 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.115103:0:11803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788891012.115108:0:11803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788891012.115112:0:11803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53635 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.115149:0:11803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd533e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf01 expref: 11 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.115162:0:11803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd533e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf01 expref: 11 pid: 8408 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891012.115173:0:11803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11803:1875787997364480:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891012.117720:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891012.117759:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+16:11359:x1875787987872512:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 Request processed in 11043us (13908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891012.117771:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 135 00000100:00100000:2.0:1788891012.118096:0:11803:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891012.118915:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997364352 00000100:00100000:0.0:1788891012.118923:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997364352 00000100:00100000:2.0:1788891012.119256:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788891012.119267:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3627:x1875787997364352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788891012.119298:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:2.0:1788891012.119350:0:8410:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa04f82, atime: 0x6aa04f82, ctime: 0x6aa04f82, blocks: 0x8 00010000:00010000:2.0:1788891012.119358:0:8410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5363c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.119384:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=234s v=(0 0) 00010000:00010000:2.0:1788891012.119389:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891012.119397:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5363c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.119413:0:8410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5363c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.119422:0:8410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5363c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.119429:0:8410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5363c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.119456:0:8410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788891012.119690:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3627:x1875787997364352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 424us (1974us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788891012.119698:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:2.0:1788891012.119748:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff924f8382df80/2, rc 0, transno 4294967305 00000100:00100000:2.0:1788891012.119754:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8382df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997364352:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788891012.119827:0:10315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891012.119833:0:10315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5363c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.119843:0:10315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310000 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891012.119847:0:10315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5363c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.119857:0:10315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5363c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.119880:0:10315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5363c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.119894:0:10315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5363c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.119915:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891012.119917:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891012.119919:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788891012.120242:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788891012.122830:0:11803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11803:1875787997364480:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891012.122863:0:11803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53635 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891012.127651:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891012.127776:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891012.129002:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987872768 00000100:00100000:2.0:1788891012.129028:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987872768 00000100:00100000:2.0:1788891012.129166:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 50 00000100:00100000:2.0:1788891012.129181:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+12:2392:x1875787987872768:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788891012.129972:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987872640 00000100:00100000:0.0:1788891012.130004:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987872640 00010000:00010000:0.0:1788891012.130054:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd533e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf01 expref: 13 pid: 8408 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891012.130104:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 75 00000100:00100000:0.0:1788891012.130121:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+13:2393:x1875787987872640:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891012.130151:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891012.130159:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd533e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf01 expref: 13 pid: 8408 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.130189:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd533e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf01 expref: 13 pid: 8408 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.130215:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd533e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf01 expref: 13 pid: 8408 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.130236:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788891012.130241:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788891012.130248:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53635 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.130259:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53635 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.130295:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891012.130381:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+12:2393:x1875787987872640:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 267us (2745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891012.130400:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 75 00010000:00010000:3.0:1788891012.130966:0:11803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53635 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.130984:0:11803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53635 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.130996:0:11803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53635 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.131004:0:11803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53635 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.131030:0:11803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891012.131055:0:10314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891012.131062:0:10314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53635 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.131070:0:10314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ede00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891012.131073:0:10314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53635 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.131080:0:10314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53635 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.131091:0:10314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53635 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.131096:0:10314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53635 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.131112:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891012.131113:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891012.131114:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891012.131324:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3628:x1875787997364224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16288us (17112us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788891012.131335:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:0.0:1788891012.131376:0:3628:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff924f83840380/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788891012.131391:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997364224:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788891012.135248:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1788891012.135285:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:2.0:1788891012.136939:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+6:2392:x1875787987872768:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 Request processed in 7752us (9153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891012.136953:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 50 00000100:00100000:1.0:1788891012.139625:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891012.139901:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987873024 00000100:00100000:3.0:1788891012.139915:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987873024 00000100:00100000:3.0:1788891012.140079:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 136 00000100:00100000:3.0:1788891012.140092:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+16:11359:x1875787987873024:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788891012.140185:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891012.140220:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53620 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf9b expref: 16 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.140245:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9250905a3d00) 00010000:00010000:3.0:1788891012.140252:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788891012.140297:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53643 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.140326:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53643 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.140339:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53643 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788891012.140491:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002fa60f7 reply state 0000000092b92548 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53643 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.140517:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53643 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.140555:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9250905a3d00) 00010000:00010000:3.0:1788891012.140559:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788891012.140561:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788891012.141078:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+17:11359:x1875787987873024:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 985us (1468us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1788891012.141087:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 136 00000100:00100000:3.0:1788891012.148705:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891012.148837:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987873152 00000100:00100000:2.0:1788891012.148853:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987873152 00000100:00100000:2.0:1788891012.148939:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:2.0:1788891012.148951:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+6:2394:x1875787987873152:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788891012.149110:0:8410:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788891012.149115:0:8410:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788891010 00002000:00010000:2.0:1788891012.149118:0:8410:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788891010 00002000:00010000:2.0:1788891012.149120:0:8410:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788891011 -> 1788891010 00002000:00010000:2.0:1788891012.149122:0:8410:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788891012.149210:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+7:2394:x1875787987873152:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 260us (522us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788891012.149218:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:1.0:1788891012.153105:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891012.153383:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987873408 00000100:00100000:0.0:1788891012.153396:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987873408 00000100:00100000:0.0:1788891012.153481:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 137 00000100:00100000:0.0:1788891012.153513:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+17:11359:x1875787987873408:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788891012.153882:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5364a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.153905:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53604 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf8d expref: 17 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.153917:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5364a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.153966:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53604 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf8d expref: 17 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.153983:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53604 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf8d expref: 17 pid: 9362 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891012.154002:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831dbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6497:1875787997364608:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891012.154187:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab09480 going to sleep for 11 seconds 00000100:00100000:1.0:1788891012.163808:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891012.164087:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831dbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6497:1875787997364608:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788891012.164146:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5364a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891012.164393:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987873536 00000100:00100000:3.0:1788891012.164404:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987873536 00010000:00010000:3.0:1788891012.164452:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53604 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf8d expref: 18 pid: 9362 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891012.164500:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 76 00000100:00100000:3.0:1788891012.164513:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+18:2394:x1875787987873536:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891012.164576:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891012.164586:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53604 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf8d expref: 18 pid: 9362 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.164600:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53604 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf8d expref: 18 pid: 9362 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.164628:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53604 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf8d expref: 18 pid: 9362 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.164649:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9250905a3d00) 00010000:00010000:3.0:1788891012.164655:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5364a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.164666:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5364a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.164677:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5364a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.164898:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891012.165188:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+17:2394:x1875787987873536:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 673us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891012.165207:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 76 00010000:00010000:0.0:1788891012.165210:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5364a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.165218:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5364a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.165281:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5364a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.165324:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5364a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.165331:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5364a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.165338:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891012.165343:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5364a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.165351:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5364a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.165363:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9250905a3d00) 00010000:00010000:0.0:1788891012.165366:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788891012.165370:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5364a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.165377:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5364a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891012.165429:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+16:11359:x1875787987873408:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 Request processed in 11918us (12338us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788891012.165437:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 137 00000100:00100000:0.0:1788891012.173628:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891012.173716:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987873664 00000100:00100000:1.0:1788891012.173737:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987873664 00000100:00100000:1.0:1788891012.173827:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:1.0:1788891012.173843:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+7:2393:x1875787987873664:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788891012.173905:0:8596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b141b1e9/0xa66601b03fd53651 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.173944:0:8596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6fa1513/0xa66601b03fd5362e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa9 expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.173953:0:8596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891012.173958:0:8596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788891012.173963:0:8596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b141b1e9/0xa66601b03fd53651 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.174009:0:8596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6fa1513/0xa66601b03fd5362e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa9 expref: 7 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891012.174025:0:8596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6fa1513/0xa66601b03fd5362e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa9 expref: 7 pid: 8408 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891012.174042:0:8596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf7f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8596:1875787997364736:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891012.174159:0:8596:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830a9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788891012.180248:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891012.180359:0:8596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf7f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8596:1875787997364736:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788891012.180388:0:8596:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b141b1e9/0xa66601b03fd53651 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891012.180476:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987873792 00000100:00100000:3.0:1788891012.180484:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987873792 00010000:00010000:3.0:1788891012.180553:0:10317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6fa1513/0xa66601b03fd5362e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa9 expref: 8 pid: 8408 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891012.180594:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00100000:3.0:1788891012.180605:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+8:2394:x1875787987873792:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891012.180619:0:10317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891012.180643:0:10317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6fa1513/0xa66601b03fd5362e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa9 expref: 8 pid: 8408 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.180654:0:10317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6fa1513/0xa66601b03fd5362e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa9 expref: 8 pid: 8408 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.180677:0:10317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6fa1513/0xa66601b03fd5362e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfa9 expref: 8 pid: 8408 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.180691:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788891012.180695:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788891012.180701:0:10317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b141b1e9/0xa66601b03fd53651 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.180711:0:10317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b141b1e9/0xa66601b03fd53651 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.180733:0:10317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891012.180792:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+7:2394:x1875787987873792:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 189us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891012.180800:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 77 00010000:00010000:0.0:1788891012.180878:0:8596:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b141b1e9/0xa66601b03fd53651 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.180887:0:8596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b141b1e9/0xa66601b03fd53651 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.180908:0:8596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b141b1e9/0xa66601b03fd53651 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.180917:0:8596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b141b1e9/0xa66601b03fd53651 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.180925:0:8596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b141b1e9/0xa66601b03fd53651 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.180932:0:8596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891012.180938:0:8596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b141b1e9/0xa66601b03fd53651 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.180947:0:8596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b141b1e9/0xa66601b03fd53651 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.180960:0:8596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b141b1e9/0xa66601b03fd53651 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.180979:0:8596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b141b1e9/0xa66601b03fd53651 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891012.181058:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:2393:x1875787987873664:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 Request processed in 7219us (7445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891012.181065:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:1.0:1788891012.184226:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891012.184355:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987874048 00000100:00100000:0.0:1788891012.184367:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987874048 00000100:00100000:0.0:1788891012.184433:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 138 00000100:00100000:0.0:1788891012.184445:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+16:11359:x1875787987874048:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788891012.184648:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53658 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.184667:0:9362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53547 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf55 expref: 16 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.184676:0:9362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53658 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.184723:0:9362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53547 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf55 expref: 16 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.184739:0:9362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53547 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf55 expref: 16 pid: 9362 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891012.184754:0:9362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9362:1875787997364864:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891012.185065:0:9362:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab09480 going to sleep for 11 seconds 00000100:00100000:2.0:1788891012.193290:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891012.193462:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987874176 00000100:00100000:3.0:1788891012.193471:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987874176 00010000:00010000:3.0:1788891012.193555:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53547 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf55 expref: 17 pid: 9362 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891012.193603:0:9362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9362:1875787997364864:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788891012.193633:0:9362:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53658 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891012.193713:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00100000:2.0:1788891012.193727:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+17:2393:x1875787987874176:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891012.193742:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891012.193751:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53547 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf55 expref: 17 pid: 9362 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.193765:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53547 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf55 expref: 17 pid: 9362 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.193787:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53547 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf55 expref: 17 pid: 9362 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.193802:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:2.0:1788891012.193808:0:7436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd535a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf78 expref: 16 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.193819:0:7436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53658 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.193827:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.193834:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53658 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.193864:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891012.193919:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+16:2393:x1875787987874176:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 196us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891012.193927:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 78 00010000:00010000:0.0:1788891012.194003:0:9362:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.194010:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.194508:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5365f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.194558:0:9362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53612 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf94 expref: 16 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.194567:0:9362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5365f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.194599:0:9362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53612 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf94 expref: 16 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.194610:0:9362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53612 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf94 expref: 16 pid: 6495 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891012.194626:0:9362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9362:1875787997364992:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891012.194686:0:9362:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090028000 going to sleep for 11 seconds 00000100:00100000:0.0:1788891012.197378:0:9362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9362:1875787997364992:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788891012.197422:0:9362:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5365f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891012.197863:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891012.197909:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987874304 00000100:00100000:2.0:1788891012.197917:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987874304 00010000:00010000:2.0:1788891012.197951:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53612 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf94 expref: 17 pid: 6495 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891012.197987:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 79 00000100:00100000:2.0:1788891012.197997:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+17:2393:x1875787987874304:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891012.198011:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891012.198018:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53612 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf94 expref: 17 pid: 6495 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.198031:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53612 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf94 expref: 17 pid: 6495 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.198067:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53612 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf94 expref: 17 pid: 6495 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.198082:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9250905a3d00) 00010000:00010000:2.0:1788891012.198087:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5365f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.198096:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5365f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.198112:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5365f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.198187:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891012.198243:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+16:2393:x1875787987874304:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 247us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891012.198259:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 79 00010000:00010000:0.0:1788891012.199148:0:9362:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5365f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.199157:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5365f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788891012.199272:0:9362:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788891012.199660:0:9362:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1788891012.199702:0:9362:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788891012.199791:0:9362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9362:1875787997365120:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788891012.199852:0:9362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891012.200040:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997365120 00000100:00100000:3.0:1788891012.200047:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997365120 00000100:00100000:3.0:1788891012.200097:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788891012.200106:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9362:x1875787997365120:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788891012.200481:0:9362:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090028180 going to sleep for 11 seconds 00000100:00100000:0.0:1788891012.201033:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9362:x1875787997365120:12345-0@lo:1000:mdt00_003.0 Request processed in 925us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891012.201041:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788891012.201100:0:9362:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1788891012.201106:0:9362:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1788891012.201141:0:9362:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff924f83840380 x1875787997364224/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788891028 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891012.201155:0:9362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9362:1875787997365120:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788891012.201635:0:9362:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1788891012.201717:0:9362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf7fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9362:1875787997365248:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788891012.201770:0:9362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891012.201843:0:9362:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788891012.202034:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997365248 00000100:00100000:0.0:1788891012.202041:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997365248 00000100:00100000:0.0:1788891012.202125:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788891012.202147:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9362:x1875787997365248:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788891012.202285:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9362:x1875787997365248:12345-0@lo:1000:mdt00_003.0 Request processed in 140us (514us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788891012.202293:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788891012.202320:0:9362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf7fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9362:1875787997365248:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788891012.202364:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5365f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.202373:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5365f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.202381:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5365f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.202388:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891012.202393:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5365f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.202401:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5365f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.202419:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9250905a3d00) 00010000:00010000:2.0:1788891012.202422:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788891012.202429:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5365f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.202436:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd5365f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.202462:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd535a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.202468:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd535a2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.202485:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd535a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.202490:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857de400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891012.202493:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd535a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.202499:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd535a2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.202508:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:2.0:1788891012.202511:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788891012.202517:0:9362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd535a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf78 expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.202578:0:9362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd535a9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf78 expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.202587:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd535a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf78 expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.202616:0:9362:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd535a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf78 expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891012.202627:0:9362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8382ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9362:1875787997365376:192.168.204.26@tcp:105: 00000100:00100000:2.0:1788891012.202696:0:9362:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891012.206777:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891012.206870:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987874432 00000100:00100000:3.0:1788891012.206888:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987874432 00000100:00100000:2.0:1788891012.206894:0:9362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8382ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9362:1875787997365376:192.168.204.26@tcp:105: 00010000:00010000:2.0:1788891012.206935:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd535a2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.206945:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd535a2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.206976:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53666 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.206991:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53666 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.207002:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53666 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.207011:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53666 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.207017:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53666 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.207024:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53666 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.207031:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891012.207034:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53666 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.207042:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53666 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.207054:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:2.0:1788891012.207056:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891012.207067:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53666 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.207072:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53666 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.207082:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.207089:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53658 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.207095:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53658 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.207100:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891012.207103:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53658 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.207110:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53658 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891012.207115:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 31 00010000:00010000:2.0:1788891012.207124:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00000100:00100000:3.0:1788891012.207142:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+20:11358:x1875787987874432:12345-192.168.204.26@tcp:49:lfs.0 00010000:00010000:2.0:1788891012.207142:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788891012.207147:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53658 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.207155:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53658 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891012.207273:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+20:11358:x1875787987874432:12345-192.168.204.26@tcp:49:lfs.0 Request processed in 146us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891012.207282:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:2.0:1788891012.207337:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+19:11359:x1875787987874048:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 22894us (23121us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788891012.207346:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 138 00000020:00080000:2.0:1788891012.207355:0:9362:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788891012.207630:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788891012.207634:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788891012.208256:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788891012.208266:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788891012.209956:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891012.209997:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891012.210106:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987874816 00000100:00100000:0.0:1788891012.210115:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987874816 00000100:00100000:0.0:1788891012.210182:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:0.0:1788891012.210192:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509047a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+19:11359:x1875787987874816:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788891012.210487:0:6499:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788891012.210555:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1788891012.210588:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5366d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.210604:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5366d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.210614:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5366d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.210623:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5366d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.210630:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5366d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.210636:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5366d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.210659:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788891012.210749:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509047a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+21:11359:x1875787987874816:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 558us (800us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788891012.210758:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 32 00000020:00080000:0.0:1788891012.210763:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788891012.211122:0:10316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891012.211144:0:10316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5366d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.211154:0:10316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891012.211158:0:10316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5366d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.211166:0:10316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5366d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.211180:0:10316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9250905a3d00) 00010000:00010000:2.0:1788891012.211183:0:10316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788891012.211188:0:10316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5366d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.211194:0:10316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5366d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891012.211209:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891012.211211:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891012.211213:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891012.211790:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987874944 00000100:00100000:3.0:1788891012.211799:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987874944 00000100:00100000:3.0:1788891012.211893:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 139 00000100:00100000:3.0:1788891012.211904:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+21:11358:x1875787987874944:12345-192.168.204.26@tcp:58:lfs.0 00000040:00080000:3.0:1788891012.212057:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788891012.212122:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+21:11358:x1875787987874944:12345-192.168.204.26@tcp:58:lfs.0 Request processed in 219us (2122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891012.212142:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 139 00000100:00100000:1.0:1788891012.238103:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891012.238202:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987875072 00000100:00100000:0.0:1788891012.238212:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987875072 00000100:00100000:0.0:1788891012.238271:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 140 00000100:00100000:0.0:1788891012.238279:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+21:11361:x1875787987875072:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891012.238300:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891012.238340:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53674 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddfb0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.238400:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5367b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.238411:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5367b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.238420:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5367b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.238431:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53682 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.238435:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53682 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.238439:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53682 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.238505:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53689 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.238515:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf71 expref: 22 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.238563:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53689 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.238593:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf71 expref: 22 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.238613:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf71 expref: 22 pid: 12407 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891012.238624:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6497:1875787997365504:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891012.238698:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250900280c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891012.240657:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6497:1875787997365504:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788891012.240696:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53689 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891012.241250:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891012.241557:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987875328 00000100:00100000:0.0:1788891012.241567:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987875328 00000100:00100000:0.0:1788891012.241626:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:0.0:1788891012.241638:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+23:6155:x1875787987875328:12345-192.168.204.26@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788891012.241924:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+24:6155:x1875787987875328:12345-192.168.204.26@tcp:35:ldlm_bl.0 Request processed in 287us (674us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788891012.241931:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:1.0:1788891012.246752:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891012.246826:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987875456 00000100:00100000:3.0:1788891012.246839:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987875456 00010000:00010000:3.0:1788891012.246884:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf71 expref: 24 pid: 12407 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891012.247009:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 80 00000100:00100000:3.0:1788891012.247021:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+24:2393:x1875787987875456:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891012.247038:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891012.247047:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf71 expref: 24 pid: 12407 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.247062:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf71 expref: 24 pid: 12407 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.247087:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53594 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf71 expref: 24 pid: 12407 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.247234:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:3.0:1788891012.247240:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53689 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.247251:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.247258:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53689 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891012.247294:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891012.247461:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+23:2393:x1875787987875456:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 441us (720us total) trans 0 rc 0/0 00010000:00010000:0.0:1788891012.247470:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891012.247471:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 80 00010000:00010000:0.0:1788891012.247483:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891012.247577:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788891012.247583:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788891012.247607:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.247637:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53689 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.247650:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5367b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.247657:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5367b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.247665:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5367b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.247672:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891012.247678:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5367b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.247686:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5367b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.247697:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:0.0:1788891012.247699:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891012.247703:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5367b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.247708:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5367b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.247720:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53682 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.247799:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53682 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.247813:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53682 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.247818:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891012.247821:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53682 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.247828:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53682 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.247837:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9250c130b900) 00010000:00010000:0.0:1788891012.247840:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891012.247843:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53682 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.247848:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53682 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.247886:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd53674 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfb0 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.247902:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53689 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfb0 expref: 22 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891012.247910:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:0.0:1788891012.247913:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788891012.247915:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5a00, rc 0) 00000100:00100000:0.0:1788891012.247952:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+22:11361:x1875787987875072:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 9673us (9859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891012.247969:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 140 00000100:00100000:0.0:1788891012.732803:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788891012.732827:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997365632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788891012.732897:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891012.732953:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997365632 00000100:00100000:0.0:1788891012.732960:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997365632 00000100:00100000:0.0:1788891012.733012:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788891012.733022:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997365632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788891012.733054:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788891012.733099:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997365632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891012.733107:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788891012.733161:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997365632:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788891012.770255:0:14230:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788891012.770267:0:14230:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788891012.770296:0:14230:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788891012.770304:0:14230:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788891013.052093:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788891013.243741:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788891013.243753:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788891013.243782:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788891013.243791:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788891013.243939:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf7f9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875787997365760:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788891013.244078:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff925087afa900 going to sleep for 11 seconds 00000100:00100000:1.0:1788891013.251805:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891013.252293:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf7f9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875787997365760:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788891013.252579:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987875584 00000100:00100000:3.0:1788891013.252587:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987875584 00000100:00100000:3.0:1788891013.252690:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 141 00000100:00100000:3.0:1788891013.252701:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+22:11374:x1875787987875584:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788891013.252736:0:9362:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788891013.252855:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+22:11374:x1875787987875584:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 155us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891013.252864:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 141 00000100:00100000:3.0:1788891013.255658:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891013.255761:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987875840 00000100:00100000:1.0:1788891013.255772:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987875840 00000100:00100000:1.0:1788891013.255837:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 142 00000100:00100000:1.0:1788891013.255847:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+22:11374:x1875787987875840:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788891013.255866:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891013.255887:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53690 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddfb7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891013.256009:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd53697 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891013.256025:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd53697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891013.256037:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd53697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891013.256049:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788891013.256177:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53690 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfb7 expref: 25 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891013.256196:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd53697 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfb7 expref: 24 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891013.256205:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:1.0:1788891013.256208:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788891013.256212:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857dfe00, rc 0) 00000100:00100000:1.0:1788891013.257782:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+24:11374:x1875787987875840:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 436us (633us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788891013.257798:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 142 00000100:00100000:2.0:1788891013.259466:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891013.259755:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891013.259824:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987876224 00000100:00100000:2.0:1788891013.259833:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987876224 00000100:00100000:2.0:1788891013.259888:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:2.0:1788891013.259897:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087acfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+24:2394:x1875787987876224:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891013.259912:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891013.259948:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd53697 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfb7 expref: 24 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891013.259966:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:2.0:1788891013.259970:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891013.260069:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987876096 00000100:00100000:0.0:1788891013.260073:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987876096 00000100:00100000:0.0:1788891013.260101:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 143 00000100:00100000:0.0:1788891013.260117:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+24:11374:x1875787987876096:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788891013.260175:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd536a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891013.260188:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd536a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891013.260207:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd536a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891013.260344:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd536a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891013.260351:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd536a5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891013.260358:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd536a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891013.260364:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891013.260378:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd536a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891013.260386:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd536a5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891013.260394:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:0.0:1788891013.260397:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788891013.260401:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd536a5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891013.260407:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd536a5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891013.260494:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087acfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+25:2394:x1875787987876224:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 596us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891013.260502:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000040:00080000:2.0:1788891013.260633:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788891013.260638:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788891013.261273:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788891013.261280:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788891013.261846:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+24:11374:x1875787987876096:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 1733us (2381us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788891013.261859:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 143 00000100:00100000:2.0:1788891013.264205:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891013.264355:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987876480 00000100:00100000:0.0:1788891013.264365:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987876480 00000100:00100000:0.0:1788891013.264453:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:0.0:1788891013.264464:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+24:11374:x1875787987876480:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788891013.264737:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+25:11374:x1875787987876480:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 274us (543us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788891013.264745:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:1.0:1788891013.584788:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891013.584893:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987876608 00000100:00100000:0.0:1788891013.584905:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987876608 00000100:00100000:0.0:1788891013.584964:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 361 00000100:00100000:0.0:1788891013.584973:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2394:x1875787987876608:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891013.585055:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2394:x1875787987876608:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 82us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891013.585062:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 361 00000100:00100000:3.0:1788891013.586412:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891013.586457:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891013.586491:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891013.586517:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987876992 00000100:00100000:2.0:1788891013.586519:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987876736 00000100:00100000:0.0:1788891013.586553:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987876992 00000100:00100000:2.0:1788891013.586561:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987876736 00000100:00100000:3.0:1788891013.586575:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891013.586603:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891013.586613:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987877248 00000100:00100000:2.0:1788891013.586618:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987877248 00000100:00100000:3.0:1788891013.586635:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891013.586652:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987876864 00000100:00100000:2.0:1788891013.586657:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987876864 00000100:00080000:1.0:1788891013.586658:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788891013.586665:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788891013.586674:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987877376 00000100:00100000:2.0:1788891013.586678:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987877376 00000100:00100000:1.0:1788891013.586693:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 197 00000100:00100000:1.0:1788891013.586706:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+25:2394:x1875787987876736:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788891013.586711:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 198 00000100:00100000:2.0:1788891013.586722:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2393:x1875787987877248:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788891013.586791:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+25:2394:x1875787987876736:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 88us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891013.586793:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2393:x1875787987877248:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 71us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891013.586807:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 197 00000100:00100000:2.0:1788891013.586814:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 198 00000100:00100000:1.0:1788891013.586831:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 199 00000100:00100000:2.0:1788891013.586853:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 200 00000100:00100000:1.0:1788891013.586864:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987876864:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788891013.586865:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2393:x1875787987877376:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788891013.586895:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987876864:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 42us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891013.586906:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 199 00000100:00100000:2.0:1788891013.586917:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2393:x1875787987877376:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 55us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891013.586927:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 200 00000100:00080000:1.0:1788891013.587061:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788891013.587422:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987877120 00000100:00100000:0.0:1788891013.587428:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987877120 00000100:00100000:0.0:1788891013.587541:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 100 00000100:00100000:0.0:1788891013.587549:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+6:2393:x1875787987876992:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891013.587588:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+6:2393:x1875787987876992:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 40us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891013.587594:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 100 00000100:00100000:0.0:1788891013.587608:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 101 00000100:00100000:0.0:1788891013.587613:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+9:2393:x1875787987877120:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891013.587654:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+9:2393:x1875787987877120:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 40us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891013.587661:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 101 00000100:00080000:1.0:1788891013.587770:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788891013.758456:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1788891013.758472:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:0.0:1788891014.075692:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788891014.268665:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788891014.268674:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788891014.268693:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788891014.268700:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788891014.342312:0:14281:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788891014.342322:0:14281:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788891014.342352:0:14281:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788891014.342359:0:14281:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788891014.459766:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891014.459871:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987877632 00000100:00100000:1.0:1788891014.459882:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987877632 00000100:00080000:2.0:1788891014.460024:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891014.460147:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 144 00000100:00100000:1.0:1788891014.460161:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+25:11394:x1875787987877632:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788891014.460182:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891014.460205:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd536ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddfbe expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891014.460322:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dec00/0xa66601b03fd536b3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891014.460336:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dec00/0xa66601b03fd536b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891014.460348:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dec00/0xa66601b03fd536b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891014.460376:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788891014.460490:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dee00/0xa66601b03fd536ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfbe expref: 28 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891014.460509:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dec00/0xa66601b03fd536b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfbe expref: 27 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891014.460517:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:1.0:1788891014.460520:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788891014.460565:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857dec00, rc 0) 00000100:00100000:1.0:1788891014.460628:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+27:11394:x1875787987877632:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 470us (873us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788891014.460636:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 144 00000100:00100000:0.0:1788891014.463594:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891014.463623:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987877760 00000100:00100000:2.0:1788891014.463639:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987877760 00000100:00100000:2.0:1788891014.463710:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 145 00000100:00100000:2.0:1788891014.463721:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+27:11394:x1875787987877760:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:2.0:1788891014.463815:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd536c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891014.463833:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd536c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891014.463847:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd536c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891014.463885:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd536c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891014.463893:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd536c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891014.463900:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd536c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891014.463926:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891014.463932:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd536c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891014.463939:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd536c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891014.463953:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:2.0:1788891014.463956:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788891014.463962:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd536c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891014.463968:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd536c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891014.464124:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+27:11394:x1875787987877760:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 404us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891014.464132:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 145 00000100:00100000:0.0:1788891014.528151:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891014.528252:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987877888 00000100:00100000:1.0:1788891014.528263:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987877888 00000100:00100000:1.0:1788891014.528344:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 53 00000100:00100000:1.0:1788891014.528355:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:2394:x1875787987877888:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:1.0:1788891014.528372:0:8596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891014.528394:0:8596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a817130c/0xa66601b03fd536c8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddfc5 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788891014.528419:0:8596:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa04f82, atime: 0x6aa04f82, ctime: 0x6aa04f82, blocks: 0x8 00010000:00010000:1.0:1788891014.528441:0:8596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=236s v=(0 0) 00010000:00010000:1.0:1788891014.528447:0:8596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891014.528456:0:8596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a817130c/0xa66601b03fd536c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfc5 expref: 7 pid: 8596 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891014.528501:0:8596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a817130c/0xa66601b03fd536c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfc5 expref: 7 pid: 8596 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891014.528515:0:8596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857dee00, rc 0) 00000100:00100000:1.0:1788891014.528611:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+7:2394:x1875787987877888:12345-192.168.204.26@tcp:101:cat.0 Request processed in 258us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891014.528620:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 53 00000100:00080000:2.0:1788891014.528702:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788891014.532071:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891014.532148:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987878016 00000100:00100000:0.0:1788891014.532156:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987878016 00002000:00100000:0.0:1788891014.532205:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff924f8318dc00 x1875787987878016/t0(0) o3->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:65/0 lens 488/0 e 0 to 0 dl 1788891025 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788891014.532216:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f8318dc00 with x1875787987878016 ext(0->4095) 00002000:00010000:0.0:1788891014.532221:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924f8318dc00 00000100:00100000:0.0:1788891014.532297:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:0.0:1788891014.532306:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df03475d-d91a-4e91-8125-742ac4d4c589+7:2393:x1875787987878016:12345-192.168.204.26@tcp:3:cat.0 00000100:00100000:0.0:1788891014.532479:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df03475d-d91a-4e91-8125-742ac4d4c589+7:2393:x1875787987878016:12345-192.168.204.26@tcp:3:cat.0 Request processed in 173us (416us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788891014.532485:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 3 00002000:00100000:0.0:1788891014.532495:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff924f8318dc00 x1875787987878016/t0(0) o3->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:65/0 lens 488/4536 e 0 to 0 dl 1788891025 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788891014.532503:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f8318dc00 with x1875787987878016 ext(0->4095) 00002000:00010000:0.0:1788891014.532506:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924f8318dc00 00000100:00100000:0.0:1788891014.781089:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997365888:0@lo:400:kworker.0 00000100:00100000:0.0:1788891014.781162:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891014.781224:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997366400:0@lo:400:kworker.0 00000100:00100000:0.0:1788891014.781257:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891014.781277:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997366912:0@lo:400:kworker.0 00000100:00100000:0.0:1788891014.781296:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891014.781309:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997367424:0@lo:400:kworker.0 00000100:00100000:0.0:1788891014.781325:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891014.781343:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788891014.781348:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997366272:0@lo:400:kworker.0 00000100:00100000:0.0:1788891014.781367:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891014.781378:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997366784:0@lo:400:kworker.0 00000100:00100000:0.0:1788891014.781394:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891014.781404:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997367296:0@lo:400:kworker.0 00000100:00100000:0.0:1788891014.781422:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891014.781445:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997366144:0@lo:400:kworker.0 00000100:00100000:2.0:1788891014.781459:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997366912 00000100:00100000:0.0:1788891014.781467:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891014.781469:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997366912 00000100:00100000:0.0:1788891014.781485:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997366656:0@lo:400:kworker.0 00000100:00100000:0.0:1788891014.781506:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891014.781546:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1875787997367168:0@lo:400:kworker.0 00000100:00100000:2.0:1788891014.781552:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997367424 00000100:00100000:2.0:1788891014.781557:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997367424 00000100:00100000:2.0:1788891014.781580:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997366784 00000100:00100000:2.0:1788891014.781584:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997366784 00000100:00100000:0.0:1788891014.781587:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891014.781608:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788891014.781610:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997367296 00000100:00100000:2.0:1788891014.781615:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997367296 00000100:00100000:0.0:1788891014.781616:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997366016:0@lo:400:kworker.0 00000100:00100000:2.0:1788891014.781643:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788891014.781643:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891014.781659:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3630:x1875787997366912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891014.781662:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997366528:0@lo:400:kworker.0 00000100:00100000:0.0:1788891014.781684:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891014.781697:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1875787997367040:0@lo:400:kworker.0 00000100:00100000:0.0:1788891014.781733:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891014.781738:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3630:x1875787997366912:12345-0@lo:400:kworker.0 Request processed in 81us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891014.781755:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788891014.781758:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997366400 00000100:00100000:0.0:1788891014.781763:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997366400 00000100:00100000:2.0:1788891014.781776:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788891014.781786:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997367424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891014.781804:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997366144 00000100:00100000:0.0:1788891014.781808:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997366144 00000100:00100000:2.0:1788891014.781827:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997367424:12345-0@lo:400:kworker.0 Request processed in 41us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891014.781827:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788891014.781836:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997366400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891014.781840:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788891014.781859:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788891014.781868:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997366784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891014.781879:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997366400:12345-0@lo:400:kworker.0 Request processed in 41us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891014.781886:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788891014.781901:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788891014.781912:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997366144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891014.781913:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997366784:12345-0@lo:400:kworker.0 Request processed in 43us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891014.781942:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997366144:12345-0@lo:400:kworker.0 Request processed in 35us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891014.781948:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788891014.781963:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788891014.781969:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997367296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891014.781992:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997367296:12345-0@lo:400:kworker.0 Request processed in 24us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891014.781998:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788891014.782025:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788891014.782032:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997366144:0@lo:400:kworker.0 00000100:00080000:2.0:1788891014.782054:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788891014.782059:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891014.782071:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997366784:0@lo:400:kworker.0 00000100:00100000:2.0:1788891014.782073:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997366272 00000100:00100000:2.0:1788891014.782090:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997366272 00000100:00100000:0.0:1788891014.782096:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997367296:0@lo:400:kworker.0 00000100:00100000:0.0:1788891014.782112:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997366400:0@lo:400:kworker.0 00000100:00100000:2.0:1788891014.782115:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997366656 00000100:00100000:2.0:1788891014.782119:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997366656 00000100:00100000:2.0:1788891014.782141:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997367168 00000100:00100000:2.0:1788891014.782146:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997367168 00000100:00100000:0.0:1788891014.782148:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997366912:0@lo:400:kworker.0 00000100:00100000:2.0:1788891014.782162:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997366016 00000100:00100000:1.0:1788891014.782162:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997365888 00000100:00100000:0.0:1788891014.782163:0:3630:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000100:00100000:2.0:1788891014.782167:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997366016 00000100:00100000:1.0:1788891014.782167:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997365888 00000004:00080000:0.0:1788891014.782171:0:3630:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000100:00100000:2.0:1788891014.782181:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997366528 00000100:00100000:2.0:1788891014.782185:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997366528 00000004:00080000:0.0:1788891014.782192:0:3630:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff924f83a72a00, transno 4294967302 00000100:00100000:2.0:1788891014.782199:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997367040 00000100:00100000:1.0:1788891014.782199:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788891014.782202:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997367040 00000100:00100000:1.0:1788891014.782207:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3630:x1875787997365888:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1788891014.782209:0:3630:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000100:00100000:2.0:1788891014.782218:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788891014.782226:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997366272:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1788891014.782228:0:3630:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff924f8382df80, transno 4294967305 00000100:00100000:0.0:1788891014.782236:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997367424:0@lo:400:kworker.0 00000100:00100000:1.0:1788891014.782261:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3630:x1875787997365888:12345-0@lo:400:kworker.0 Request processed in 42us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891014.782263:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997366272:12345-0@lo:400:kworker.0 Request processed in 38us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891014.782270:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788891014.782276:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997366272:0@lo:400:kworker.0 00000100:00100000:2.0:1788891014.782277:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788891014.782295:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788891014.782296:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997365888:0@lo:400:kworker.0 00000100:00100000:2.0:1788891014.782306:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875787997366656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891014.782306:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788891014.782313:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875787997367168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891014.782418:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875787997366656:12345-0@lo:400:kworker.0 Request processed in 115us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891014.782426:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788891014.782477:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788891014.782485:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997366016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891014.782500:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788891014.782509:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1788891014.782510:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875787997366528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891014.782519:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:3.0:1788891014.782647:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788891014.782654:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875787997367040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891014.783615:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875787997366528:12345-0@lo:400:kworker.0 Request processed in 1104us (1927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891014.783623:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788891014.783640:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875787997367040:12345-0@lo:400:kworker.0 Request processed in 986us (1906us total) trans 0 rc 0/0 00000100:00080000:2.0:1788891014.783645:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788891014.783650:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788891014.783657:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788891014.783671:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997366016:12345-0@lo:400:kworker.0 Request processed in 1184us (2026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891014.783682:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788891014.783684:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997366016:0@lo:400:kworker.0 00000100:00100000:2.0:1788891014.783702:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997366528:0@lo:400:kworker.0 00000100:00100000:2.0:1788891014.783714:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1875787997367040:0@lo:400:kworker.0 00010000:00080000:2.0:1788891014.783731:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83addc00 x1875787997366656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891014.783741:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997366656:0@lo:400:kworker.0 00010000:00080000:2.0:1788891014.783755:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83add500 x1875787997367168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891014.783765:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1875787997367168:0@lo:400:kworker.0 00000100:00100000:1.0:1788891014.784121:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875787997367168:12345-0@lo:400:kworker.0 Request processed in 1807us (2535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891014.784130:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000040:00080000:3.0:1788891014.844460:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788891015.100132:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891015.291973:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8382df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997367552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788891015.292084:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891015.292219:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997367552 00000100:00100000:1.0:1788891015.292229:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997367552 00000100:00100000:1.0:1788891015.292295:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788891015.292324:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997367552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788891015.292364:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788891015.292415:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997367552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891015.292424:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788891015.292487:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8382df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997367552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788891015.292512:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788891015.292518:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997367680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788891015.292568:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891015.293434:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997367680 00000100:00100000:3.0:1788891015.293444:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997367680 00000100:00100000:3.0:1788891015.293505:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788891015.293516:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997367680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788891015.293563:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788891015.293640:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997367680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891015.293648:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788891015.293917:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997367680:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788891016.123657:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891016.827832:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788891016.827857:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997367808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788891016.827931:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788891016.828009:0:8593:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 239072484386ns, next at 240072481229ns, rc = 0 00000100:00100000:3.0:1788891016.828011:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8382d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997367936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788891016.828166:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997367808 00000100:00100000:2.0:1788891016.828174:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997367808 00000100:00100000:2.0:1788891016.828222:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788891016.828232:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997367808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788891016.828279:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788891016.828340:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997367808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891016.828347:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788891016.829400:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891016.829472:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997367808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788891016.830188:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788891016.830201:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf7f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997368064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788891016.830235:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891016.830402:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997367936 00000100:00100000:3.0:1788891016.830409:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997367936 00000100:00100000:3.0:1788891016.830453:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997368064 00000100:00100000:3.0:1788891016.830456:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997368064 00000100:00100000:3.0:1788891016.830472:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788891016.830480:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3630:x1875787997367936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788891016.830505:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788891016.830564:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3630:x1875787997367936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891016.830571:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788891016.830586:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788891016.830601:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997368064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788891016.830611:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788891016.830641:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997368064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891016.830647:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788891016.830685:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf7f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997368064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788891016.830727:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8382d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997367936:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788891016.830897:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788891017.147733:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891017.455106:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891017.455204:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987878144 00000100:00100000:2.0:1788891017.455224:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987878144 00000100:00100000:2.0:1788891017.455338:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 146 00000100:00100000:2.0:1788891017.455350:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+27:11047:x1875787987878144:12345-192.168.204.26@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788891017.455467:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+27:11047:x1875787987878144:12345-192.168.204.26@tcp:60:lhsmtool_posix.0 Request processed in 120us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891017.455476:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 146 00000100:00080000:0.0:1788891017.455618:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891017.459203:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891017.459320:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987878272 00000100:00100000:0.0:1788891017.459331:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987878272 00000100:00100000:0.0:1788891017.459421:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 147 00000100:00100000:0.0:1788891017.459432:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+5:11047:x1875787987878272:12345-192.168.204.26@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788891017.459599:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+5:11047:x1875787987878272:12345-192.168.204.26@tcp:60:lhsmtool_posix.0 Request processed in 168us (405us total) trans 0 rc 0/0 00000100:00080000:1.0:1788891017.460157:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788891017.460359:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 147 00000100:00100000:2.0:1788891017.465749:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891017.466141:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987878528 00000100:00100000:1.0:1788891017.466152:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987878528 00000100:00100000:1.0:1788891017.467778:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:1.0:1788891017.467798:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+27:11047:x1875787987878528:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788891017.468083:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+28:11047:x1875787987878528:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 294us (2343us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788891017.468092:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 35 00000001:00080000:2.0:1788891017.470790:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000004:00080000:2.0:1788891017.470807:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00010000:00010000:1.0:1788891017.471052:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53643 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891017.471065:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53643 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891017.471073:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53643 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891017.471080:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ec600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891017.471097:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53643 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891017.471104:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53643 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891017.471122:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9250905a3d00) 00010000:00010000:1.0:1788891017.471125:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891017.471130:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53643 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891017.471137:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53643 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891017.471289:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997368192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788891017.471367:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788891017.471691:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9250830a9f00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788891017.471696:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff925088efd700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9250830a9600 00000020:00080000:2.0:1788891017.471707:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff925088efd800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff925083e9a800 00000020:00080000:2.0:1788891017.471724:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788891017.471736:0:6527:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788891017.471806:0:6527:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1788891017.471833:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997368192 00000100:00100000:2.0:1788891017.471841:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997368192 00000100:00100000:2.0:1788891017.471887:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788891017.471898:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3628:x1875787997368192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788891017.472012:0:11803:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788891017.472016:0:11803:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788891010 -> 1788891010 00002000:00010000:2.0:1788891017.472019:0:11803:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1788891010 -> 1788891010 00002000:00010000:2.0:1788891017.472021:0:11803:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788891010 -> 1788891010 00002000:00010000:2.0:1788891017.472023:0:11803:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788891017.472814:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3628:x1875787997368192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 915us (1444us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788891017.472823:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1788891017.480582:0:3628:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff924f8318ca80/2, rc 0, transno 4294967313 00000100:00100000:1.0:1788891017.480597:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997368192:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1788891017.481706:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1788891017.481719:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:2.0:1788891017.643931:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891017.644001:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987878656 00000100:00100000:3.0:1788891017.644011:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987878656 00000100:00100000:3.0:1788891017.644111:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 148 00000100:00100000:3.0:1788891017.644122:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:11851:x1875787987878656:12345-192.168.204.26@tcp:101:lsof.0 00010000:00010000:3.0:1788891017.644140:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891017.644168:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd536cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddfcc expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891017.644230:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd536d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891017.644244:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd536d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891017.644255:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd536d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891017.644298:0:14295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788891017.644312:0:14295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891017.644349:0:14295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd536d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891017.644373:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd536cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfcc expref: 7 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891017.644392:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd536d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfcc expref: 6 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891017.644400:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925095f80e00) 00010000:00010000:3.0:1788891017.644403:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788891017.644406:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8a600, rc 0) 00000100:00100000:3.0:1788891017.644467:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:11851:x1875787987878656:12345-192.168.204.26@tcp:101:lsof.0 Request processed in 347us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891017.644474:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 148 00000100:00080000:1.0:1788891017.644564:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891017.851802:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788891017.851826:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997368320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788891017.851914:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891017.852051:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997368320 00000100:00100000:0.0:1788891017.852060:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997368320 00000100:00100000:0.0:1788891017.852116:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788891017.852126:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997368320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788891017.852159:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788891017.852217:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997368320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891017.852225:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788891017.852307:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997368320:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788891018.171879:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891018.709467:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891018.709588:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987878784 00000100:00100000:3.0:1788891018.709599:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891018.709604:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987878784 00000100:00100000:2.0:1788891018.709680:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 363 00000100:00100000:2.0:1788891018.709691:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2393:x1875787987878784:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788891018.709789:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2393:x1875787987878784:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 99us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891018.709798:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 363 00000100:00100000:3.0:1788891018.711271:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891018.711308:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891018.711362:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987879296 00000100:00100000:2.0:1788891018.711373:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987879296 00000100:00100000:2.0:1788891018.711502:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 106 00000100:00100000:2.0:1788891018.711510:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b6b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987879296:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788891018.711589:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b6b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987879296:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 80us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891018.711596:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 106 00000100:00100000:0.0:1788891018.712124:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987879040 00000100:00100000:0.0:1788891018.712131:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987879040 00000100:00100000:0.0:1788891018.712173:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 207 00000100:00100000:0.0:1788891018.712181:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987879040:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891018.712221:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987879040:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 41us (2625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891018.712227:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 207 00000100:00100000:3.0:1788891018.714135:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00080000:1.0:1788891018.714560:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788891018.717397:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987879552 00000100:00100000:2.0:1788891018.717423:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987879552 00000100:00080000:1.0:1788891018.717782:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788891018.718363:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891018.718464:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987878912 00000100:00100000:0.0:1788891018.718474:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987878912 00000100:00100000:3.0:1788891018.718614:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891018.718703:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987879424 00000100:00100000:3.0:1788891018.718708:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987879424 00000100:00100000:3.0:1788891018.718753:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 208 00000100:00100000:3.0:1788891018.718765:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2393:x1875787987879552:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891018.718802:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 209 00000100:00100000:0.0:1788891018.718813:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:2393:x1875787987879424:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891018.718873:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2393:x1875787987879552:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 110us (7563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891018.718883:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 208 00000100:00100000:0.0:1788891018.718912:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:2393:x1875787987879424:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 100us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891018.718921:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 210 00000100:00100000:3.0:1788891018.718935:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+13:2393:x1875787987878912:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891018.718961:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 209 00000100:00100000:3.0:1788891018.718972:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+13:2393:x1875787987878912:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 37us (4849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891018.718980:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 210 00000100:00100000:1.0:1788891018.719518:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987879168 00000100:00100000:1.0:1788891018.719610:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987879168 00000100:00100000:1.0:1788891018.719817:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 107 00000100:00100000:1.0:1788891018.719826:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:2393:x1875787987879168:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788891018.719890:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:2393:x1875787987879168:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 65us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891018.719897:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 107 00000100:00080000:0.0:1788891018.720083:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788891019.195651:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788891019.651166:0:14479:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:10:18 (1788891018) 00000100:00100000:0.0:1788891019.900217:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997368576:0@lo:400:kworker.0 00000100:00100000:1.0:1788891019.900236:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997368832:0@lo:400:kworker.0 00000100:00100000:2.0:1788891019.900317:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997368448:0@lo:400:kworker.0 00000100:00100000:1.0:1788891019.900518:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891019.900615:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997369344:0@lo:400:kworker.0 00000100:00100000:1.0:1788891019.900644:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891019.900666:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997369856:0@lo:400:kworker.0 00000100:00100000:1.0:1788891019.900688:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891019.900730:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997368704:0@lo:400:kworker.0 00000100:00100000:2.0:1788891019.900963:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891019.901002:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891019.901013:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997368960:0@lo:400:kworker.0 00000100:00100000:0.0:1788891019.901033:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997369088:0@lo:400:kworker.0 00000100:00100000:0.0:1788891019.901060:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891019.901076:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997369600:0@lo:400:kworker.0 00000100:00100000:0.0:1788891019.901107:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891019.901120:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891019.901150:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997368832 00000100:00100000:0.0:1788891019.901158:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997368832 00000100:00100000:0.0:1788891019.901199:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997368576 00000100:00100000:0.0:1788891019.901202:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997368576 00000100:00100000:2.0:1788891019.901219:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997369472:0@lo:400:kworker.0 00000100:00100000:0.0:1788891019.901225:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997369088 00000100:00100000:0.0:1788891019.901228:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997369088 00000100:00100000:2.0:1788891019.901251:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891019.901255:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997369600 00000100:00100000:0.0:1788891019.901259:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997369600 00000100:00100000:2.0:1788891019.901277:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997369984:0@lo:400:kworker.0 00000100:00100000:0.0:1788891019.901292:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788891019.901306:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997368832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891019.901307:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891019.901348:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997368448 00000100:00100000:2.0:1788891019.901354:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997368448 00000100:00100000:0.0:1788891019.901368:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997368832:12345-0@lo:400:kworker.0 Request processed in 66us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891019.901376:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788891019.901390:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788891019.901398:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788891019.901402:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3630:x1875787997368448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891019.901410:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997368576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891019.901458:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3630:x1875787997368448:12345-0@lo:400:kworker.0 Request processed in 59us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891019.901460:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997368576:12345-0@lo:400:kworker.0 Request processed in 52us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891019.901466:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788891019.901476:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788891019.901482:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997369088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891019.901509:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997369088:12345-0@lo:400:kworker.0 Request processed in 27us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891019.901544:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788891019.901553:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788891019.901567:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997369600:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788891019.901570:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788891019.901600:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997368576:0@lo:400:kworker.0 00000100:00100000:0.0:1788891019.901616:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997369088:0@lo:400:kworker.0 00000100:00100000:3.0:1788891019.901621:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997369600:12345-0@lo:400:kworker.0 Request processed in 55us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891019.901629:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997369600:0@lo:400:kworker.0 00000100:00100000:3.0:1788891019.901632:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788891019.901690:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997369344 00000100:00100000:3.0:1788891019.901694:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997369344 00000100:00100000:3.0:1788891019.901732:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997369856 00000100:00100000:3.0:1788891019.901736:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997369856 00000100:00100000:3.0:1788891019.901762:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997369472 00000100:00100000:3.0:1788891019.901766:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997369472 00000100:00100000:3.0:1788891019.901779:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997369984 00000100:00100000:3.0:1788891019.901781:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997369984 00000100:00100000:3.0:1788891019.901794:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788891019.901800:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997369344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891019.901845:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997369344:12345-0@lo:400:kworker.0 Request processed in 44us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891019.901852:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788891019.901865:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788891019.901871:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997369856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891019.902227:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788891019.902283:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997368448:0@lo:400:kworker.0 00000100:00100000:2.0:1788891019.902315:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997368960 00000100:00100000:2.0:1788891019.902319:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997368960 00000100:00080000:0.0:1788891019.902323:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788891019.902331:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788891019.902373:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891019.902379:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788891019.902389:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997368960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891019.902405:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997369216:0@lo:400:kworker.0 00000100:00100000:2.0:1788891019.902440:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997368960:12345-0@lo:400:kworker.0 Request processed in 52us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891019.902445:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891019.902454:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788891019.902474:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1875787997369728:0@lo:400:kworker.0 00000100:00100000:0.0:1788891019.902481:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997368704 00000100:00100000:0.0:1788891019.902487:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997368704 00000100:00100000:1.0:1788891019.902503:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891019.902513:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788891019.902540:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997368704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891019.902562:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788891019.902574:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997369472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891019.902590:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997368704:12345-0@lo:400:kworker.0 Request processed in 68us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891019.902598:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788891019.902605:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997369216 00000100:00100000:2.0:1788891019.902612:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997369216 00000100:00100000:1.0:1788891019.902619:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997369472:12345-0@lo:400:kworker.0 Request processed in 48us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891019.902624:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997369728 00000100:00100000:1.0:1788891019.902628:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788891019.902630:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997369728 00000100:00100000:1.0:1788891019.902649:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788891019.902661:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997369984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891019.902662:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788891019.902672:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788891019.902678:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875787997369216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891019.902687:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875787997369728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891019.902705:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997369984:12345-0@lo:400:kworker.0 Request processed in 46us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891019.902712:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788891019.902740:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875787997369216:12345-0@lo:400:kworker.0 Request processed in 66us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891019.902742:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875787997369728:12345-0@lo:400:kworker.0 Request processed in 59us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891019.902754:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788891019.902771:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:2.0:1788891019.902775:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788891019.902800:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997368960:0@lo:400:kworker.0 00000100:00100000:2.0:1788891019.902811:0:3630:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1788891019.902817:0:3630:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff924f83840380, transno 4294967310 00000004:00080000:2.0:1788891019.902829:0:3630:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967313 00000004:00080000:2.0:1788891019.902849:0:3630:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff924f8318ca80, transno 4294967313 00000100:00100000:2.0:1788891019.902853:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997369472:0@lo:400:kworker.0 00000100:00100000:2.0:1788891019.902865:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997369984:0@lo:400:kworker.0 00000100:00100000:3.0:1788891019.903945:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997369856:12345-0@lo:400:kworker.0 Request processed in 2067us (3249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891019.903955:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788891019.904408:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997368832:0@lo:400:kworker.0 00000100:00100000:1.0:1788891019.904435:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997369344:0@lo:400:kworker.0 00000100:00100000:1.0:1788891019.904473:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997369856:0@lo:400:kworker.0 00000100:00100000:1.0:1788891019.904519:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997368704:0@lo:400:kworker.0 00010000:00080000:1.0:1788891019.905130:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83a67800 x1875787997369216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891019.905209:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997369216:0@lo:400:kworker.0 00010000:00080000:1.0:1788891019.905226:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83a64e00 x1875787997369728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891019.905233:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1875787997369728:0@lo:400:kworker.0 00010000:00010000:3.0:1788891020.219788:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891020.412428:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788891020.412455:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997370112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788891020.412611:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891020.412731:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf7fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997370240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788891020.412756:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891020.413035:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997370112 00000100:00100000:1.0:1788891020.413045:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997370112 00000100:00100000:1.0:1788891020.413096:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997370240 00000100:00100000:1.0:1788891020.413099:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997370240 00000100:00100000:1.0:1788891020.413116:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788891020.413124:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997370112:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788891020.413223:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788891020.413231:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997370240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788891020.413259:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788891020.413317:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997370112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 193us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891020.413323:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00002000:00000024:3.0:1788891020.413478:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788891020.413509:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997370240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 280us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891020.413516:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788891020.414710:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf7fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997370240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788891020.414731:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997370112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788891020.515595:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891020.515793:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987879808 00000100:00100000:0.0:1788891020.515806:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987879808 00000100:00100000:0.0:1788891020.515907:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 149 00000100:00100000:0.0:1788891020.515919:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+13:12118:x1875787987879808:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788891020.515978:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891020.516004:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd536dd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddfd3 expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516099:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd536e4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516118:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd536e4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516133:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd536e4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516164:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd536eb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516171:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd536eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516178:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd536eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516306:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd536f2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516316:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd536f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516324:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd536f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891020.516336:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788891020.516452:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd536e4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516461:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd536e4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516468:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd536e4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516474:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891020.516478:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd536e4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516487:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd536e4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516501:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9250b65fcc00) 00010000:00010000:0.0:1788891020.516505:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891020.516511:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd536e4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516517:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd536e4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516588:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd536eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516594:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd536eb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516600:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd536eb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516617:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891020.516620:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd536eb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516626:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd536eb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516636:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9250c130b200) 00010000:00010000:0.0:1788891020.516639:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891020.516642:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd536eb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.516648:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd536eb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788891020.517434:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788891020.518761:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd536dd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfd3 expref: 16 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.518810:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd536f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfd3 expref: 15 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891020.518821:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9250905a3b00) 00010000:00010000:0.0:1788891020.518824:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891020.518828:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5000, rc 0) 00000100:00100000:0.0:1788891020.518920:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+15:12118:x1875787987879808:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 3001us (3396us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788891020.518930:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 149 00000100:00100000:2.0:1788891020.523655:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891020.523784:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891020.523977:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987879936 00000100:00100000:1.0:1788891020.523992:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987879936 00000100:00100000:1.0:1788891020.524086:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:1.0:1788891020.524099:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+15:2391:x1875787987879936:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891020.524122:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891020.524155:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd536f2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfd3 expref: 15 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891020.524186:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9250905a3b00) 00010000:00010000:1.0:1788891020.524192:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891020.524267:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+14:2391:x1875787987879936:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 171us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891020.524275:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:3.0:1788891020.524569:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987880064 00000100:00100000:3.0:1788891020.524575:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987880064 00000100:00100000:3.0:1788891020.524617:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 150 00000100:00100000:3.0:1788891020.524626:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+14:12118:x1875787987880064:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788891020.524730:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+14:12118:x1875787987880064:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 Request processed in 104us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891020.524738:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 150 00000100:00100000:2.0:1788891020.531503:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891020.531618:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987880192 00000100:00100000:0.0:1788891020.531649:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987880192 00000100:00080000:2.0:1788891020.531728:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788891020.531746:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 151 00000100:00100000:0.0:1788891020.531758:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+5:12118:x1875787987880192:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788891020.531904:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+5:12118:x1875787987880192:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 Request processed in 148us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891020.531914:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 151 00000040:00080000:3.0:1788891020.989495:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788891021.243669:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788891021.435714:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788891021.435725:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788891021.436314:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788891021.436325:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788891021.819820:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891021.819964:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987880320 00000100:00100000:3.0:1788891021.819974:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987880320 00000100:00100000:3.0:1788891021.820038:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 152 00000100:00100000:3.0:1788891021.820048:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+14:12160:x1875787987880320:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891021.820066:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891021.820087:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53700 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddfda expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820166:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53707 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820180:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53707 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820193:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53707 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820208:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5370e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820216:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5370e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820222:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5370e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820281:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53707 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820288:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53707 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820295:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53707 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820301:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ec600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891021.820305:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53707 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820313:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53707 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820325:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925095f80e00) 00010000:00010000:3.0:1788891021.820328:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891021.820332:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53707 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820338:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd53707 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820352:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5370e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820359:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5370e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820364:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5370e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820375:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ede00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891021.820378:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5370e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820384:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5370e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820393:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff925082bfc400) 00010000:00010000:3.0:1788891021.820395:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891021.820397:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5370e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820404:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5370e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820439:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53700 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfda expref: 15 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820448:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925095f80e00) 00010000:00010000:3.0:1788891021.820451:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891021.820455:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53700 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfda expref: 15 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.820465:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8ac00, rc 0) 00000100:00100000:3.0:1788891021.820556:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+14:12160:x1875787987880320:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 509us (745us total) trans 0 rc 301/301 00000100:00100000:3.0:1788891021.820564:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 152 00000100:00100000:3.0:1788891021.826595:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891021.826787:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987880576 00000100:00100000:2.0:1788891021.826797:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987880576 00000100:00100000:3.0:1788891021.826983:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 153 00000100:00100000:3.0:1788891021.826995:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+14:12160:x1875787987880576:12345-192.168.204.26@tcp:36:lfs.0 00010000:00010000:3.0:1788891021.827058:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891021.827098:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6600/0xa66601b03fd53054 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddfe expref: 14 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.827115:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925095f80e00) 00010000:00010000:3.0:1788891021.827130:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788891021.827382:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53715 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.827400:0:14295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd536d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfcc expref: 5 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.827409:0:14295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53715 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.827446:0:14295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd536d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfcc expref: 5 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.827462:0:14295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd536d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfcc expref: 5 pid: 14295 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891021.827482:0:14295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a64380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14295:1875787997370368:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788891021.827688:0:14295:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090028840 going to sleep for 11 seconds 00000100:00100000:3.0:1788891021.834477:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891021.834587:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987880704 00000100:00100000:2.0:1788891021.834590:0:14295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a64380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14295:1875787997370368:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891021.834600:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987880704 00010000:00010000:0.0:1788891021.834660:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd536d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfcc expref: 6 pid: 14295 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891021.834699:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 81 00000100:00100000:0.0:1788891021.834711:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:2391:x1875787987880704:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891021.834729:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891021.834731:0:14295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53715 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891021.834741:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd536d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfcc expref: 6 pid: 14295 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891021.834760:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd536d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfcc expref: 6 pid: 14295 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891021.834798:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd536d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfcc expref: 6 pid: 14295 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891021.834816:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925095f80e00) 00010000:00010000:0.0:1788891021.834821:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53715 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891021.834837:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53715 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891021.834845:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53715 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788891021.834874:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788891021.834877:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891021.834936:0:14295:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53715 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891021.834960:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2391:x1875787987880704:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 246us (488us total) trans 0 rc 0/0 00010000:00010000:2.0:1788891021.834965:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53715 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891021.834979:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 81 00010000:00010000:2.0:1788891021.835015:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5371c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.835032:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5371c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.835042:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5371c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.836158:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53723 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.836174:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.836197:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788891021.836219:0:14295:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011265e42 reply state 00000000855690d8 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.836234:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53723 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.836241:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:2.0:1788891021.836244:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788891021.836249:0:14295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788891021.836258:0:14295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788891021.836268:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53715 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.836275:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53715 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.836283:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53715 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.836290:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891021.836297:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53715 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.836307:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53715 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.836321:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925095f80e00) 00010000:00010000:2.0:1788891021.836324:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891021.836335:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53715 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.836342:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53715 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788891021.836365:0:14295:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011265e42 reply state 00000000855690d8 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5371c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.836375:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5371c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.836382:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff924f82e36900) 00010000:00010000:2.0:1788891021.836385:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788891021.836388:0:14295:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788891021.836773:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+15:12160:x1875787987880576:12345-192.168.204.26@tcp:36:lfs.0 Request processed in 9776us (10183us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788891021.836784:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 153 00000100:00100000:3.0:1788891021.910626:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891021.910762:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987880832 00000100:00100000:1.0:1788891021.910773:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987880832 00000100:00100000:1.0:1788891021.910839:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 154 00000100:00100000:1.0:1788891021.910849:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+15:12168:x1875787987880832:12345-192.168.204.26@tcp:101:lctl.0 00010000:00010000:1.0:1788891021.910874:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891021.910898:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dea00/0xa66601b03fd5372a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddfe1 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891021.910974:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd53731 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891021.910987:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd53731 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891021.911000:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd53731 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891021.911052:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788891021.911056:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788891021.911075:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd53731 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891021.911099:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dea00/0xa66601b03fd5372a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfe1 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891021.911128:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd53731 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfe1 expref: 16 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891021.911136:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250b65fd200) 00010000:00010000:1.0:1788891021.911139:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788891021.911142:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857dfc00, rc 0) 00000100:00100000:1.0:1788891021.911213:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+16:12168:x1875787987880832:12345-192.168.204.26@tcp:101:lctl.0 Request processed in 365us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891021.911221:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 154 00000100:00100000:0.0:1788891021.941984:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891021.942084:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987880960 00000100:00100000:2.0:1788891021.942095:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987880960 00000100:00100000:2.0:1788891021.942158:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 155 00000100:00100000:2.0:1788891021.942178:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+16:12174:x1875787987880960:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788891021.942199:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891021.942220:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53738 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddfe8 expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.942297:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5373f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.942312:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5373f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.942344:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5373f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.942510:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53746 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.942552:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.942561:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.942712:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031800/0xa66601b03fd5374d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.942723:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080031800/0xa66601b03fd5374d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.942731:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080031800/0xa66601b03fd5374d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891021.942766:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788891021.942770:0:12407:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891021.942790:0:12407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925080031800/0xa66601b03fd5374d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.942802:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5373f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.942808:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5373f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.942814:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5373f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.942820:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891021.942824:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5373f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.942832:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5373f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.942844:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250b65fd200) 00010000:00010000:3.0:1788891021.942847:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891021.942853:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5373f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.942867:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd5373f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.942950:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.942959:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53746 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.942965:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53746 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.942971:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891021.942975:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53746 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.942980:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53746 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.942989:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff924f82e36900) 00010000:00010000:3.0:1788891021.942992:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891021.942996:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53746 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.943002:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53746 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.943031:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53738 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfe8 expref: 18 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.943056:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031800/0xa66601b03fd5374d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfe8 expref: 17 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891021.943064:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:3.0:1788891021.943066:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788891021.943068:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080031800, rc 0) 00000100:00100000:3.0:1788891021.943144:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+17:12174:x1875787987880960:12345-192.168.204.26@tcp:101:bash.0 Request processed in 977us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891021.943153:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 155 00000100:00100000:3.0:1788891021.945438:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891021.945642:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987881216 00000100:00100000:2.0:1788891021.945652:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987881216 00000100:00100000:2.0:1788891021.945703:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 156 00000100:00100000:2.0:1788891021.945725:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+17:12174:x1875787987881216:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788891021.945745:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891021.945762:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd53754 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddfef expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.945852:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd5375b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.945864:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd5375b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.945872:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd5375b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.945947:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53762 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.945970:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53762 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.945977:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53762 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788891021.946361:0:6497:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788891021.946489:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53769 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.946511:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.946519:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.946575:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd5375b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.946582:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd5375b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.946588:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd5375b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.946593:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891021.946597:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd5375b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.946604:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd5375b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.946629:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:2.0:1788891021.946632:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891021.946638:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd5375b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.946644:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd5375b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788891021.946658:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b49faff reply state 00000000719159af transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53762 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.946670:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53762 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.946676:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff924f82e36400) 00010000:00010000:2.0:1788891021.946678:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788891021.946681:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788891021.946711:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd53754 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfef expref: 20 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.946725:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53769 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfef expref: 19 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.946732:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff924f82e36300) 00010000:00010000:2.0:1788891021.946735:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891021.946737:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310000, rc 0) 00000100:00100000:2.0:1788891021.946809:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+20:12174:x1875787987881216:12345-192.168.204.26@tcp:101:bash.0 Request processed in 1097us (1379us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1788891021.946816:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 156 00000100:00100000:2.0:1788891021.947841:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788891021.947860:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997370752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788891021.947921:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891021.947922:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997370496:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788891021.947967:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891021.947996:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250baa2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997370624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788891021.948022:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891021.948051:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997370752 00000100:00100000:2.0:1788891021.948054:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997370496 00000100:00100000:2.0:1788891021.948059:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997370496 00000100:00100000:3.0:1788891021.948060:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997370752 00000100:00100000:2.0:1788891021.948090:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997370624 00000100:00100000:3.0:1788891021.948093:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788891021.948093:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997370624 00000100:00100000:2.0:1788891021.948107:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788891021.948113:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997370496:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788891021.948119:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997370752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788891021.948139:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00002000:00000024:2.0:1788891021.948139:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788891021.948238:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997370752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891021.948246:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788891021.948276:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788891021.948284:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997370624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788891021.948294:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788891021.948320:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997370624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891021.948327:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1788891021.948345:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891021.948585:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997370752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788891021.948601:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250baa2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997370624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788891021.949565:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997370496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788891021.949661:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997370496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1547us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891021.949669:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788891021.950283:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891021.950356:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987881344 00000100:00100000:1.0:1788891021.950363:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987881344 00000100:00100000:1.0:1788891021.950455:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00100000:1.0:1788891021.950463:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df03475d-d91a-4e91-8125-742ac4d4c589+5:2391:x1875787987881344:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1788891021.950477:0:11803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891021.950499:0:11803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd53777 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddff6 expref: -99 pid: 11803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788891021.950561:0:11803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788891021.950580:0:11803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=244s v=(0 0) 00010000:00010000:1.0:1788891021.950585:0:11803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891021.950594:0:11803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd53777 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddff6 expref: 6 pid: 11803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891021.950630:0:11803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd53777 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddff6 expref: 6 pid: 11803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891021.950644:0:11803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857dea00, rc 0) 00000100:00100000:1.0:1788891021.950694:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df03475d-d91a-4e91-8125-742ac4d4c589+6:2391:x1875787987881344:12345-192.168.204.26@tcp:101:bash.0 Request processed in 232us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891021.950701:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00080000:3.0:1788891021.951110:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788891021.957821:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891021.958400:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987881472 00000100:00100000:1.0:1788891021.958411:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987881472 00000100:00100000:1.0:1788891021.958571:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 56 00000100:00100000:1.0:1788891021.958583:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:12174:x1875787987881472:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1788891021.958600:0:8596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891021.958619:0:8596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd5377e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204ddffd expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891021.958651:0:8596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd53777 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddff6 expref: 7 pid: 11803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891021.958660:0:8596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891021.958664:0:8596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891021.958670:0:8596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd5377e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddffd expref: 7 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891021.958704:0:8596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd53777 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddff6 expref: 7 pid: 11803 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891021.958744:0:8596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd53777 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddff6 expref: 7 pid: 11803 timeout: 344 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891021.958760:0:8596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83addc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8596:1875787997370880:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891021.958860:0:8596:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f821d7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788891021.961259:0:8596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83addc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8596:1875787997370880:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891021.961294:0:8596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd5377e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddffd expref: 7 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.961958:0:8596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857dfe00, rc 0) 00000100:00100000:2.0:1788891021.962016:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+7:12174:x1875787987881472:12345-192.168.204.26@tcp:101:bash.0 Request processed in 3435us (4204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891021.962024:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 56 00000100:00100000:3.0:1788891021.970461:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891021.970728:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987881600 00000100:00100000:2.0:1788891021.970743:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987881600 00010000:00010000:2.0:1788891021.970800:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd53777 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddff6 expref: 7 pid: 11803 timeout: 344 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891021.970881:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 82 00000100:00100000:2.0:1788891021.970895:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+7:2394:x1875787987881600:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891021.970919:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891021.970961:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd53777 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddff6 expref: 7 pid: 11803 timeout: 344 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.970979:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd53777 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddff6 expref: 7 pid: 11803 timeout: 344 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.971822:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd53777 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddff6 expref: 7 pid: 11803 timeout: 344 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.971843:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891021.971848:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891021.971858:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd5377e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddffd expref: 6 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.971868:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd5377e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddffd expref: 6 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891021.971912:0:6483:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd5377e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddffd expref: 6 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891021.971927:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6483:1875787997371008:192.168.204.26@tcp:105: 00000100:00100000:2.0:1788891021.972117:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788891021.978301:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6483:1875787997371008:192.168.204.26@tcp:105: 00010000:00010000:2.0:1788891021.978331:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891021.978399:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+6:2394:x1875787987881600:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 7506us (7955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891021.978412:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 82 00000100:00100000:3.0:1788891021.979645:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891021.979861:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987881856 00000100:00100000:0.0:1788891021.979869:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987881856 00000100:00100000:1.0:1788891021.980302:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:1.0:1788891021.980315:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+20:12174:x1875787987881856:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:1.0:1788891021.980995:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+21:12174:x1875787987881856:12345-192.168.204.26@tcp:35:bash.0 Request processed in 680us (1353us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788891021.981003:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:1.0:1788891022.040263:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891022.040451:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987882112 00000100:00100000:0.0:1788891022.040461:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987882112 00000100:00100000:0.0:1788891022.040605:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 157 00000100:00100000:0.0:1788891022.040617:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+21:12184:x1875787987882112:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891022.040642:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891022.040663:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53785 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de004 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891022.040763:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788891022.040871:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53785 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de004 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.040905:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250b65fd200) 00010000:00010000:0.0:1788891022.040907:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788891022.040913:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53785 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de004 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.040927:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5200, rc 0) 00000100:00100000:0.0:1788891022.041094:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+22:12184:x1875787987882112:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 479us (841us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1788891022.041102:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 157 00000100:00080000:3.0:1788891022.041377:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788891022.046967:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891022.047050:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987882368 00000100:00100000:1.0:1788891022.047061:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987882368 00000100:00100000:1.0:1788891022.047124:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:1.0:1788891022.047136:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+22:12184:x1875787987882368:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:1.0:1788891022.047383:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+23:12184:x1875787987882368:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 250us (427us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788891022.047392:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:2.0:1788891022.101377:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891022.101647:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987882496 00000100:00100000:0.0:1788891022.101658:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987882496 00000100:00100000:0.0:1788891022.105545:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 158 00000100:00100000:0.0:1788891022.105572:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+23:12190:x1875787987882496:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891022.105597:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891022.105617:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53793 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de00b expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.105686:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5379a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.105714:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5379a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.105727:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5379a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891022.105791:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788891022.105796:0:9362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788891022.105814:0:9362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5379a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.105841:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd53793 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de00b expref: 25 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.105861:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5379a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de00b expref: 24 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.105870:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:0.0:1788891022.105873:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788891022.105876:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5600, rc 0) 00000100:00100000:0.0:1788891022.105955:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+24:12190:x1875787987882496:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 397us (4589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891022.105963:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 158 00000100:00100000:3.0:1788891022.109976:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891022.110056:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987882752 00000100:00100000:2.0:1788891022.110072:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987882752 00000100:00100000:2.0:1788891022.110147:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 159 00000100:00100000:2.0:1788891022.110157:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+24:12190:x1875787987882752:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788891022.110180:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891022.110203:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd537a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de012 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.110316:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd537a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.110331:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd537a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.110343:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd537a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891022.110354:0:14295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788891022.110463:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd537a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de012 expref: 27 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.110481:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd537a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de012 expref: 26 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.110502:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff924f82e36300) 00010000:00010000:2.0:1788891022.110505:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891022.110508:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310a00, rc 0) 00000100:00100000:2.0:1788891022.110620:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+26:12190:x1875787987882752:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 464us (660us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1788891022.110628:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 159 00000100:00100000:2.0:1788891022.114005:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891022.114060:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891022.114142:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987883136 00000100:00100000:0.0:1788891022.114153:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987883136 00000100:00100000:0.0:1788891022.114220:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 160 00000100:00100000:0.0:1788891022.114230:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+26:12190:x1875787987883136:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891022.114255:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891022.114275:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd537b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de019 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.114385:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd537bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.114431:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd537bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.114445:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd537bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891022.114461:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788891022.114608:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd537b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de019 expref: 29 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.114626:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd537bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de019 expref: 28 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.114635:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff924f82e36300) 00010000:00010000:0.0:1788891022.114637:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788891022.114642:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4400, rc 0) 00000100:00100000:0.0:1788891022.114715:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+28:12190:x1875787987883136:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 486us (653us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1788891022.114724:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 160 00000100:00100000:1.0:1788891022.115957:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987882880 00000100:00100000:1.0:1788891022.115968:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987882880 00000100:00100000:1.0:1788891022.116033:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:1.0:1788891022.116042:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+28:2392:x1875787987882880:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891022.116056:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891022.116087:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd537a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de012 expref: 28 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891022.116105:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff924f82e36300) 00010000:00010000:1.0:1788891022.116109:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891022.116150:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+27:2392:x1875787987882880:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 109us (2156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891022.116157:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:3.0:1788891022.125459:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891022.125591:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987883264 00000100:00100000:2.0:1788891022.125609:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987883264 00000100:00100000:2.0:1788891022.125683:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 57 00000100:00100000:2.0:1788891022.125695:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+6:2391:x1875787987883264:12345-192.168.204.26@tcp:1:lfs.0 00010000:00010000:2.0:1788891022.125742:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd537cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.125764:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd5377e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddffd expref: 6 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.125774:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891022.125778:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788891022.125783:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd537cb lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.125822:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd5377e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddffd expref: 6 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.125859:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd5377e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddffd expref: 6 pid: 8596 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891022.125875:0:8411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf793480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8411:1875787997371136:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891022.125999:0:8411:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788891022.127882:0:8411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf793480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8411:1875787997371136:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891022.127944:0:8411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd537cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891022.128947:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891022.129070:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987883392 00000100:00100000:1.0:1788891022.129081:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987883392 00002000:00100000:1.0:1788891022.129155:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff924f83a67480 x1875787987883392/t0(0) o4->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:73/0 lens 504/0 e 0 to 0 dl 1788891033 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788891022.129167:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f83a67480 with x1875787987883392 ext(0->12) 00010000:00010000:1.0:1788891022.129179:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd5377e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddffd expref: 7 pid: 8596 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891022.129203:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd5377e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddffd expref: 7 pid: 8596 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788891022.129211:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff924f83a67480 00000100:00100000:1.0:1788891022.129255:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:1.0:1788891022.129268:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df03475d-d91a-4e91-8125-742ac4d4c589+7:2394:x1875787987883392:12345-192.168.204.26@tcp:4:lfs.0 00000100:00100000:1.0:1788891022.132222:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df03475d-d91a-4e91-8125-742ac4d4c589+9:2394:x1875787987883392:12345-192.168.204.26@tcp:4:lfs.0 Request processed in 2937us (3271us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788891022.132241:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2 00002000:00100000:1.0:1788891022.132259:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff924f83a67480 x1875787987883392/t4294967306(0) o4->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:73/0 lens 504/448 e 0 to 0 dl 1788891033 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788891022.132292:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f83a67480 with x1875787987883392 ext(0->12) 00010000:00010000:1.0:1788891022.132322:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd5377e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddffd expref: 9 pid: 8596 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891022.132347:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd5377e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddffd expref: 9 pid: 8596 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788891022.132355:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff924f83a67480 00000100:00100000:3.0:1788891022.139086:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891022.139203:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987883520 00000100:00100000:0.0:1788891022.139217:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987883520 00010000:00010000:0.0:1788891022.139275:0:10317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd5377e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddffd expref: 9 pid: 8596 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891022.139443:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 83 00000100:00100000:0.0:1788891022.139457:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+9:2393:x1875787987883520:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891022.139485:0:10317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788891022.139572:0:10317:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788891022.139576:0:10317:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788891021 00002000:00010000:0.0:1788891022.139578:0:10317:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788891021 00002000:00010000:0.0:1788891022.139580:0:10317:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788891021 00002000:00010000:0.0:1788891022.139582:0:10317:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788891022.139589:0:10317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd5377e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddffd expref: 9 pid: 8596 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.139606:0:10317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd5377e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddffd expref: 9 pid: 8596 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.139648:0:10317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098cc590a/0xa66601b03fd5377e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddffd expref: 9 pid: 8596 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.139670:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788891022.139676:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788891022.139682:0:10317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd537cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.139694:0:10317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd537cb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.139730:0:10317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891022.139804:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+8:2393:x1875787987883520:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 348us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891022.139814:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 83 00010000:00010000:2.0:1788891022.139819:0:8411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd537cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.139841:0:8411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd537cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.139878:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd537cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.139887:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd537cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.139896:0:8411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd537cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.139929:0:8411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310400 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891022.139943:0:8411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd537cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.139953:0:8411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd537cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.139975:0:8411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd537cb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.139983:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd537cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891022.140127:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+7:2391:x1875787987883264:12345-192.168.204.26@tcp:1:lfs.0 Request processed in 14427us (14692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891022.140141:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 57 00000100:00100000:3.0:1788891022.144923:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891022.145395:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987883776 00000100:00100000:1.0:1788891022.145409:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987883776 00000100:00100000:1.0:1788891022.145551:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:1.0:1788891022.145565:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090479450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+27:12190:x1875787987883776:12345-192.168.204.26@tcp:35:lfs.0 00000004:00010000:1.0:1788891022.145680:0:6498:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd537bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de019 expref: 27 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788891022.146094:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788891022.146256:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788891022.146968:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1788891022.147091:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd537d2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891022.147182:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53769 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfef expref: 31 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891022.147194:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd537d2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891022.147268:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53769 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfef expref: 31 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891022.147286:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53769 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfef expref: 31 pid: 6497 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891022.147371:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83adea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6498:1875787997371264:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891022.147501:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f821d76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891022.153488:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83adea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6498:1875787997371264:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891022.155796:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd537d2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891022.156464:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891022.156608:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987883904 00000100:00100000:2.0:1788891022.156619:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987883904 00010000:00010000:2.0:1788891022.156671:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53769 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfef expref: 32 pid: 6497 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891022.156965:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 84 00000100:00100000:2.0:1788891022.156979:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83addf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+32:2393:x1875787987883904:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891022.157000:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891022.157009:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53769 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfef expref: 32 pid: 6497 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.157046:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53769 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfef expref: 32 pid: 6497 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.157076:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53769 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfef expref: 32 pid: 6497 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.157096:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff924f82e36300) 00010000:00010000:2.0:1788891022.157102:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd537d2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.157113:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd537d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.157122:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd537d2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.157207:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891022.157287:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83addf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+31:2393:x1875787987883904:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 310us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891022.157296:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 84 00010000:00010000:3.0:1788891022.157512:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd537d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.157542:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd537d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788891022.157703:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1788891022.158029:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1788891022.158149:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bab51180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6498:1875787997371392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788891022.158218:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891022.158318:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090028180 going to sleep for 11 seconds 00000100:00100000:1.0:1788891022.158975:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997371392 00000100:00100000:1.0:1788891022.158985:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997371392 00000100:00080000:3.0:1788891022.159052:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788891022.159063:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788891022.159080:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6498:x1875787997371392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788891022.159457:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6498:x1875787997371392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 379us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891022.159467:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788891022.159609:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bab51180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6498:1875787997371392:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788891022.159778:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1788891022.159868:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839cd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6498:1875787997371520:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788891022.159909:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891022.159971:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090028480 going to sleep for 11 seconds 00000100:00100000:2.0:1788891022.160057:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997371520 00000100:00100000:2.0:1788891022.160064:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997371520 00000100:00100000:2.0:1788891022.160096:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788891022.160103:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6498:x1875787997371520:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788891022.160247:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6498:x1875787997371520:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 144us (337us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788891022.160254:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788891022.160719:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839cd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6498:1875787997371520:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788891022.160784:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1788891022.160830:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd537d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.160913:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd537d2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.160921:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd537d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.160928:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891022.160945:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd537d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.160955:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd537d2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.160975:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff924f82e36300) 00010000:00010000:3.0:1788891022.160978:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788891022.160985:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd537d2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.160992:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd537d2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788891022.161652:0:6498:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788891022.161735:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1788891022.161750:0:6498:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 244406225924ns, next at 245406223581ns, rc = 0 00000001:00080000:3.0:1788891022.161759:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1788891022.161807:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff924f82e36300) 00010000:00010000:3.0:1788891022.161811:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788891022.161820:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd537bd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de019 expref: 35 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891022.162693:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090479450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+34:12190:x1875787987883776:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 17125us (17779us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1788891022.162705:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 38 00000020:00080000:3.0:1788891022.162714:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788891022.166627:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891022.167617:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987884032 00000100:00100000:0.0:1788891022.167652:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987884032 00000100:00100000:0.0:1788891022.167767:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 161 00000100:00100000:0.0:1788891022.167781:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+34:12190:x1875787987884032:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891022.167816:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891022.167862:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd537d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de020 expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.167958:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd537d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de020 expref: 35 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.167978:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd537d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de020 expref: 35 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.168001:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:0.0:1788891022.168005:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788891022.168010:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5200, rc 0) 00000100:00100000:0.0:1788891022.168119:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+35:12190:x1875787987884032:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 331us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891022.168127:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 161 00000100:00100000:1.0:1788891022.173032:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891022.173234:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987884288 00000100:00100000:0.0:1788891022.173249:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987884288 00000100:00100000:0.0:1788891022.173323:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:3.0:1788891022.173333:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1788891022.173337:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+35:12190:x1875787987884288:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:3.0:1788891022.173360:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1788891022.174466:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+36:12190:x1875787987884288:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 1126us (1444us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788891022.174478:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:2.0:1788891022.235892:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891022.235996:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987884544 00000100:00100000:3.0:1788891022.236006:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987884544 00000100:00100000:3.0:1788891022.236069:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 162 00000100:00100000:3.0:1788891022.236082:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+36:12200:x1875787987884544:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891022.236108:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891022.236143:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd537e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de027 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891022.236247:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788891022.236347:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd537e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de027 expref: 38 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.236361:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250b65fd200) 00010000:00010000:3.0:1788891022.236364:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891022.236369:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd537e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de027 expref: 38 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.236383:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080030000, rc 0) 00000100:00100000:3.0:1788891022.236461:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+37:12200:x1875787987884544:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 382us (578us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1788891022.236469:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 162 00000100:00100000:1.0:1788891022.239866:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891022.239984:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987884672 00000100:00100000:0.0:1788891022.239993:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987884672 00000100:00100000:0.0:1788891022.240107:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 163 00000100:00100000:0.0:1788891022.240117:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+37:12200:x1875787987884672:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:0.0:1788891022.240205:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd537ee lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240223:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd537ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240234:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd537ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240247:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd537f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240255:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd537f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240262:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd537f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240351:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd537fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240360:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd537fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240367:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd537fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788891022.240417:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd537fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240431:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd537ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240447:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd537ee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240454:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd537ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240460:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891022.240464:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd537ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240472:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd537ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240484:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:0.0:1788891022.240487:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891022.240504:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd537ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240511:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd537ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240562:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd537f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240569:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd537f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240575:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd537f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240581:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891022.240591:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd537f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240597:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd537f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240607:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff924f82e36400) 00010000:00010000:0.0:1788891022.240610:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891022.240613:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd537f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240619:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd537f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240629:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd537fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240635:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd537fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240640:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd537fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240645:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891022.240648:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd537fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240653:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd537fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240660:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:0.0:1788891022.240662:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891022.240670:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd537fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.240676:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd537fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891022.240758:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+37:12200:x1875787987884672:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 641us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891022.240767:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 163 00000100:00100000:1.0:1788891022.242920:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891022.243021:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987884928 00000100:00100000:2.0:1788891022.243029:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987884928 00000100:00100000:2.0:1788891022.243077:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00100000:2.0:1788891022.243086:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+37:12200:x1875787987884928:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788891022.243453:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+38:12200:x1875787987884928:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 366us (542us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788891022.243461:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 40 00010000:00010000:2.0:1788891022.269361:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891022.275052:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891022.275142:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987885184 00000100:00100000:3.0:1788891022.275163:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987885184 00000100:00100000:3.0:1788891022.275231:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 164 00000100:00100000:3.0:1788891022.275243:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+38:12203:x1875787987885184:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891022.275268:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891022.275288:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53803 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de02e expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.275382:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd5380a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.275396:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd5380a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.275407:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd5380a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.275417:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53811 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.275424:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53811 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.275430:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53811 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.275579:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53818 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.275603:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53818 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.275610:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53818 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891022.275621:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788891022.275951:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd5380a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.275959:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd5380a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.275965:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd5380a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.275971:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891022.275974:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd5380a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.275981:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd5380a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.275993:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:3.0:1788891022.275996:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891022.276000:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd5380a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.276007:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd5380a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.276021:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53811 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.276033:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53811 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.276039:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53811 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.276043:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891022.276046:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53811 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.276052:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53811 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.276061:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff924f82e36400) 00010000:00010000:3.0:1788891022.276063:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891022.276066:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53811 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.276071:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53811 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.276112:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53803 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de02e expref: 41 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.276125:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53818 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de02e expref: 40 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.276133:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:3.0:1788891022.276136:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788891022.276144:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080031200, rc 0) 00000100:00100000:3.0:1788891022.276207:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+40:12203:x1875787987885184:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 965us (1164us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788891022.276214:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 164 00000100:00100000:1.0:1788891022.280342:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891022.280426:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987885312 00000100:00100000:3.0:1788891022.280437:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987885312 00000100:00100000:3.0:1788891022.280585:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 165 00000100:00100000:3.0:1788891022.280595:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+40:12203:x1875787987885312:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:3.0:1788891022.280659:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53826 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.280694:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53826 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.280706:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53826 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.280739:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53826 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.280746:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53826 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.280754:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53826 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.280760:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080031c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891022.280765:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53826 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.280772:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53826 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.280797:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:3.0:1788891022.280801:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891022.280806:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53826 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.280812:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53826 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891022.280883:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+40:12203:x1875787987885312:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 289us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891022.280891:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 165 00000100:00100000:1.0:1788891022.287335:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891022.288244:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987885568 00000100:00100000:2.0:1788891022.288258:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987885568 00000100:00100000:2.0:1788891022.288322:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 41 00000100:00100000:2.0:1788891022.288332:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+40:12203:x1875787987885568:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788891022.288956:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+41:12203:x1875787987885568:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 623us (1628us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788891022.288965:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 41 00000100:00100000:1.0:1788891022.480888:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891022.480996:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987885824 00000100:00100000:2.0:1788891022.481008:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987885824 00000100:00100000:2.0:1788891022.481075:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 166 00000100:00100000:2.0:1788891022.481086:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+41:12234:x1875787987885824:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:2.0:1788891022.481125:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891022.481147:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd5382d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de035 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.481276:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53834 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.481292:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53834 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.481562:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53834 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891022.481577:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788891022.481882:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd5382d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de035 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.481900:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53834 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de035 expref: 43 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.481909:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:2.0:1788891022.481912:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891022.481915:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310c00, rc 0) 00000100:00100000:2.0:1788891022.481992:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+43:12234:x1875787987885824:12345-192.168.204.26@tcp:101:cat.0 Request processed in 908us (1113us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788891022.482001:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 166 00000001:00080000:1.0:1788891022.488071:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000004:00080000:1.0:1788891022.488119:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788891022.488169:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff925090028180 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788891022.488175:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff924f839b3c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff925090028240 00000020:00080000:1.0:1788891022.488178:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff924f839b3800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff924f83a9b600 00000020:00080000:1.0:1788891022.488226:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788891022.488508:0:6527:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788891022.488617:0:6527:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788891022.488630:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788891022.488659:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997371648:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788891022.488763:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891022.488864:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997371648 00000100:00100000:2.0:1788891022.488874:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997371648 00000100:00100000:2.0:1788891022.488943:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788891022.488955:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3627:x1875787997371648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788891022.488997:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00010000:00010000:3.0:1788891022.489034:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5371c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489050:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5371c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891022.489051:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa04f8d, atime: 0x6aa04f8d, ctime: 0x6aa04f8d, blocks: 0x8 00010000:00010000:2.0:1788891022.489066:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd53842 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489067:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5371c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.489090:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=244s v=(0 0) 00010000:00010000:3.0:1788891022.489091:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891022.489100:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5371c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.489100:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891022.489110:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd53842 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489113:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5371c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.489142:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd53842 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489144:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff924f82e36900) 00010000:00010000:3.0:1788891022.489152:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891022.489157:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd53842 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489168:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5371c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.489169:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd53842 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489187:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5371c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489214:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53723 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.489214:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891022.489224:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53723 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489230:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53723 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489236:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891022.489240:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53723 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489246:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53723 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489255:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:3.0:1788891022.489258:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891022.489262:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53723 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489268:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53723 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489283:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53762 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489302:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53762 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489308:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53762 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489314:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310e00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891022.489317:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53762 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489336:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53762 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489347:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff924f82e36400) 00010000:00010000:3.0:1788891022.489350:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891022.489354:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53762 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489361:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53762 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891022.489381:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3627:x1875787997371648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 426us (616us total) trans 4294967308 rc 0/0 00010000:00010000:3.0:1788891022.489390:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788891022.489390:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:3.0:1788891022.489398:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd53842 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489409:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310000 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891022.489414:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd53842 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489436:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd53842 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.489453:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd53842 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788891022.489461:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9250bf792d80/2, rc 0, transno 4294967308 00010000:00010000:3.0:1788891022.489462:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd53842 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891022.489471:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997371648:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788891022.489485:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891022.489489:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891022.489491:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891022.491699:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891022.491777:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891022.492001:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987886080 00000100:00100000:2.0:1788891022.492013:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987886080 00000100:00100000:2.0:1788891022.492088:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:2.0:1788891022.492100:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+18:12234:x1875787987886080:12345-192.168.204.26@tcp:35:cat.0 00000100:00100000:2.0:1788891022.492439:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+19:12234:x1875787987886080:12345-192.168.204.26@tcp:35:cat.0 Request processed in 339us (758us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1788891022.492450:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:0.0:1788891022.492462:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987886208 00000100:00100000:0.0:1788891022.492469:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987886208 00000100:00100000:0.0:1788891022.492513:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:0.0:1788891022.492550:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087acc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+19:2392:x1875787987886208:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891022.492566:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891022.492610:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53834 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de035 expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.492633:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:0.0:1788891022.492640:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891022.492676:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087acc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+18:2392:x1875787987886208:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 154us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891022.492683:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:1.0:1788891022.545672:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891022.545757:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987886464 00000100:00100000:0.0:1788891022.545772:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987886464 00000100:00100000:0.0:1788891022.545913:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 167 00000100:00100000:0.0:1788891022.545938:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+18:12240:x1875787987886464:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:0.0:1788891022.545972:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891022.545976:0:9362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788891022.546033:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5379a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de00b expref: 18 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.546058:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:0.0:1788891022.546065:0:9362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788891022.546081:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53849 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de03c expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.546232:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53850 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.546249:0:9362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53818 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de02e expref: 18 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.546258:0:9362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53850 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.546299:0:9362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53818 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de02e expref: 18 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.546315:0:9362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53818 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de02e expref: 18 pid: 12407 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891022.546332:0:9362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9362:1875787997371776:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891022.546463:0:9362:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788891022.555343:0:9362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9362:1875787997371776:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788891022.555388:0:9362:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53850 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891022.556484:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891022.556582:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987886592 00000100:00100000:0.0:1788891022.556595:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987886592 00010000:00010000:0.0:1788891022.556663:0:10317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53818 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de02e expref: 19 pid: 12407 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891022.557279:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 85 00000100:00100000:0.0:1788891022.557295:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+19:2394:x1875787987886592:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891022.557321:0:10317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891022.557338:0:10317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53818 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de02e expref: 19 pid: 12407 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.557359:0:10317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53818 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de02e expref: 19 pid: 12407 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.557393:0:10317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53818 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de02e expref: 19 pid: 12407 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.557418:0:10317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:0.0:1788891022.557423:0:10317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53850 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.557436:0:10317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53850 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.557445:0:10317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53850 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.557484:0:10317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891022.557662:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+18:2394:x1875787987886592:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 370us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891022.557671:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 85 00010000:00010000:3.0:1788891022.557741:0:9362:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53850 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.557755:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53850 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891022.557778:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788891022.557944:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53849 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de03c expref: 19 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.557971:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53850 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de03c expref: 18 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.557980:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:3.0:1788891022.557984:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788891022.558001:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5000, rc 0) 00000100:00100000:3.0:1788891022.558342:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+18:12240:x1875787987886464:12345-192.168.204.26@tcp:101:dd.0 Request processed in 12417us (12692us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788891022.558351:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 167 00000100:00100000:1.0:1788891022.562216:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891022.563249:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987886720 00000100:00100000:2.0:1788891022.563265:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987886720 00000100:00100000:2.0:1788891022.563504:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 168 00000100:00100000:2.0:1788891022.563519:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+18:12240:x1875787987886720:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1788891022.563575:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891022.563604:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd5385e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de043 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.563654:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53865 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.563673:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53865 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.563687:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53865 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.563849:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd5385e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de043 expref: 20 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.563883:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53865 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de043 expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.563893:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:2.0:1788891022.563897:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788891022.563901:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310800, rc 0) 00000100:00100000:2.0:1788891022.564022:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+19:12240:x1875787987886720:12345-192.168.204.26@tcp:101:dd.0 Request processed in 506us (1820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891022.564030:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 168 00000100:00100000:2.0:1788891022.567748:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891022.568242:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987886976 00000100:00100000:0.0:1788891022.568256:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987886976 00000100:00100000:0.0:1788891022.568339:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 169 00000100:00100000:0.0:1788891022.568352:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+19:12240:x1875787987886976:12345-192.168.204.26@tcp:36:dd.0 00010000:00010000:0.0:1788891022.568751:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5386c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.568776:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5386c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.568795:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5386c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788891022.568849:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1788891022.568876:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000413e3027 reply state 0000000017aec67c transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5386c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.568892:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5386c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.568900:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:0.0:1788891022.568904:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788891022.568909:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788891022.569040:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+22:12240:x1875787987886976:12345-192.168.204.26@tcp:36:dd.0 Request processed in 689us (1306us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1788891022.569048:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 169 00000020:00080000:0.0:1788891022.569054:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788891022.741745:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891022.741878:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987887104 00000100:00100000:3.0:1788891022.741892:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987887104 00000100:00100000:3.0:1788891022.742043:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 170 00000100:00100000:3.0:1788891022.742057:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+22:12254:x1875787987887104:12345-192.168.204.26@tcp:101:stat.0 00010000:00010000:3.0:1788891022.742090:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891022.742118:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53873 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de04a expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.743287:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd5387a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.743313:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd5387a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.743328:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd5387a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.743346:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53881 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.743353:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53881 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.743359:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53881 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.743508:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53888 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.743552:0:12407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53850 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de03c expref: 23 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.743563:0:12407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53888 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.743613:0:12407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53850 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de03c expref: 23 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.743634:0:12407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53850 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de03c expref: 23 pid: 9362 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891022.743651:0:12407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf7f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997371904:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788891022.743794:0:12407:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090028b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788891022.750347:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891022.750771:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987887360 00000100:00100000:0.0:1788891022.750786:0:14588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987887360 00000100:00100000:0.0:1788891022.750877:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:0.0:1788891022.750890:0:14588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+24:6155:x1875787987887360:12345-192.168.204.26@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788891022.751317:0:14588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+25:6155:x1875787987887360:12345-192.168.204.26@tcp:35:ldlm_bl.0 Request processed in 427us (982us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788891022.751327:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:3.0:1788891022.751821:0:12407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf7f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997371904:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891022.751858:0:12407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53888 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891022.761634:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891022.762255:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987887488 00000100:00100000:3.0:1788891022.762271:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987887488 00010000:00010000:3.0:1788891022.762336:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53850 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de03c expref: 25 pid: 9362 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891022.762388:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 86 00000100:00100000:3.0:1788891022.762400:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+25:2393:x1875787987887488:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891022.762421:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891022.762450:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53850 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de03c expref: 25 pid: 9362 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.762467:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53850 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de03c expref: 25 pid: 9362 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.762500:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd53850 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de03c expref: 25 pid: 9362 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.762518:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:3.0:1788891022.762563:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53888 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.762576:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53888 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.762585:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53888 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.762632:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891022.762710:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+24:2393:x1875787987887488:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 311us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891022.762719:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 86 00010000:00010000:0.0:1788891022.763095:0:12407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53888 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.763107:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53888 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891022.763187:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788891022.763193:0:12407:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788891022.763227:0:12407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53888 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.763247:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53888 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.763260:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd5387a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.763268:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd5387a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.763276:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd5387a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.763284:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891022.763297:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd5387a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.763308:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd5387a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.763321:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:0.0:1788891022.763324:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891022.763328:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd5387a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.763336:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd5387a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.763352:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53881 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.763360:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53881 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.763366:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53881 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.763372:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891022.763376:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53881 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.763383:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53881 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.763390:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff925082bfc400) 00010000:00010000:0.0:1788891022.763393:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891022.763402:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53881 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.763409:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53881 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.763482:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53873 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de04a expref: 24 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.763504:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53888 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de04a expref: 23 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.763513:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:0.0:1788891022.763516:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788891022.763518:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080030a00, rc 0) 00000100:00100000:0.0:1788891022.763655:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+23:12254:x1875787987887104:12345-192.168.204.26@tcp:101:stat.0 Request processed in 21601us (21925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891022.763665:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 170 00000100:00100000:2.0:1788891022.820938:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891022.823207:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987887744 00000100:00100000:3.0:1788891022.823229:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987887744 00000100:00100000:3.0:1788891022.823408:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 171 00000100:00100000:3.0:1788891022.823422:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+23:12260:x1875787987887744:12345-192.168.204.26@tcp:36:truncate.0 00010000:00010000:3.0:1788891022.823511:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891022.823565:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53888 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de04a expref: 23 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.823608:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:3.0:1788891022.823613:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788891022.823836:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd5388f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.823854:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd5388f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.823866:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd5388f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788891022.823916:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1788891022.823954:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8912bcf reply state 000000002509cb2c transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd5388f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.823969:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd5388f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.823976:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:3.0:1788891022.823979:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788891022.823982:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788891022.824123:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+25:12260:x1875787987887744:12345-192.168.204.26@tcp:36:truncate.0 Request processed in 702us (3209us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788891022.824132:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 171 00000020:00080000:3.0:1788891022.824139:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788891022.938763:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891022.938888:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987887872 00000100:00100000:2.0:1788891022.938903:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987887872 00000100:00100000:2.0:1788891022.938996:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 172 00000100:00100000:2.0:1788891022.939009:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+25:12274:x1875787987887872:12345-192.168.204.26@tcp:101:stat.0 00010000:00010000:2.0:1788891022.939047:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891022.939079:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53896 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de051 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939170:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd5389d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939187:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd5389d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939200:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd5389d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939240:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939248:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939255:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939418:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd538ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939429:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd538ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939437:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd538ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891022.939492:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788891022.939498:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788891022.939575:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd538ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939591:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd538ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939599:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd5389d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939607:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd5389d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939625:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd5389d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939632:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891022.939636:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd5389d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939645:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd5389d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939660:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:2.0:1788891022.939664:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891022.939669:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd5389d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939677:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd5389d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939695:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939701:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939707:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939711:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891022.939715:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939731:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939740:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff924f82e36c00) 00010000:00010000:2.0:1788891022.939742:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891022.939746:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939751:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939790:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53896 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de051 expref: 27 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939806:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd538ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de051 expref: 26 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891022.939813:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:2.0:1788891022.939816:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891022.939820:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311800, rc 0) 00000100:00100000:2.0:1788891022.940138:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+26:12274:x1875787987887872:12345-192.168.204.26@tcp:101:stat.0 Request processed in 1130us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891022.940147:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 172 00000100:00100000:0.0:1788891022.972208:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788891022.972242:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997372032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788891022.972341:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891022.977128:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997372032 00000100:00100000:2.0:1788891022.977153:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997372032 00000100:00100000:2.0:1788891022.977256:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788891022.977270:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997372032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788891022.977334:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788891022.977504:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997372032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 237us (5162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891022.977512:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788891022.977911:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997372032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788891023.011852:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891023.013574:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987888128 00000100:00100000:0.0:1788891023.013595:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987888128 00000100:00100000:0.0:1788891023.013708:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 173 00000100:00100000:0.0:1788891023.013725:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+26:12284:x1875787987888128:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891023.013765:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891023.013800:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd538b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de058 expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891023.013983:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788891023.014127:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd538b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de058 expref: 28 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.014146:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250b65fd200) 00010000:00010000:0.0:1788891023.014150:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788891023.014156:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd538b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de058 expref: 28 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.014177:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5000, rc 0) 00000100:00100000:0.0:1788891023.014280:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+27:12284:x1875787987888128:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 559us (2444us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1788891023.014288:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 173 00000100:00100000:3.0:1788891023.017876:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891023.018016:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987888384 00000100:00100000:1.0:1788891023.018030:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987888384 00000100:00100000:1.0:1788891023.018219:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 44 00000100:00100000:1.0:1788891023.018233:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509047ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+27:12284:x1875787987888384:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:1.0:1788891023.018621:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509047ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+28:12284:x1875787987888384:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 389us (813us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1788891023.018630:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 44 00000100:00100000:1.0:1788891023.073143:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.073333:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987888640 00000100:00100000:2.0:1788891023.073348:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987888640 00000100:00100000:2.0:1788891023.073439:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 174 00000100:00100000:2.0:1788891023.073454:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+28:12290:x1875787987888640:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788891023.073491:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891023.073564:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd538c0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de05f expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.073805:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538c7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.073825:0:14295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd538ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de051 expref: 29 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.073843:0:14295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538c7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.073898:0:14295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd538ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de051 expref: 29 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.073927:0:14295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd538ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de051 expref: 29 pid: 6495 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891023.073943:0:14295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14295:1875787997372160:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891023.074422:0:14295:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788891023.080270:0:14295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14295:1875787997372160:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891023.080314:0:14295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538c7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891023.080690:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891023.080822:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987888768 00000100:00100000:3.0:1788891023.080832:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987888768 00010000:00010000:3.0:1788891023.080887:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd538ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de051 expref: 30 pid: 6495 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891023.080974:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 87 00000100:00100000:3.0:1788891023.080987:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+30:2393:x1875787987888768:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891023.081007:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891023.081015:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd538ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de051 expref: 30 pid: 6495 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.081029:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd538ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de051 expref: 30 pid: 6495 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.081057:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd538ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de051 expref: 30 pid: 6495 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.081076:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:3.0:1788891023.081082:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538c7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.081101:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.081110:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538c7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.081144:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891023.081238:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+29:2393:x1875787987888768:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 253us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891023.081251:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 87 00010000:00010000:2.0:1788891023.082859:0:14295:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.082880:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891023.082911:0:14295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788891023.083148:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd538c0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de05f expref: 30 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.083171:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de05f expref: 29 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.083181:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:2.0:1788891023.083184:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788891023.083187:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311600, rc 0) 00000100:00100000:2.0:1788891023.083277:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+29:12290:x1875787987888640:12345-192.168.204.26@tcp:101:bash.0 Request processed in 9825us (10151us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788891023.084512:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 174 00000100:00100000:1.0:1788891023.091186:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891023.091284:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987889024 00000100:00100000:0.0:1788891023.091296:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987889024 00000100:00100000:0.0:1788891023.091411:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 175 00000100:00100000:0.0:1788891023.091424:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+29:12290:x1875787987889024:12345-192.168.204.26@tcp:36:bash.0 00010000:00010000:0.0:1788891023.091756:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd538d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.091779:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd538d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.091792:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd538d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788891023.091839:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1788891023.091879:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c0fe171 reply state 0000000082ecbc4a transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd538d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.091893:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd538d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.091901:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:0.0:1788891023.091904:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788891023.091908:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788891023.092039:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+32:12290:x1875787987889024:12345-192.168.204.26@tcp:36:bash.0 Request processed in 617us (874us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1788891023.092047:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 175 00000020:00080000:0.0:1788891023.092053:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788891023.097709:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891023.097875:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987889152 00000100:00100000:3.0:1788891023.097909:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987889152 00000100:00100000:3.0:1788891023.098003:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 176 00000100:00100000:3.0:1788891023.098015:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+32:12290:x1875787987889152:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:3.0:1788891023.098049:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891023.098079:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd538dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de066 expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.098231:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd538e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.098250:0:12407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538c7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de05f expref: 33 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.098260:0:12407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd538e3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.098304:0:12407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de05f expref: 33 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.098321:0:12407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de05f expref: 33 pid: 14295 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891023.098338:0:12407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf7f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997372288:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788891023.098457:0:12407:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090028b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788891023.100973:0:12407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf7f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997372288:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788891023.101008:0:12407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd538e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891023.101515:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891023.101630:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987889280 00000100:00100000:3.0:1788891023.101638:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987889280 00010000:00010000:3.0:1788891023.101677:0:10317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de05f expref: 34 pid: 14295 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891023.101737:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 88 00000100:00100000:3.0:1788891023.101747:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+34:2393:x1875787987889280:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891023.102048:0:10317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891023.102057:0:10317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de05f expref: 34 pid: 14295 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.102076:0:10317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de05f expref: 34 pid: 14295 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.102110:0:10317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd538c7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de05f expref: 34 pid: 14295 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.102127:0:10317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:3.0:1788891023.102132:0:10317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd538e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.102142:0:10317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd538e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.102151:0:10317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd538e3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.102181:0:10317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891023.102237:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+33:2393:x1875787987889280:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 490us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891023.102246:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 88 00010000:00010000:0.0:1788891023.102410:0:12407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd538e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.102418:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd538e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891023.102469:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788891023.102473:0:12407:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788891023.102492:0:12407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd538e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.102605:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd538dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de066 expref: 33 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.102631:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd538e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de066 expref: 32 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.102639:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:0.0:1788891023.102642:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788891023.102644:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080030800, rc 0) 00000100:00100000:0.0:1788891023.102682:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+32:12290:x1875787987889152:12345-192.168.204.26@tcp:101:bash.0 Request processed in 4669us (4992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891023.102690:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 176 00000100:00100000:0.0:1788891023.108761:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891023.108855:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987889536 00000100:00100000:3.0:1788891023.108891:0:14588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987889536 00000100:00100000:3.0:1788891023.108989:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00100000:3.0:1788891023.109003:0:14588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+32:12290:x1875787987889536:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:3.0:1788891023.109337:0:14588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+33:12290:x1875787987889536:12345-192.168.204.26@tcp:35:bash.0 Request processed in 336us (595us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788891023.109346:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00100000:3.0:1788891023.168967:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.171053:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987889792 00000100:00100000:2.0:1788891023.171078:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987889792 00000100:00100000:2.0:1788891023.171192:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 177 00000100:00100000:2.0:1788891023.171207:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+33:12300:x1875787987889792:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788891023.171297:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891023.171345:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd538ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de06d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891023.171482:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788891023.171681:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd538ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de06d expref: 35 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.171701:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250b65fd200) 00010000:00010000:2.0:1788891023.171705:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788891023.171711:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd538ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de06d expref: 35 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.171738:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311400, rc 0) 00000100:00100000:2.0:1788891023.171829:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+34:12300:x1875787987889792:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 625us (2877us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1788891023.171837:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 177 00000100:00100000:1.0:1788891023.176433:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.176582:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987889920 00000100:00100000:2.0:1788891023.176594:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987889920 00000100:00100000:2.0:1788891023.176660:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 178 00000100:00100000:2.0:1788891023.176671:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+34:12300:x1875787987889920:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:2.0:1788891023.176756:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd538f8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.176774:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd538f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.176785:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd538f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.176820:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd538ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.176827:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd538ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.176833:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd538ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.176909:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53906 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.176929:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.176936:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788891023.176983:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.176995:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd538f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177000:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd538f8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177007:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd538f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177012:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891023.177016:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd538f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177030:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd538f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177041:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:2.0:1788891023.177044:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891023.177048:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd538f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177054:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd538f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177066:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd538ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177072:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd538ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177077:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd538ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177081:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891023.177083:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd538ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177101:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd538ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177108:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff924f82e36c00) 00010000:00010000:2.0:1788891023.177111:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891023.177114:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd538ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177129:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd538ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177144:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177150:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53906 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177155:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53906 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177160:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891023.177163:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53906 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177168:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53906 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177176:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:2.0:1788891023.177178:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891023.177181:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53906 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.177187:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53906 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891023.177559:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+34:12300:x1875787987889920:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 887us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891023.177569:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 178 00000100:00100000:0.0:1788891023.180416:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891023.180494:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987890176 00000100:00100000:1.0:1788891023.180518:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987890176 00000100:00100000:1.0:1788891023.180626:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 46 00000100:00100000:1.0:1788891023.180637:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+34:12300:x1875787987890176:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:1.0:1788891023.180872:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+35:12300:x1875787987890176:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 236us (464us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788891023.180881:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 46 00000100:00100000:3.0:1788891023.208696:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891023.208840:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987890432 00000100:00100000:0.0:1788891023.208851:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987890432 00000100:00100000:0.0:1788891023.208923:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 179 00000100:00100000:0.0:1788891023.208934:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+35:12303:x1875787987890432:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891023.208960:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891023.208983:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5390d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de074 expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209081:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53914 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209097:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53914 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209110:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53914 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209145:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5391b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209152:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5391b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209159:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5391b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209278:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53922 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209288:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53922 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209295:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53922 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891023.209305:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788891023.209379:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53914 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209386:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53914 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209393:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53914 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209399:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891023.209403:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53914 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209421:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53914 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209435:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:0.0:1788891023.209438:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891023.209443:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53914 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209450:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4400/0xa66601b03fd53914 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209463:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5391b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209469:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5391b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209476:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5391b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209481:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891023.209484:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5391b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209490:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5391b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209497:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9250c130b900) 00010000:00010000:0.0:1788891023.209500:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891023.209503:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5391b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209520:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5391b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209609:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5000/0xa66601b03fd5390d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de074 expref: 38 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209630:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53922 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de074 expref: 37 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.209639:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:0.0:1788891023.209641:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788891023.209644:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925081523800, rc 0) 00000100:00100000:0.0:1788891023.209710:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+37:12303:x1875787987890432:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 778us (1022us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788891023.209718:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 179 00000100:00100000:2.0:1788891023.211842:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891023.211898:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987890688 00000100:00100000:3.0:1788891023.211907:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987890688 00000100:00100000:3.0:1788891023.211977:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 180 00000100:00100000:3.0:1788891023.211987:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+37:12303:x1875787987890688:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:3.0:1788891023.212046:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53930 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.212062:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53930 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.212073:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53930 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.212200:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53930 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.212209:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53930 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.212217:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53930 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.212240:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891023.212244:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53930 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.212252:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53930 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.212265:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:3.0:1788891023.212268:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891023.212273:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53930 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.212279:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53930 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891023.212879:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+37:12303:x1875787987890688:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 889us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891023.212889:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 180 00000100:00100000:3.0:1788891023.213484:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891023.214081:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987890560 00000100:00100000:0.0:1788891023.214149:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987890560 00000100:00100000:0.0:1788891023.214210:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:0.0:1788891023.214220:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+37:2394:x1875787987890560:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891023.214235:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891023.214259:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53922 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de074 expref: 37 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.214277:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:0.0:1788891023.214281:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891023.214333:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+36:2394:x1875787987890560:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 114us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891023.214354:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:3.0:1788891023.217235:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.217678:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987890944 00000100:00100000:2.0:1788891023.217692:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987890944 00000100:00100000:2.0:1788891023.217752:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:2.0:1788891023.217763:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+36:12303:x1875787987890944:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788891023.217998:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+37:12303:x1875787987890944:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 237us (776us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788891023.218005:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 47 00010000:00010000:0.0:1788891023.292698:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891023.326066:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891023.326242:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987891200 00000100:00100000:0.0:1788891023.326254:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987891200 00000100:00100000:0.0:1788891023.326320:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 181 00000100:00100000:0.0:1788891023.326331:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+37:12321:x1875787987891200:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:0.0:1788891023.326359:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891023.326380:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53937 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de07b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.326503:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5393e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.326520:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5393e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.326562:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5393e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891023.326574:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788891023.326684:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53937 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de07b expref: 40 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.326706:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5393e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de07b expref: 39 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.326715:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:0.0:1788891023.326718:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788891023.326736:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925081522a00, rc 0) 00000100:00100000:0.0:1788891023.326799:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+39:12321:x1875787987891200:12345-192.168.204.26@tcp:101:cat.0 Request processed in 470us (745us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1788891023.326807:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 181 00000100:00100000:0.0:1788891023.351200:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891023.351361:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987891328 00000100:00100000:3.0:1788891023.351372:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987891328 00000100:00100000:3.0:1788891023.351436:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 182 00000100:00100000:3.0:1788891023.351448:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+39:12322:x1875787987891328:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891023.351473:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891023.351495:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd5394c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de082 expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.351653:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53953 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.351669:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53953 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.351696:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53953 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891023.351741:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788891023.351746:0:9362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891023.351899:0:9362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53953 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.351935:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd5394c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de082 expref: 41 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.351951:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53953 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de082 expref: 40 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.351958:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:3.0:1788891023.351961:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788891023.351964:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080031200, rc 0) 00000100:00100000:3.0:1788891023.352070:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+40:12322:x1875787987891328:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 625us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891023.352078:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 182 00000100:00100000:3.0:1788891023.358942:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891023.359957:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987891712 00000100:00100000:0.0:1788891023.360122:0:14588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987891712 00000100:00100000:0.0:1788891023.360250:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 48 00000100:00100000:0.0:1788891023.360262:0:14588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+40:12322:x1875787987891712:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788891023.360673:0:14588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+41:12322:x1875787987891712:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 413us (1738us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788891023.360682:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 48 00000100:00100000:2.0:1788891023.362647:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891023.362737:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987891840 00000100:00100000:1.0:1788891023.362745:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987891840 00000100:00100000:1.0:1788891023.362853:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:1.0:1788891023.362863:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+41:12322:x1875787987891840:12345-192.168.204.26@tcp:103:lfs.0 00010000:00010000:1.0:1788891023.362878:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788891023.362920:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd538e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de066 expref: 41 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.362949:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd5393e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de07b expref: 40 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.362964:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd537d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de020 expref: 39 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.362976:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:1.0:1788891023.362981:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891023.363069:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+38:12322:x1875787987891840:12345-192.168.204.26@tcp:103:lfs.0 Request processed in 209us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891023.363075:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:1.0:1788891023.366328:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.366456:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987891968 00000100:00100000:2.0:1788891023.366466:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987891968 00000100:00100000:2.0:1788891023.366663:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 183 00000100:00100000:2.0:1788891023.366675:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+38:12322:x1875787987891968:12345-192.168.204.26@tcp:58:lfs.0 00010000:00010000:2.0:1788891023.366821:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd5395a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.366998:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd5395a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.367011:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd5395a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788891023.367124:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788891023.367995:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+38:12322:x1875787987891968:12345-192.168.204.26@tcp:58:lfs.0 Request processed in 1316us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891023.368033:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 183 00000100:00100000:3.0:1788891023.383750:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.383847:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987892096 00000100:00100000:2.0:1788891023.383862:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987892096 00000100:00100000:2.0:1788891023.384105:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 184 00000100:00100000:2.0:1788891023.384120:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+38:12324:x1875787987892096:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788891023.384143:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891023.384166:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53961 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de089 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384235:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53968 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384250:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53968 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384262:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53968 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384277:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5396f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384284:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5396f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384290:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5396f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384358:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53976 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384386:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53976 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384395:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53976 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891023.384438:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788891023.384443:0:6495:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788891023.384460:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53976 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384473:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53976 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384482:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53968 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384489:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53968 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384496:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53968 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384502:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891023.384506:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53968 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384514:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53968 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384556:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:2.0:1788891023.384560:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891023.384571:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53968 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384578:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53968 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384591:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5396f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384598:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5396f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384604:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5396f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384609:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310e00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891023.384611:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5396f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384616:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5396f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384623:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff924f82e36c00) 00010000:00010000:2.0:1788891023.384625:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891023.384628:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5396f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384634:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5396f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384666:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53961 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de089 expref: 40 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384692:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53976 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de089 expref: 39 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.384713:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:2.0:1788891023.384716:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788891023.384718:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311000, rc 0) 00000100:00100000:2.0:1788891023.384789:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+39:12324:x1875787987892096:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 673us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891023.385225:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 184 00000040:00080000:2.0:1788891023.485009:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788891023.485020:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788891023.485047:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788891023.485056:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788891023.485222:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875787997372416:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788891023.485383:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788891023.489772:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875787997372416:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788891023.490338:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891023.490565:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987892224 00000100:00100000:3.0:1788891023.490577:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987892224 00000100:00100000:3.0:1788891023.491268:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 185 00000100:00100000:3.0:1788891023.491278:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+39:12335:x1875787987892224:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788891023.491305:0:12407:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788891023.491438:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+39:12335:x1875787987892224:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 161us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891023.491446:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 185 00000100:00100000:1.0:1788891023.495482:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.496034:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987892352 00000100:00100000:2.0:1788891023.496049:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987892352 00000100:00100000:2.0:1788891023.496207:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 186 00000100:00100000:2.0:1788891023.496219:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+39:12335:x1875787987892352:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788891023.496321:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5397d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.496344:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5397d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.496374:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5397d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.500431:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53984 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.500460:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53984 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.500473:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53984 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.500513:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5398b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.500537:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5398b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.500546:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5398b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891023.500613:0:14295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788891023.500618:0:14295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788891023.500634:0:14295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5398b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.500646:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5397d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.500654:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5397d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.500673:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5397d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.500679:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310e00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891023.500684:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5397d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.500691:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5397d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.500705:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9250905a3b00) 00010000:00010000:2.0:1788891023.500708:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891023.500713:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5397d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.500720:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd5397d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.502377:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53984 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.502392:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53984 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.502400:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53984 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.502406:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891023.502410:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53984 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.502432:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53984 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.502447:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff924f82e36c00) 00010000:00010000:2.0:1788891023.502450:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891023.502455:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53984 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.502462:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53984 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.502484:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5398b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.502489:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5398b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.502494:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5398b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.502499:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891023.502502:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5398b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.502508:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5398b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.502515:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:2.0:1788891023.502518:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891023.502535:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5398b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.502552:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd5398b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891023.502659:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+39:12335:x1875787987892352:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 Request processed in 6437us (7186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891023.502668:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 186 00000100:00100000:3.0:1788891023.505788:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891023.508830:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987892608 00000100:00100000:0.0:1788891023.508846:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987892608 00000100:00100000:0.0:1788891023.508978:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 187 00000100:00100000:0.0:1788891023.508989:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+39:12335:x1875787987892608:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788891023.509009:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891023.509028:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53992 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de090 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.509265:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53999 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.509283:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53999 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.509295:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53999 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891023.509318:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788891023.509392:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53999 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.509400:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53999 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.509407:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53999 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.509413:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081523800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891023.509417:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53999 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.509425:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53999 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.509437:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:0.0:1788891023.509440:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788891023.509444:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53999 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.509451:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53999 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.509490:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53992 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de090 expref: 41 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.509500:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9250905a3b00) 00010000:00010000:0.0:1788891023.509502:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788891023.509511:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53992 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de090 expref: 41 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.509539:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925081523200, rc 0) 00000100:00100000:0.0:1788891023.509604:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+40:12335:x1875787987892608:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 617us (3826us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1788891023.509612:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 187 00000100:00100000:1.0:1788891023.514655:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891023.514748:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987892736 00000100:00100000:3.0:1788891023.514757:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987892736 00000100:00100000:3.0:1788891023.514825:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 188 00000100:00100000:3.0:1788891023.514837:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+40:12335:x1875787987892736:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788891023.514877:0:9362:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788891023.515018:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+40:12335:x1875787987892736:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 182us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891023.515026:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 188 00000100:00100000:1.0:1788891023.521864:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.522087:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987892992 00000100:00100000:2.0:1788891023.522098:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987892992 00000100:00100000:2.0:1788891023.522157:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 189 00000100:00100000:2.0:1788891023.522167:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+40:12335:x1875787987892992:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891023.522189:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891023.522191:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788891023.522218:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53953 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de082 expref: 40 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.522238:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:2.0:1788891023.522243:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891023.522261:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd539a7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de097 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788891023.522655:0:6497:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788891023.522793:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd539ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.522806:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd539ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.522816:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd539ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.522876:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd539a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de097 expref: 42 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.522890:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd539ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de097 expref: 41 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.522899:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff924f82e36c00) 00010000:00010000:2.0:1788891023.522901:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891023.522904:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310000, rc 0) 00000100:00100000:2.0:1788891023.522967:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+41:12335:x1875787987892992:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 802us (1112us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788891023.522975:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 189 00000100:00100000:1.0:1788891023.526068:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.526214:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987893248 00000100:00100000:2.0:1788891023.526226:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987893248 00000100:00100000:2.0:1788891023.526287:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 190 00000100:00100000:2.0:1788891023.526298:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+41:12335:x1875787987893248:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788891023.526354:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891023.526383:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd539ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de097 expref: 41 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526403:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff924f82e36c00) 00010000:00010000:2.0:1788891023.526414:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891023.526435:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd539bc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526449:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd539bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526467:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd539bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526512:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd539c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x87e48219 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526553:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd539c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x87e48219 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526562:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd539c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x87e48219 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526604:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd539bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526611:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd539bc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526617:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd539bc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526623:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310e00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891023.526628:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd539bc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526635:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd539bc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526644:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:2.0:1788891023.526647:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891023.526651:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd539bc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526663:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd539bc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526672:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd539c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x87e48219 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526678:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd539c3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x87e48219 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526684:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd539c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x87e48219 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526689:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891023.526693:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd539c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x87e48219 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526698:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd539c3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x87e48219 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526706:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x87e48219 (ffff924f82e36d00) 00010000:00010000:2.0:1788891023.526708:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891023.526711:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd539c3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x87e48219 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.526717:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd539c3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x87e48219 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891023.526784:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+40:12335:x1875787987893248:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 489us (725us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788891023.526791:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 190 00000100:00100000:1.0:1788891023.528585:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891023.528703:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987893376 00000100:00100000:3.0:1788891023.528710:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987893376 00000100:00100000:3.0:1788891023.528761:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 191 00000100:00100000:3.0:1788891023.528770:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+40:12335:x1875787987893376:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788891023.528786:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891023.528804:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd539ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de09e expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.528838:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd539d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.528851:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd539d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.528862:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd539d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.528994:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd539ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de09e expref: 42 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.529014:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd539d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de09e expref: 41 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.529023:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff925082bfce00) 00010000:00010000:3.0:1788891023.529026:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788891023.529030:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080030200, rc 0) 00000100:00100000:3.0:1788891023.529093:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+41:12335:x1875787987893376:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 323us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891023.529100:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 191 00000100:00100000:1.0:1788891023.534651:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891023.534729:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987893632 00000100:00100000:3.0:1788891023.534740:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987893632 00000100:00100000:3.0:1788891023.534800:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 192 00000100:00100000:3.0:1788891023.534810:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+41:12335:x1875787987893632:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788891023.534896:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd539d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.534924:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd539d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.535002:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd539d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788891023.535177:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788891023.535187:0:6497:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 245779663398ns, next at 246779660978ns, rc = 0 00000004:00010000:3.0:1788891023.535242:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021929695 reply state 0000000065dbc57b transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd539d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.535256:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd539d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.535264:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff925082bfce00) 00010000:00010000:3.0:1788891023.535267:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788891023.535270:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788891023.535366:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+43:12335:x1875787987893632:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 556us (724us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788891023.535374:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 192 00000100:00100000:1.0:1788891023.546280:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891023.546344:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987893760 00000100:00100000:3.0:1788891023.546355:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987893760 00000100:00100000:3.0:1788891023.546461:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 193 00000100:00100000:3.0:1788891023.546474:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+43:12335:x1875787987893760:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788891023.546500:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891023.546562:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd539df lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de0a5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.546623:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd539df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0a5 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.546639:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd539df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0a5 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.546658:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff925082bfce00) 00010000:00010000:2.0:1788891023.546662:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788891023.546665:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080030000, rc 0) 00000100:00100000:2.0:1788891023.546725:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+44:12335:x1875787987893760:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 254us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891023.546732:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 193 00000100:00100000:1.0:1788891023.550952:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.551437:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987893888 00000100:00100000:2.0:1788891023.551448:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987893888 00000100:00100000:2.0:1788891023.551539:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:2.0:1788891023.551550:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1262a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+6:2393:x1875787987893888:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788891023.551800:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1262a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+7:2393:x1875787987893888:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 251us (857us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788891023.551808:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00080000:1.0:1788891023.551872:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788891023.556887:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891023.556979:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987894144 00000100:00100000:3.0:1788891023.556990:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987894144 00000100:00100000:3.0:1788891023.557054:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 49 00000100:00100000:3.0:1788891023.557065:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+44:12335:x1875787987894144:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788891023.557305:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+45:12335:x1875787987894144:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 241us (431us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788891023.557313:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 49 00000100:00100000:3.0:1788891023.565157:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.565264:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987894400 00000100:00100000:2.0:1788891023.565275:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987894400 00000100:00100000:2.0:1788891023.565340:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 194 00000100:00100000:2.0:1788891023.565351:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+45:12335:x1875787987894400:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788891023.565490:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+45:12335:x1875787987894400:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 140us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891023.565517:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 194 00000100:00100000:1.0:1788891023.567776:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891023.567863:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987894528 00000100:00100000:3.0:1788891023.567872:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987894528 00000100:00100000:3.0:1788891023.567934:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 195 00000100:00100000:3.0:1788891023.567958:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+45:12335:x1875787987894528:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788891023.567977:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891023.567996:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd539e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de0ac expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.568063:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd539ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.568078:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd539ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.568103:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd539ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891023.568149:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891023.568168:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd539ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.568192:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd539e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0ac expref: 47 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.568209:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd539ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0ac expref: 46 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.568218:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff925082bfce00) 00010000:00010000:3.0:1788891023.568221:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788891023.568224:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080031200, rc 0) 00000100:00100000:3.0:1788891023.568296:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+46:12335:x1875787987894528:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 340us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891023.568313:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 195 00000100:00100000:0.0:1788891023.571762:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.571877:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987894656 00000100:00100000:2.0:1788891023.571887:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987894656 00000100:00100000:2.0:1788891023.571957:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:2.0:1788891023.571969:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+7:2394:x1875787987894656:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891023.572078:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891023.572101:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd539f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de0b3 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891023.572126:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa04f8f, blocks: 0x0 00010000:00010000:2.0:1788891023.572145:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=245s v=(0 0) 00010000:00010000:2.0:1788891023.572150:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891023.572160:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd539f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0b3 expref: 8 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.572178:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd539f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0b3 expref: 8 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.572192:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310400, rc 0) 00000100:00100000:2.0:1788891023.572319:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+8:2394:x1875787987894656:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 351us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891023.572326:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:1.0:1788891023.574420:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891023.574553:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987894912 00000100:00100000:0.0:1788891023.574565:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987894912 00000100:00100000:0.0:1788891023.574626:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 196 00000100:00100000:0.0:1788891023.574635:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+46:12335:x1875787987894912:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788891023.574738:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+46:12335:x1875787987894912:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 104us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891023.574746:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 196 00000100:00100000:1.0:1788891023.577469:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.577762:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987895040 00000100:00100000:2.0:1788891023.577772:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987895040 00000100:00100000:2.0:1788891023.577835:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:2.0:1788891023.577846:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+8:12335:x1875787987895040:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891023.577870:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891023.577887:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd539fb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de0ba expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.577930:0:8410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd539f4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0b3 expref: 9 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.577940:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891023.577944:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891023.577949:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd539fb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0ba expref: 9 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.577983:0:8410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd539f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0b3 expref: 9 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.577996:0:8410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd539f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0b3 expref: 9 pid: 8411 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891023.578012:0:8410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8410:1875787997372544:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891023.578112:0:8410:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788891023.580241:0:8410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8410:1875787997372544:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891023.580280:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd539fb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0ba expref: 9 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.580303:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310e00, rc 0) 00000100:00100000:3.0:1788891023.580404:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+9:12335:x1875787987895040:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 2559us (2949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891023.580412:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:1.0:1788891023.582469:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891023.582757:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987895168 00000100:00100000:3.0:1788891023.582766:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987895168 00010000:00010000:3.0:1788891023.582807:0:10317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd539f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0b3 expref: 9 pid: 8411 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891023.582842:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 89 00000100:00100000:3.0:1788891023.582852:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087ace050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+9:2393:x1875787987895168:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891023.582868:0:10317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891023.582890:0:10317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd539f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0b3 expref: 9 pid: 8411 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.582917:0:10317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd539f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0b3 expref: 9 pid: 8411 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.582942:0:10317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd539f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0b3 expref: 9 pid: 8411 timeout: 345 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.582972:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891023.582977:0:10317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891023.582986:0:10317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd539fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0ba expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.582996:0:10317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd539fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0ba expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.583035:0:10317:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd539fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0ba expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891023.583049:0:10317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10317:1875787997372672:192.168.204.26@tcp:105: 00000100:00100000:3.0:1788891023.583140:0:10317:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090028000 going to sleep for 11 seconds 00000100:00100000:3.0:1788891023.586051:0:10317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10317:1875787997372672:192.168.204.26@tcp:105: 00010000:00010000:3.0:1788891023.586076:0:10317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891023.586138:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087ace050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+8:2393:x1875787987895168:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 3286us (3674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891023.586148:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 89 00000100:00100000:0.0:1788891023.587025:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891023.587156:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987895296 00000100:00100000:3.0:1788891023.587163:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987895296 00002000:00100000:3.0:1788891023.587208:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff924f831dbb80 x1875787987895296/t0(0) o4->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:74/0 lens 504/0 e 0 to 0 dl 1788891034 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788891023.587218:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f831dbb80 with x1875787987895296 ext(0->8) 00002000:00010000:3.0:1788891023.587224:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924f831dbb80 00000100:00100000:3.0:1788891023.587269:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:3.0:1788891023.587339:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df03475d-d91a-4e91-8125-742ac4d4c589+8:2393:x1875787987895296:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788891023.588918:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df03475d-d91a-4e91-8125-742ac4d4c589+10:2393:x1875787987895296:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 Request processed in 1625us (1879us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788891023.588948:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00002000:00100000:2.0:1788891023.588960:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff924f831dbb80 x1875787987895296/t4294967315(0) o4->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:74/0 lens 504/448 e 0 to 0 dl 1788891034 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788891023.589355:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f831dbb80 with x1875787987895296 ext(0->8) 00002000:00010000:2.0:1788891023.589361:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924f831dbb80 00000100:00100000:1.0:1788891023.591172:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.591266:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987895424 00000100:00100000:2.0:1788891023.591275:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987895424 00000100:00100000:2.0:1788891023.591367:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 197 00000100:00100000:2.0:1788891023.591377:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+46:12335:x1875787987895424:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788891023.594038:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1788891023.594052:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1788891023.594104:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1788891023.594158:0:6527:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1788891023.594172:0:6527:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788891023.594264:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+23:12335:x1875787987895424:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 Request processed in 2882us (3094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891023.594276:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 197 00000100:00100000:0.0:1788891023.594507:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997372800:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788891023.594584:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891023.594780:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997372800 00000100:00100000:3.0:1788891023.594786:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997372800 00000100:00100000:3.0:1788891023.594842:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788891023.594855:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997372800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788891023.594987:0:8596:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788891023.594991:0:8596:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788891023 00002000:00010000:3.0:1788891023.594993:0:8596:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788891023.594995:0:8596:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788891023 -> 1788891023 00002000:00010000:3.0:1788891023.594998:0:8596:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788891023.595033:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3630:x1875787997372800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 179us (448us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788891023.595040:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788891023.595092:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788891023.595124:0:3630:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9250bf6a7800/2, rc 0, transno 4294967316 00000100:00100000:0.0:1788891023.595129:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997372800:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788891023.595368:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5386c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595379:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5386c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595387:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5386c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595394:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891023.595400:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5386c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595408:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5386c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595425:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:1.0:1788891023.595441:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891023.595448:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5386c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595454:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5386c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595694:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd5388f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595702:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd5388f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595709:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd5388f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595713:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080031c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891023.595717:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd5388f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595723:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd5388f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595734:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:1.0:1788891023.595736:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891023.595738:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd5388f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595744:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd5388f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595755:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd538d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595771:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd538d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595777:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd538d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595781:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891023.595784:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd538d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595789:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd538d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595798:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:1.0:1788891023.595800:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891023.595802:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd538d5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595807:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd538d5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595819:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd539d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595825:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd539d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595831:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd539d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595835:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891023.595843:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd539d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595850:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd539d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595858:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff925082bfce00) 00010000:00010000:1.0:1788891023.595860:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788891023.595863:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd539d8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.595869:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd539d8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891023.597044:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.597125:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987895552 00000100:00100000:2.0:1788891023.597134:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987895552 00000100:00100000:2.0:1788891023.597186:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:2.0:1788891023.597196:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1262300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+10:2393:x1875787987895552:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788891023.599897:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:0.0:1788891023.599930:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1788891023.600279:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1262300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+7:2393:x1875787987895552:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 Request processed in 3076us (3235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891023.600295:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:0.0:1788891023.606037:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891023.606949:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987895808 00000100:00100000:1.0:1788891023.606966:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987895808 00000100:00100000:1.0:1788891023.607062:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 198 00000100:00100000:1.0:1788891023.607078:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+19:12335:x1875787987895808:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788891023.607627:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891023.607669:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd539ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0ac expref: 19 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.607699:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff925082bfce00) 00010000:00010000:2.0:1788891023.607706:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891023.607790:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53a02 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.607808:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53a02 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.607821:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53a02 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788891023.608008:0:14295:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e24a8956 reply state 0000000062c5dcd5 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53a02 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.608021:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53a02 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.608027:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff925082bfce00) 00010000:00010000:2.0:1788891023.608030:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788891023.608033:0:14295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788891023.608457:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+20:12335:x1875787987895808:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 1382us (2433us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1788891023.608467:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 198 00000100:00100000:0.0:1788891023.611711:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891023.611798:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987895936 00000100:00100000:3.0:1788891023.611811:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987895936 00000100:00100000:3.0:1788891023.611901:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:3.0:1788891023.611923:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+7:2394:x1875787987895936:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788891023.612142:0:8410:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788891023.612147:0:8410:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788891023 -> 1788891022 00002000:00010000:3.0:1788891023.612150:0:8410:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788891021 00002000:00010000:3.0:1788891023.612152:0:8410:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788891023 -> 1788891022 00002000:00010000:3.0:1788891023.612154:0:8410:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788891023.612233:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+8:2394:x1875787987895936:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 312us (536us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788891023.612243:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:1.0:1788891023.615034:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.615147:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987896192 00000100:00100000:2.0:1788891023.615159:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987896192 00000100:00100000:2.0:1788891023.615390:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 199 00000100:00100000:2.0:1788891023.615402:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+20:12335:x1875787987896192:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788891023.615499:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53a09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.615807:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd539d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de09e expref: 20 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.615833:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53a09 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.615881:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd539d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de09e expref: 20 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.615896:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd539d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de09e expref: 20 pid: 9362 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891023.615927:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6496:1875787997372928:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891023.616091:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788891023.620192:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891023.620331:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987896320 00000100:00100000:3.0:1788891023.620344:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987896320 00010000:00010000:3.0:1788891023.620397:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd539d1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de09e expref: 21 pid: 9362 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891023.620449:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 90 00000100:00100000:3.0:1788891023.620461:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+21:2393:x1875787987896320:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891023.620479:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891023.620487:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd539d1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de09e expref: 21 pid: 9362 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.620504:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd539d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de09e expref: 21 pid: 9362 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.620555:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff925082bfce00) 00010000:00010000:3.0:1788891023.620562:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53a09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.620574:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53a09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.620583:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53a09 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.620606:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891023.620679:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+21:2393:x1875787987896320:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 220us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891023.620688:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 90 00010000:00010000:2.0:1788891023.621505:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd539d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de09e expref: 20 pid: 9362 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891023.621548:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6496:1875787997372928:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891023.621577:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53a09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.621588:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53a09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.621594:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53a09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.621647:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53a09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.621655:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53a09 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.621673:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53a09 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.621680:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891023.621686:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53a09 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.621696:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53a09 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.621711:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff925082bfce00) 00010000:00010000:2.0:1788891023.621715:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788891023.621720:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53a09 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.621727:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53a09 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891023.621809:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+19:12335:x1875787987896192:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 Request processed in 6408us (6786us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788891023.621829:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 199 00000100:00100000:1.0:1788891023.624091:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.624182:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987896448 00000100:00100000:2.0:1788891023.624193:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987896448 00000100:00100000:2.0:1788891023.624267:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:2.0:1788891023.624278:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+8:2392:x1875787987896448:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788891023.624346:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036c6dfa2/0xa66601b03fd53a10 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.624373:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd539fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0ba expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.624392:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891023.624398:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788891023.624403:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c6dfa2/0xa66601b03fd53a10 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.624449:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd539fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0ba expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.624464:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd539fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0ba expref: 8 pid: 8410 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891023.624483:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8408:1875787997373056:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891023.624610:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788891023.627207:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8408:1875787997373056:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891023.627249:0:8408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036c6dfa2/0xa66601b03fd53a10 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891023.628707:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.628804:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987896576 00000100:00100000:2.0:1788891023.628815:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987896576 00010000:00010000:2.0:1788891023.628866:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd539fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0ba expref: 9 pid: 8410 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891023.628927:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 91 00000100:00100000:2.0:1788891023.628941:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+9:2393:x1875787987896576:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891023.628981:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891023.629013:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd539fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0ba expref: 9 pid: 8410 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.629029:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd539fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0ba expref: 9 pid: 8410 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.629061:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac8ac7e8/0xa66601b03fd539fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0ba expref: 9 pid: 8410 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.629082:0:7436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788891023.629087:0:7436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788891023.629093:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036c6dfa2/0xa66601b03fd53a10 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.629105:0:7436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c6dfa2/0xa66601b03fd53a10 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.629142:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891023.629220:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+8:2393:x1875787987896576:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 280us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891023.629229:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 91 00010000:00010000:0.0:1788891023.629321:0:8408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036c6dfa2/0xa66601b03fd53a10 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.629334:0:8408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c6dfa2/0xa66601b03fd53a10 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.629362:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036c6dfa2/0xa66601b03fd53a10 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.629372:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036c6dfa2/0xa66601b03fd53a10 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.629381:0:8408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036c6dfa2/0xa66601b03fd53a10 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.629389:0:8408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891023.629394:0:8408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c6dfa2/0xa66601b03fd53a10 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.629405:0:8408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036c6dfa2/0xa66601b03fd53a10 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.629421:0:8408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036c6dfa2/0xa66601b03fd53a10 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.629429:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c6dfa2/0xa66601b03fd53a10 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891023.629607:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+7:2392:x1875787987896448:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 Request processed in 5330us (5531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891023.629618:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:1.0:1788891023.634708:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891023.634806:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987896832 00000100:00100000:3.0:1788891023.634825:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987896832 00000100:00100000:3.0:1788891023.634901:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 200 00000100:00100000:3.0:1788891023.634927:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+19:12335:x1875787987896832:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788891023.635039:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a17 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.635062:0:12407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53865 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de043 expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.635073:0:12407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a17 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.635121:0:12407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53865 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de043 expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.635137:0:12407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53865 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de043 expref: 19 pid: 14295 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891023.635157:0:12407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997373184:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788891023.635312:0:12407:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090028600 going to sleep for 11 seconds 00000100:00100000:0.0:1788891023.639355:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.639560:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987896960 00000100:00100000:2.0:1788891023.639572:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987896960 00010000:00010000:2.0:1788891023.639633:0:10317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53865 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de043 expref: 20 pid: 14295 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891023.639715:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 92 00000100:00100000:2.0:1788891023.639729:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+20:2393:x1875787987896960:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891023.639751:0:10317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891023.639760:0:10317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53865 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de043 expref: 20 pid: 14295 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.640492:0:10317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53865 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de043 expref: 20 pid: 14295 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.640546:0:10317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:2.0:1788891023.640553:0:10317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a17 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.640564:0:10317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.640573:0:10317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a17 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.640599:0:10317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891023.640677:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+20:2393:x1875787987896960:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 951us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891023.640687:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 92 00010000:00010000:3.0:1788891023.642584:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53865 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de043 expref: 19 pid: 14295 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891023.642612:0:12407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997373184:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891023.642645:0:12407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.642964:0:12407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.642973:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.643224:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53a1e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.643241:0:12407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd539df lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0a5 expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.643253:0:12407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53a1e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.643300:0:12407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd539df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0a5 expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.643321:0:12407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd539df lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0a5 expref: 19 pid: 6495 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891023.643341:0:12407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997373312:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891023.643477:0:12407:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891023.648229:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891023.648437:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987897088 00000100:00100000:3.0:1788891023.648462:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987897088 00010000:00010000:3.0:1788891023.648514:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd539df lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0a5 expref: 20 pid: 6495 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891023.648587:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 93 00000100:00100000:3.0:1788891023.648599:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+20:2393:x1875787987897088:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891023.648618:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891023.648627:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd539df lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0a5 expref: 20 pid: 6495 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.648647:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd539df lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0a5 expref: 20 pid: 6495 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.648678:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff925082bfce00) 00010000:00010000:3.0:1788891023.648685:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53a1e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.648698:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53a1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.648707:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53a1e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.648731:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891023.648805:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+20:2393:x1875787987897088:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 208us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891023.648989:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 93 00010000:00010000:2.0:1788891023.649750:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd539df lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0a5 expref: 19 pid: 6495 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891023.649778:0:12407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997373312:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891023.649806:0:12407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53a1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.649818:0:12407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53a1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891023.649835:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53a1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788891023.650044:0:12407:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1788891023.650231:0:12407:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1788891023.650275:0:12407:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1788891023.650394:0:12407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12407:1875787997373440:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788891023.650473:0:12407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891023.650518:0:12407:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788891023.650736:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997373440 00000100:00100000:0.0:1788891023.650744:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997373440 00000100:00100000:0.0:1788891023.650804:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788891023.651492:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12407:x1875787997373440:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788891023.651667:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12407:x1875787997373440:12345-0@lo:1000:mdt00_004.0 Request processed in 853us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891023.651676:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788891023.651894:0:12407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1788891023.651902:0:12407:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9250bf6a7800, transno 4294967316 00000100:00100000:3.0:1788891023.651941:0:12407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12407:1875787997373440:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1788891023.652097:0:12407:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1788891023.652167:0:12407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12407:1875787997373568:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788891023.652215:0:12407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891023.652254:0:12407:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090028f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788891023.652317:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997373568 00000100:00100000:2.0:1788891023.652324:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997373568 00000100:00100000:2.0:1788891023.652408:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788891023.652418:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12407:x1875787997373568:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788891023.652614:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12407:x1875787997373568:12345-0@lo:1000:mdt00_004.0 Request processed in 197us (399us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788891023.652621:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788891023.653064:0:12407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12407:1875787997373568:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788891023.653115:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53a1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.653143:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53a1e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.653152:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53a1e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.653160:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891023.653165:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53a1e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.653173:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53a1e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.653205:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff925082bfce00) 00010000:00010000:0.0:1788891023.653209:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788891023.653214:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53a1e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.653221:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53a1e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.653251:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd5395a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.653257:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd5395a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.653263:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd5395a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.653270:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891023.653273:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd5395a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.653279:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd5395a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.653286:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:0.0:1788891023.653288:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788891023.653291:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd5395a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.653296:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd5395a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.653334:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53a25 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.653349:0:12407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53976 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de089 expref: 22 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.653368:0:12407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53a25 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.653404:0:12407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53976 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de089 expref: 22 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.653422:0:12407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53976 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de089 expref: 22 pid: 6495 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891023.653438:0:12407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997373696:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891023.653564:0:12407:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847000 going to sleep for 11 seconds 00000100:00100000:0.0:1788891023.659009:0:12407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997373696:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891023.659031:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00010000:00010000:0.0:1788891023.659053:0:12407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53a25 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891023.659248:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987897216 00000100:00100000:1.0:1788891023.659256:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987897216 00010000:00010000:1.0:1788891023.659297:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53976 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de089 expref: 23 pid: 6495 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891023.659327:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 94 00000100:00100000:1.0:1788891023.659350:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+23:2394:x1875787987897216:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891023.659366:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891023.659372:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53976 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de089 expref: 23 pid: 6495 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.659383:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53976 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de089 expref: 23 pid: 6495 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.659405:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53976 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de089 expref: 23 pid: 6495 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.659419:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:1.0:1788891023.659423:0:7436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53a25 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.659432:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53a25 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.659438:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53a25 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891023.659458:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891023.659517:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+22:2394:x1875787987897216:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 167us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891023.659584:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 94 00010000:00010000:3.0:1788891023.660018:0:12407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53a25 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.660029:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53a25 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.660044:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53a25 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.660053:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53a25 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.660061:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53a25 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.660068:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081523800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891023.660073:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53a25 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.660082:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53a25 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.660093:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:3.0:1788891023.660096:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891023.660101:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53a25 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.660123:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53a25 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.660138:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.660144:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a17 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.660150:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a17 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.660155:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891023.660158:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a17 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.660163:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a17 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.660172:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9250c130b200) 00010000:00010000:3.0:1788891023.660174:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788891023.660176:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a17 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.660182:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a17 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891023.660384:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+21:12335:x1875787987896832:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 25458us (25682us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788891023.660394:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 200 00000020:00080000:3.0:1788891023.660407:0:12407:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788891023.660609:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788891023.660615:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788891023.661177:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:0.0:1788891023.661187:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788891023.663388:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891023.663571:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987897472 00000100:00100000:0.0:1788891023.663584:0:14588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987897472 00000100:00100000:0.0:1788891023.663712:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 50 00000100:00100000:0.0:1788891023.664217:0:14588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090479050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+21:12335:x1875787987897472:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788891023.666078:0:14588:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788891023.666125:0:14588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1788891023.666173:0:14588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53a2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.666195:0:14588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53a2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.666209:0:14588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53a2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.666219:0:14588:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53a2c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.666226:0:14588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53a2c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.666233:0:14588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53a2c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891023.666263:0:14588:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891023.666476:0:10315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891023.666492:0:10315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53a2c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.666501:0:10315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891023.666505:0:10315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53a2c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.666515:0:10315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53a2c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.666547:0:10315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff925082bfce00) 00010000:00010000:3.0:1788891023.666550:0:10315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788891023.666556:0:10315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53a2c lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.666561:0:10315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53a2c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891023.666576:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891023.666578:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891023.666580:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891023.666642:0:14588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090479050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+23:12335:x1875787987897472:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 2425us (3264us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788891023.666654:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 50 00000020:00080000:0.0:1788891023.666661:0:14588:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788891023.824123:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.824252:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891023.824284:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891023.824312:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987897600 00000100:00100000:2.0:1788891023.824320:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891023.824324:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987897600 00000100:00100000:2.0:1788891023.824353:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891023.824377:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987897728 00000100:00100000:2.0:1788891023.824383:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987897856 00000100:00100000:0.0:1788891023.824383:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987897728 00000100:00100000:2.0:1788891023.824390:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987897856 00000100:00100000:1.0:1788891023.824396:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 365 00000100:00100000:1.0:1788891023.824425:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2394:x1875787987897600:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891023.824438:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987897984 00000100:00100000:2.0:1788891023.824439:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 112 00000100:00100000:0.0:1788891023.824441:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987897984 00000100:00100000:2.0:1788891023.824452:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+7:2394:x1875787987897856:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891023.824460:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987898112 00000100:00100000:0.0:1788891023.824470:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987898112 00000100:00100000:0.0:1788891023.824491:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 217 00000100:00100000:0.0:1788891023.824498:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987897728:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788891023.824504:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2394:x1875787987897600:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 82us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891023.824515:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 365 00000100:00100000:3.0:1788891023.824604:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 218 00000100:00100000:3.0:1788891023.824616:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2393:x1875787987897984:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788891023.824681:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+7:2394:x1875787987897856:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 233us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891023.824689:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 112 00000100:00100000:2.0:1788891023.824719:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 219 00000100:00100000:2.0:1788891023.824727:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987898112:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788891023.824754:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987898112:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 29us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891023.824760:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 219 00000100:00100000:0.0:1788891023.824794:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+5:2393:x1875787987897728:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 293us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891023.824803:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 217 00000100:00080000:0.0:1788891023.824830:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788891023.824836:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788891023.824838:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788891023.825926:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2393:x1875787987897984:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 1304us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891023.825937:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 218 00000040:00080000:0.0:1788891023.957608:0:14626:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788891023.957617:0:14626:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788891023.957654:0:14626:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788891023.957661:0:14626:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788891024.063163:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788891024.082360:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.082491:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987898368 00000100:00100000:3.0:1788891024.082516:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987898368 00000100:00100000:3.0:1788891024.082643:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 201 00000100:00100000:3.0:1788891024.082658:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+23:12345:x1875787987898368:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891024.082697:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891024.082741:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de0c1 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.082908:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53a3a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.082926:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53a3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.082944:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53a3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891024.082958:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788891024.083118:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0c1 expref: 26 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.083140:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53a3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0c1 expref: 25 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.083151:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:3.0:1788891024.083154:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788891024.083158:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080031200, rc 0) 00000100:00100000:3.0:1788891024.083240:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+25:12345:x1875787987898368:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 585us (892us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788891024.083247:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 201 00000100:00080000:1.0:1788891024.083425:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788891024.089006:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.090199:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987898496 00000100:00100000:3.0:1788891024.090219:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987898496 00000100:00100000:3.0:1788891024.090316:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 202 00000100:00100000:3.0:1788891024.090329:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+25:12345:x1875787987898496:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:3.0:1788891024.090441:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a48 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.090464:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.090479:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.090498:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.090505:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.090512:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.092863:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.092905:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.092922:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788891024.092993:0:9362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093019:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093026:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a48 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093036:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093043:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891024.093049:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093058:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a48 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093075:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:3.0:1788891024.093079:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891024.093085:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093091:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093103:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093110:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093116:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093127:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891024.093130:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093137:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093146:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff925082bfc900) 00010000:00010000:3.0:1788891024.093148:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891024.093151:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093158:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093174:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093181:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093186:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093191:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891024.093194:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093199:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093217:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff925082bfc800) 00010000:00010000:3.0:1788891024.093220:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891024.093223:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a56 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.093229:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891024.093363:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+25:12345:x1875787987898496:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 3029us (4369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891024.093375:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 202 00000100:00100000:3.0:1788891024.127433:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.127504:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987898752 00000100:00100000:3.0:1788891024.127545:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987898752 00000100:00100000:3.0:1788891024.127621:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 203 00000100:00100000:3.0:1788891024.127634:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+25:12348:x1875787987898752:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891024.127662:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891024.127690:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de0c8 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.127804:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a64 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.127822:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.127838:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.127872:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.127880:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.127887:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.128052:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53a72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.128061:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.128079:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891024.128091:0:14295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788891024.128202:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.128211:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a64 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.128218:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.128225:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891024.128229:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.128250:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a64 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.128265:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:3.0:1788891024.128268:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891024.128274:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.128279:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53a64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.128295:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.128301:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a6b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.128308:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.128312:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891024.128315:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.128321:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a6b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.128328:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff925082bfc800) 00010000:00010000:3.0:1788891024.128330:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891024.128333:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a6b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.128348:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53a6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.128402:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53a5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0c8 expref: 28 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.128418:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53a72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0c8 expref: 27 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.128426:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff925082bfc900) 00010000:00010000:3.0:1788891024.128429:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788891024.128434:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080031c00, rc 0) 00000100:00100000:3.0:1788891024.128552:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+27:12348:x1875787987898752:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 891us (1105us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788891024.128561:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 203 00000100:00100000:0.0:1788891024.139635:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.140576:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987898880 00000100:00100000:3.0:1788891024.140592:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987898880 00000100:00100000:3.0:1788891024.140681:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 204 00000100:00100000:3.0:1788891024.140693:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+27:12348:x1875787987898880:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:3.0:1788891024.140795:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53a80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.140817:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53a80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.140832:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53a80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.140907:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53a80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.140916:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53a80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.140923:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53a80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.140930:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891024.140935:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53a80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.140943:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53a80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.140958:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff925082bfc900) 00010000:00010000:3.0:1788891024.140962:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891024.140969:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53a80 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.140976:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53a80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891024.141094:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+27:12348:x1875787987898880:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 402us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891024.141103:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 204 00000100:00100000:3.0:1788891024.146441:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891024.146624:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987899136 00000100:00100000:0.0:1788891024.146643:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987899136 00000100:00100000:0.0:1788891024.146740:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:0.0:1788891024.146754:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+27:12348:x1875787987899136:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788891024.147061:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+28:12348:x1875787987899136:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 311us (631us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1788891024.147068:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:1.0:1788891024.178746:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891024.178952:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987899392 00000100:00100000:2.0:1788891024.178963:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987899392 00000100:00100000:2.0:1788891024.179027:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 205 00000100:00100000:2.0:1788891024.179038:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+28:11881:x1875787987899392:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788891024.179063:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891024.179085:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53a87 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de0cf expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.179195:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53a8e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.179212:0:12407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53a72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0c8 expref: 29 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.179220:0:12407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53a8e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.179257:0:12407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53a72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0c8 expref: 29 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.179270:0:12407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53a72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0c8 expref: 29 pid: 14295 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891024.179317:0:12407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997373824:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891024.179411:0:12407:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891024.181734:0:12407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997373824:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891024.181765:0:12407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53a8e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891024.184089:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891024.184343:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987899520 00000100:00100000:2.0:1788891024.184353:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987899520 00010000:00010000:2.0:1788891024.184396:0:10317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53a72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0c8 expref: 30 pid: 14295 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891024.184444:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 95 00000100:00100000:2.0:1788891024.184455:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+30:2392:x1875787987899520:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891024.184609:0:10317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891024.184618:0:10317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53a72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0c8 expref: 30 pid: 14295 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.184634:0:10317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53a72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0c8 expref: 30 pid: 14295 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.184655:0:10317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53a72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0c8 expref: 30 pid: 14295 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.184672:0:10317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff925082bfc900) 00010000:00010000:2.0:1788891024.184677:0:10317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53a8e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.184686:0:10317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53a8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.184711:0:10317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53a8e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.184775:0:10317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891024.184839:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+29:2392:x1875787987899520:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 386us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891024.184847:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 95 00010000:00010000:3.0:1788891024.185311:0:12407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53a8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.185323:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53a8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891024.185343:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788891024.185479:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53a87 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0cf expref: 30 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.185495:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53a8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0cf expref: 29 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.185504:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff925082bfc900) 00010000:00010000:3.0:1788891024.185507:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788891024.185509:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310e00, rc 0) 00000100:00100000:3.0:1788891024.185605:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+29:11881:x1875787987899392:12345-192.168.204.26@tcp:101:bash.0 Request processed in 6566us (6867us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1788891024.185615:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 205 00000100:00100000:1.0:1788891024.188569:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.188944:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987899648 00000100:00100000:3.0:1788891024.188956:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987899648 00000100:00100000:3.0:1788891024.189021:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 206 00000100:00100000:3.0:1788891024.189030:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+29:11881:x1875787987899648:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:3.0:1788891024.189059:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891024.189464:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53a9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de0d6 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.189520:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53aa3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.189549:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.189561:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.189688:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030000/0xa66601b03fd53a9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0d6 expref: 31 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.189707:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0d6 expref: 30 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.189715:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff925082bfc900) 00010000:00010000:3.0:1788891024.189717:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788891024.189721:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080030a00, rc 0) 00000100:00100000:3.0:1788891024.189792:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+30:11881:x1875787987899648:12345-192.168.204.26@tcp:101:bash.0 Request processed in 762us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891024.189801:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 206 00000100:00100000:1.0:1788891024.195994:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.198634:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987899904 00000100:00100000:3.0:1788891024.198652:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987899904 00000100:00100000:2.0:1788891024.199449:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 207 00000100:00100000:2.0:1788891024.199481:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+30:11881:x1875787987899904:12345-192.168.204.26@tcp:36:bash.0 00010000:00010000:2.0:1788891024.199766:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd53aaa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.199796:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd53aaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.199809:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd53aaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788891024.199852:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1788891024.199875:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004fbd5204 reply state 000000001d25a9fe transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd53aaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.199889:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd53aaa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.199909:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff925082bfc900) 00010000:00010000:2.0:1788891024.199912:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788891024.199915:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788891024.200006:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1788891024.200130:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+34:11881:x1875787987899904:12345-192.168.204.26@tcp:36:bash.0 Request processed in 668us (4145us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788891024.200139:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 207 00000020:00080000:2.0:1788891024.200144:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788891024.202418:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.202465:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987900032 00000100:00100000:3.0:1788891024.202474:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987900032 00000100:00100000:3.0:1788891024.202559:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 208 00000100:00100000:3.0:1788891024.202569:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+34:11881:x1875787987900032:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:3.0:1788891024.202607:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891024.202752:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53ab1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de0dd expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891024.202826:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53ab1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0dd expref: 35 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891024.202841:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53ab1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0dd expref: 35 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891024.202872:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff925082bfc900) 00010000:00010000:0.0:1788891024.202876:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788891024.202880:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925081523800, rc 0) 00000100:00100000:0.0:1788891024.202956:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+35:11881:x1875787987900032:12345-192.168.204.26@tcp:101:bash.0 Request processed in 387us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891024.206042:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 208 00000100:00100000:1.0:1788891024.206584:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.206780:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987900160 00000100:00100000:3.0:1788891024.206789:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987900160 00000100:00100000:3.0:1788891024.206882:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:3.0:1788891024.206903:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+7:11881:x1875787987900160:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:3.0:1788891024.206924:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891024.206959:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f97a1f3/0xa66601b03fd53ab8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de0e4 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788891024.206988:0:8410:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa04f8e, atime: 0x6aa04f8d, ctime: 0x6aa04f8e, blocks: 0x8 00010000:00010000:3.0:1788891024.207014:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=246s v=(0 0) 00010000:00010000:3.0:1788891024.207020:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891024.207030:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f97a1f3/0xa66601b03fd53ab8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0e4 expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.207051:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f97a1f3/0xa66601b03fd53ab8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0e4 expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.207205:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080030000, rc 0) 00000100:00100000:3.0:1788891024.207281:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+8:11881:x1875787987900160:12345-192.168.204.26@tcp:101:bash.0 Request processed in 390us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891024.207288:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:1.0:1788891024.210519:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891024.210905:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987900288 00000100:00100000:2.0:1788891024.210918:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987900288 00002000:00010000:2.0:1788891024.210975:0:8414:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1788891024.210980:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f833d2680 with x1875787987900288 ext(0->18446744073709551615) 00002000:00010000:2.0:1788891024.210996:0:8414:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924f833d2680. 00000100:00100000:2.0:1788891024.211085:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:2.0:1788891024.211097:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df03475d-d91a-4e91-8125-742ac4d4c589+8:2393:x1875787987900288:12345-192.168.204.26@tcp:10:bash.0 00002000:00010000:2.0:1788891024.211427:0:8414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788891024.211431:0:8414:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788891022 -> 1788891023 00002000:00010000:2.0:1788891024.211434:0:8414:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788891021 -> 1788891021 00002000:00010000:2.0:1788891024.211437:0:8414:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788891022 -> 1788891023 00002000:00010000:2.0:1788891024.211440:0:8414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788891024.211547:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df03475d-d91a-4e91-8125-742ac4d4c589+9:2393:x1875787987900288:12345-192.168.204.26@tcp:10:bash.0 Request processed in 428us (1013us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788891024.211555:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00002000:00010000:2.0:1788891024.211560:0:8414:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1788891024.211562:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f833d2680 with x1875787987900288 ext(0->18446744073709551615) 00002000:00010000:2.0:1788891024.211567:0:8414:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924f833d2680. 00000100:00100000:0.0:1788891024.292813:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891024.292926:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987900416 00000100:00100000:2.0:1788891024.292937:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987900416 00000100:00100000:2.0:1788891024.293038:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 209 00000100:00100000:2.0:1788891024.293049:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+35:12362:x1875787987900416:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:2.0:1788891024.293145:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53abf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293162:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53abf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293175:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53abf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293189:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53ac6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293195:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293200:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293282:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53acd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293290:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53acd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293296:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53acd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788891024.293344:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53acd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293356:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53abf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293397:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53abf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293404:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53abf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293410:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891024.293414:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53abf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293422:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53abf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293435:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:2.0:1788891024.293437:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891024.293442:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53abf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293448:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53abf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293461:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293467:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53ac6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293473:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293478:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891024.293487:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293493:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293501:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff924f82e34e00) 00010000:00010000:2.0:1788891024.293504:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891024.293507:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53ac6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293512:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53ac6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293575:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53acd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293582:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53acd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293588:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53acd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293593:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891024.293596:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53acd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293602:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53acd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293616:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff925082bfc900) 00010000:00010000:2.0:1788891024.293618:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891024.293627:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53acd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.293633:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53acd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891024.293705:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+35:12362:x1875787987900416:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 657us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891024.293712:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 209 00010000:00010000:0.0:1788891024.315751:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891024.327655:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.327968:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987900672 00000100:00100000:3.0:1788891024.327980:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987900672 00000100:00100000:3.0:1788891024.328031:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 210 00000100:00100000:3.0:1788891024.328041:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+35:12365:x1875787987900672:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891024.328074:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891024.328201:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53ad4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de0eb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328273:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53adb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328286:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53adb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328297:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53adb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328312:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53ae2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328319:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328326:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328430:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53ae9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328440:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328447:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891024.328458:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788891024.328827:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53adb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328836:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53adb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328843:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53adb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328849:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891024.328854:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53adb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328862:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53adb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328873:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:3.0:1788891024.328876:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891024.328880:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53adb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328887:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53adb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328911:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328918:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53ae2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328923:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328927:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080031c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891024.328937:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328944:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53ae2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328952:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff925082bfc700) 00010000:00010000:3.0:1788891024.328955:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891024.328958:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53ae2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.328964:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53ae2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.329011:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53ad4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0eb expref: 38 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.329026:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0eb expref: 37 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.329033:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff925082bfc900) 00010000:00010000:3.0:1788891024.329036:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788891024.329039:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8a600, rc 0) 00000100:00100000:3.0:1788891024.329257:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+37:12365:x1875787987900672:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1215us (1611us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788891024.329265:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 210 00000100:00100000:1.0:1788891024.332570:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891024.332684:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987900800 00000100:00100000:2.0:1788891024.332694:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987900800 00000100:00100000:2.0:1788891024.332743:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 211 00000100:00100000:2.0:1788891024.332752:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+37:12365:x1875787987900800:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:2.0:1788891024.332818:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53af7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.332834:0:12407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53a8e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0cf expref: 37 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.332845:0:12407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53af7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.332885:0:12407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53a8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0cf expref: 37 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.332909:0:12407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53a8e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0cf expref: 37 pid: 12407 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891024.332923:0:12407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997373952:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891024.333037:0:12407:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788891024.336288:0:12407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12407:1875787997373952:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891024.336316:0:12407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53af7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891024.336735:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891024.336967:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987901056 00000100:00100000:0.0:1788891024.336975:0:14588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987901056 00000100:00100000:0.0:1788891024.337036:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:0.0:1788891024.337047:0:14588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+38:6154:x1875787987901056:12345-192.168.204.26@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788891024.337860:0:14588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+39:6154:x1875787987901056:12345-192.168.204.26@tcp:35:ldlm_bl.0 Request processed in 811us (1122us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788891024.337869:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:0.0:1788891024.341106:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.341233:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987901184 00000100:00100000:3.0:1788891024.341241:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987901184 00010000:00010000:3.0:1788891024.341283:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53a8e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0cf expref: 39 pid: 12407 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891024.341351:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 96 00000100:00100000:3.0:1788891024.341364:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087acd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+39:2394:x1875787987901184:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891024.341379:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891024.341388:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53a8e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0cf expref: 39 pid: 12407 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.341403:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53a8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0cf expref: 39 pid: 12407 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.341426:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53a8e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0cf expref: 39 pid: 12407 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.341443:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff925082bfc900) 00010000:00010000:3.0:1788891024.341448:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53af7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.341458:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53af7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.341465:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53af7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.341499:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891024.341598:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087acd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+38:2394:x1875787987901184:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 237us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891024.341607:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 96 00010000:00010000:2.0:1788891024.341956:0:12407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53af7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.341965:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53af7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.342005:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53af7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.342014:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53af7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.342020:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53af7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.342027:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891024.342031:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53af7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.342039:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53af7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.342055:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff925082bfc900) 00010000:00010000:2.0:1788891024.342058:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788891024.342175:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53af7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.342196:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53af7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891024.342240:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+37:12365:x1875787987900800:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 9487us (9720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891024.342248:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 211 00000100:00100000:3.0:1788891024.344441:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891024.344556:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987901440 00000100:00100000:0.0:1788891024.344565:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987901440 00000100:00100000:0.0:1788891024.344617:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 53 00000100:00100000:0.0:1788891024.344627:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+37:12365:x1875787987901440:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788891024.344837:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+38:12365:x1875787987901440:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 210us (405us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788891024.344845:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 53 00000100:00100000:0.0:1788891024.410767:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.413025:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987901696 00000100:00100000:3.0:1788891024.413046:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987901696 00000100:00100000:2.0:1788891024.413184:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 212 00000100:00100000:2.0:1788891024.413197:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+38:12376:x1875787987901696:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:2.0:1788891024.413222:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891024.413244:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53afe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de0f2 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413321:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b05 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413335:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413347:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413362:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413370:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413376:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413500:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd53b13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413510:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd53b13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413517:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd53b13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891024.413550:0:14295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788891024.413626:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413633:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b05 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413713:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413720:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891024.413728:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413737:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b05 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413748:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:2.0:1788891024.413751:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891024.413756:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413772:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413869:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413876:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b0c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413882:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413897:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891024.413901:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413907:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413916:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff924f82e34e00) 00010000:00010000:2.0:1788891024.413919:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891024.413922:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b0c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413927:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413972:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53afe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0f2 expref: 41 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.413997:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd53b13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0f2 expref: 40 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.414004:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff925082bfc900) 00010000:00010000:2.0:1788891024.414006:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891024.414009:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310600, rc 0) 00000100:00100000:2.0:1788891024.414081:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+40:12376:x1875787987901696:12345-192.168.204.26@tcp:101:cat.0 Request processed in 886us (3323us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788891024.414088:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 212 00000100:00100000:1.0:1788891024.420229:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.420326:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987901952 00000100:00100000:3.0:1788891024.420335:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987901952 00000100:00100000:3.0:1788891024.420400:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 54 00000100:00100000:3.0:1788891024.420410:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+40:12376:x1875787987901952:12345-192.168.204.26@tcp:35:cat.0 00000100:00100000:3.0:1788891024.420728:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+41:12376:x1875787987901952:12345-192.168.204.26@tcp:35:cat.0 Request processed in 318us (508us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788891024.420737:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 54 00000100:00100000:3.0:1788891024.437472:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891024.437596:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987902208 00000100:00100000:2.0:1788891024.437606:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987902208 00000100:00100000:2.0:1788891024.437724:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 213 00000100:00100000:2.0:1788891024.437736:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+41:12377:x1875787987902208:12345-192.168.204.26@tcp:36:rm.0 00010000:00010000:2.0:1788891024.437801:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788891024.437831:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53ab1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0dd expref: 41 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.437858:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd53b13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0f2 expref: 40 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.437874:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53ae9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0eb expref: 39 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.437899:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53aa3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0d6 expref: 38 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.437933:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff925082bfc900) 00010000:00010000:2.0:1788891024.437939:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891024.437964:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53b21 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.437978:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53b21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.437988:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53b21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.438003:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b28 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.438012:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.438019:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.438111:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.438120:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.438128:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788891024.439685:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00010000:00010000:2.0:1788891024.439768:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53b36 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.439793:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53b36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.439802:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53b36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.439810:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53b36 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.439816:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53b36 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.439822:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53b36 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.439851:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891024.439874:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.439880:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b2f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.439886:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.439903:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891024.439908:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.439914:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b2f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.439935:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff925082bfc900) 00010000:00010000:2.0:1788891024.439938:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788891024.439942:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b2f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.439948:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b2f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.439965:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53b21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.439972:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53b21 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.439977:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53b21 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.439982:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891024.439984:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53b21 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.439990:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53b21 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.439997:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:2.0:1788891024.439999:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891024.440002:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53b21 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.440007:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53b21 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788891024.440026:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028a667d7 reply state 00000000aac897d3 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.440037:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b28 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.440043:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff924f82e34e00) 00010000:00010000:2.0:1788891024.440046:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788891024.440049:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788891024.440142:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+39:12377:x1875787987902208:12345-192.168.204.26@tcp:36:rm.0 Request processed in 2405us (2678us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788891024.440151:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 213 00010000:00010000:3.0:1788891024.442428:0:10316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891024.442444:0:10316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53b36 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.442456:0:10316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310400 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891024.442461:0:10316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53b36 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.442472:0:10316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53b36 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.442507:0:10316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff925082bfc900) 00010000:00010000:3.0:1788891024.442511:0:10316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788891024.442516:0:10316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53b36 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.442557:0:10316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53b36 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.442575:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891024.442595:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891024.442597:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891024.492771:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891024.492903:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987902464 00000100:00100000:0.0:1788891024.492914:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987902464 00000100:00100000:2.0:1788891024.493098:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 214 00000100:00100000:2.0:1788891024.493114:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+39:12383:x1875787987902464:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788891024.493144:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891024.493171:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53b3d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de0f9 expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.493282:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b44 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.493297:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b44 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.493309:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b44 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.493320:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd53b4b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.493341:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd53b4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.493349:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd53b4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788891024.493721:0:12407:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788891024.493875:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53b52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.493885:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53b52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.494247:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53b52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.494285:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b44 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.494292:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b44 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.494299:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b44 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.494305:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891024.494309:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b44 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.494315:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b44 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.494341:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:2.0:1788891024.494344:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891024.494349:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b44 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.494355:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53b44 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788891024.494369:0:12407:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000358c8c9 reply state 00000000dbfc7def transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd53b4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.494379:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd53b4b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.494386:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff924f82e34e00) 00010000:00010000:2.0:1788891024.494388:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788891024.494390:0:12407:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788891024.494424:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53b3d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0f9 expref: 42 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.494439:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53b52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0f9 expref: 41 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.494446:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34100) 00010000:00010000:2.0:1788891024.494448:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891024.494451:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310200, rc 0) 00000100:00100000:2.0:1788891024.494779:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+42:12383:x1875787987902464:12345-192.168.204.26@tcp:101:bash.0 Request processed in 1668us (2017us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788891024.494787:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 214 00000100:00100000:0.0:1788891024.498279:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891024.498370:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987902592 00000100:00100000:2.0:1788891024.498381:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987902592 00000100:00100000:2.0:1788891024.498447:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:2.0:1788891024.498459:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+7:2391:x1875787987902592:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788891024.498480:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891024.498502:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd53b60 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de100 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891024.498549:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891024.498571:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=246s v=(0 0) 00010000:00010000:2.0:1788891024.498575:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891024.498585:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd53b60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de100 expref: 8 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.498610:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd53b60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de100 expref: 8 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.498624:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310400, rc 0) 00000100:00100000:2.0:1788891024.498682:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+8:2391:x1875787987902592:12345-192.168.204.26@tcp:101:bash.0 Request processed in 225us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891024.498689:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:3.0:1788891024.501987:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891024.502383:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987902720 00000100:00100000:2.0:1788891024.502397:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987902720 00000100:00100000:2.0:1788891024.502476:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:2.0:1788891024.502489:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+8:12383:x1875787987902720:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788891024.502514:0:8596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891024.502595:0:8596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa84e4d7/0xa66601b03fd53b67 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de107 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.502640:0:8596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd53b60 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de100 expref: 9 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.502652:0:8596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891024.502658:0:8596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891024.502663:0:8596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa84e4d7/0xa66601b03fd53b67 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de107 expref: 9 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.502710:0:8596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd53b60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de100 expref: 9 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.502727:0:8596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd53b60 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de100 expref: 9 pid: 8408 timeout: 346 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891024.502745:0:8596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8596:1875787997374080:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891024.503024:0:8596:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788891024.506961:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.507110:0:8596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8596:1875787997374080:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891024.507160:0:8596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa84e4d7/0xa66601b03fd53b67 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de107 expref: 9 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.507187:0:8596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311200, rc 0) 00000100:00100000:3.0:1788891024.507266:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+9:12383:x1875787987902720:12345-192.168.204.26@tcp:101:bash.0 Request processed in 4780us (5297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891024.507277:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:0.0:1788891024.508249:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987902848 00000100:00100000:0.0:1788891024.508261:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987902848 00010000:00010000:0.0:1788891024.508315:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd53b60 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de100 expref: 9 pid: 8408 timeout: 346 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891024.508967:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 97 00000100:00100000:0.0:1788891024.508983:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+9:2394:x1875787987902848:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891024.509014:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891024.509051:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd53b60 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de100 expref: 9 pid: 8408 timeout: 346 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891024.509081:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd53b60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de100 expref: 9 pid: 8408 timeout: 346 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891024.509120:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efd58ceb/0xa66601b03fd53b60 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de100 expref: 9 pid: 8408 timeout: 346 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891024.509138:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891024.509143:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891024.509154:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa84e4d7/0xa66601b03fd53b67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de107 expref: 8 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891024.509165:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa84e4d7/0xa66601b03fd53b67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de107 expref: 8 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891024.509239:0:6482:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fa84e4d7/0xa66601b03fd53b67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de107 expref: 8 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891024.509258:0:6482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a67b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6482:1875787997374208:192.168.204.26@tcp:105: 00000100:00100000:0.0:1788891024.509374:0:6482:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788891024.516016:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.516117:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987903104 00000100:00100000:3.0:1788891024.516131:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987903104 00000100:00100000:3.0:1788891024.516200:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00100000:3.0:1788891024.516212:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+42:12383:x1875787987903104:12345-192.168.204.26@tcp:35:bash.0 00000001:00080000:3.0:1788891024.516578:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967485 00000100:00100000:3.0:1788891024.516716:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+44:12383:x1875787987903104:12345-192.168.204.26@tcp:35:bash.0 Request processed in 505us (714us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1788891024.516726:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 55 00000020:00080000:3.0:1788891024.516733:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788891024.516867:0:6482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a67b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6482:1875787997374208:192.168.204.26@tcp:105: 00010000:00010000:2.0:1788891024.516909:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891024.517042:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+8:2394:x1875787987902848:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 8060us (10095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891024.517057:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 97 00000100:00100000:2.0:1788891024.620557:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.620620:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987903232 00000100:00100000:3.0:1788891024.620633:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987903232 00000100:00100000:3.0:1788891024.620712:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 215 00000100:00100000:3.0:1788891024.620724:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+44:12399:x1875787987903232:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891024.620757:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891024.620785:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53b6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de10e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.620910:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53b75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.620927:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53b75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.620941:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53b75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891024.621006:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788891024.621012:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891024.621041:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53b75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.621149:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53b6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de10e expref: 46 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.621167:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53b75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de10e expref: 45 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.621174:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:3.0:1788891024.621177:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788891024.621180:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8a600, rc 0) 00000100:00100000:3.0:1788891024.621323:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+45:12399:x1875787987903232:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 596us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891024.621330:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 215 00000100:00100000:1.0:1788891024.627907:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.628031:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987903488 00000100:00100000:3.0:1788891024.628044:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987903488 00000100:00100000:3.0:1788891024.628297:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 216 00000100:00100000:3.0:1788891024.628310:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+45:12399:x1875787987903488:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891024.628346:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891024.628378:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53b7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de115 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.628570:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53b83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.628589:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53b83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.628604:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53b83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891024.628620:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788891024.628772:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53b7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de115 expref: 48 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.628796:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53b83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de115 expref: 47 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.628806:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34100) 00010000:00010000:3.0:1788891024.628810:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788891024.628815:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080030a00, rc 0) 00000100:00100000:3.0:1788891024.628919:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+47:12399:x1875787987903488:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 611us (1039us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1788891024.628928:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 216 00000100:00100000:1.0:1788891024.634406:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891024.634607:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987903744 00000100:00100000:2.0:1788891024.634632:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987903744 00000100:00100000:2.0:1788891024.634713:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 217 00000100:00100000:2.0:1788891024.634726:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+47:12399:x1875787987903744:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788891024.634760:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891024.634790:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53b91 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de11c expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.634943:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53b98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.634960:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53b98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.634974:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53b98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891024.634991:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788891024.635125:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53b91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de11c expref: 50 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.635146:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53b98 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de11c expref: 49 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.635156:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34100) 00010000:00010000:2.0:1788891024.635159:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788891024.635164:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311000, rc 0) 00000100:00100000:2.0:1788891024.635245:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+49:12399:x1875787987903744:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 522us (852us total) trans 4294967488 rc 0/0 00000100:00100000:2.0:1788891024.635253:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 217 00000100:00100000:1.0:1788891024.636615:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.637197:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987903872 00000100:00100000:3.0:1788891024.637225:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987903872 00000100:00100000:3.0:1788891024.637304:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:3.0:1788891024.637319:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+49:2393:x1875787987903872:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891024.637783:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891024.637820:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53b83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de115 expref: 49 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.637848:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34100) 00010000:00010000:3.0:1788891024.637855:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891024.637948:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+48:2393:x1875787987903872:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 633us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891024.637956:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:1.0:1788891024.643865:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.644949:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987904000 00000100:00100000:3.0:1788891024.645039:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987904000 00000100:00100000:3.0:1788891024.645132:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:3.0:1788891024.645145:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+8:2392:x1875787987904000:12345-192.168.204.26@tcp:1:lfs.0 00010000:00010000:3.0:1788891024.645206:0:8410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000367750f1/0xa66601b03fd53ba6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.645231:0:8410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa84e4d7/0xa66601b03fd53b67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de107 expref: 8 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.645240:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891024.645245:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788891024.645249:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000367750f1/0xa66601b03fd53ba6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.645318:0:8410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa84e4d7/0xa66601b03fd53b67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de107 expref: 8 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.645335:0:8410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa84e4d7/0xa66601b03fd53b67 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de107 expref: 8 pid: 8596 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891024.645354:0:8410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8410:1875787997374336:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788891024.645569:0:8410:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090028480 going to sleep for 11 seconds 00000100:00100000:1.0:1788891024.654023:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.654105:0:8410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8410:1875787997374336:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891024.654135:0:8410:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000367750f1/0xa66601b03fd53ba6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891024.654147:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987904128 00000100:00100000:2.0:1788891024.654157:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987904128 00002000:00100000:2.0:1788891024.654209:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff924f823eaa00 x1875787987904128/t0(0) o4->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:75/0 lens 504/0 e 0 to 0 dl 1788891035 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788891024.654219:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f823eaa00 with x1875787987904128 ext(0->8) 00010000:00010000:2.0:1788891024.654226:0:8415:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fa84e4d7/0xa66601b03fd53b67 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de107 expref: 9 pid: 8596 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.654240:0:8415:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fa84e4d7/0xa66601b03fd53b67 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de107 expref: 9 pid: 8596 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891024.654248:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff924f823eaa00 00000100:00100000:2.0:1788891024.654288:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:2.0:1788891024.654299:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df03475d-d91a-4e91-8125-742ac4d4c589+9:2393:x1875787987904128:12345-192.168.204.26@tcp:4:lfs.0 00000100:00100000:2.0:1788891024.657258:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df03475d-d91a-4e91-8125-742ac4d4c589+11:2393:x1875787987904128:12345-192.168.204.26@tcp:4:lfs.0 Request processed in 2947us (3231us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788891024.657272:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 3 00002000:00100000:2.0:1788891024.657284:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff924f823eaa00 x1875787987904128/t4294967309(0) o4->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:75/0 lens 504/448 e 0 to 0 dl 1788891035 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788891024.657295:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f823eaa00 with x1875787987904128 ext(0->8) 00010000:00010000:2.0:1788891024.657305:0:8415:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fa84e4d7/0xa66601b03fd53b67 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de107 expref: 11 pid: 8596 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.657322:0:8415:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fa84e4d7/0xa66601b03fd53b67 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de107 expref: 11 pid: 8596 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891024.657348:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff924f823eaa00 00000100:00100000:0.0:1788891024.664244:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.664634:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987904256 00000100:00100000:3.0:1788891024.664647:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987904256 00010000:00010000:3.0:1788891024.664702:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa84e4d7/0xa66601b03fd53b67 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de107 expref: 11 pid: 8596 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891024.664757:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 98 00000100:00100000:3.0:1788891024.664782:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+11:2394:x1875787987904256:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891024.664804:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788891024.664834:0:6483:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788891024.664837:0:6483:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788891024 00002000:00010000:3.0:1788891024.664840:0:6483:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788891024 00002000:00010000:3.0:1788891024.664842:0:6483:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788891024 00002000:00010000:3.0:1788891024.664866:0:6483:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788891024.664874:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa84e4d7/0xa66601b03fd53b67 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de107 expref: 11 pid: 8596 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.664905:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa84e4d7/0xa66601b03fd53b67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de107 expref: 11 pid: 8596 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.664939:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa84e4d7/0xa66601b03fd53b67 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de107 expref: 11 pid: 8596 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.664968:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788891024.664975:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788891024.664983:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000367750f1/0xa66601b03fd53ba6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.664996:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000367750f1/0xa66601b03fd53ba6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.665037:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891024.665083:0:8410:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000367750f1/0xa66601b03fd53ba6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.665094:0:8410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000367750f1/0xa66601b03fd53ba6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.665134:0:8410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000367750f1/0xa66601b03fd53ba6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.665142:0:8410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000367750f1/0xa66601b03fd53ba6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.665151:0:8410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000367750f1/0xa66601b03fd53ba6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891024.665322:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+10:2394:x1875787987904256:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 552us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891024.665331:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 98 00010000:00010000:2.0:1788891024.665919:0:8410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030a00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891024.665924:0:8410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000367750f1/0xa66601b03fd53ba6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.665933:0:8410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000367750f1/0xa66601b03fd53ba6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.665947:0:8410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000367750f1/0xa66601b03fd53ba6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.665969:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000367750f1/0xa66601b03fd53ba6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891024.666030:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+9:2392:x1875787987904000:12345-192.168.204.26@tcp:1:lfs.0 Request processed in 20888us (22177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891024.666039:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:1.0:1788891024.668968:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891024.669302:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987904512 00000100:00100000:0.0:1788891024.669321:0:14588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987904512 00000100:00100000:0.0:1788891024.669454:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 56 00000100:00100000:0.0:1788891024.669467:0:14588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090478050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+48:12399:x1875787987904512:12345-192.168.204.26@tcp:35:lfs.0 00000004:00010000:0.0:1788891024.669600:0:14588:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53b98 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de11c expref: 48 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788891024.669931:0:14588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788891024.669966:0:14588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1788891024.670371:0:14588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:0.0:1788891024.670413:0:14588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53bad lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891024.670428:0:14588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53b52 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0f9 expref: 52 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891024.670437:0:14588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53bad lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891024.670479:0:14588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53b52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0f9 expref: 52 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891024.670503:0:14588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53b52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0f9 expref: 52 pid: 12407 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891024.670518:0:14588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1262680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14588:1875787997374464:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891024.670633:0:14588:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788891024.673245:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891024.673440:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987904640 00000100:00100000:0.0:1788891024.673446:0:14588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1262680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14588:1875787997374464:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891024.673449:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987904640 00010000:00010000:0.0:1788891024.673480:0:14588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53bad lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.673496:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53b52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0f9 expref: 53 pid: 12407 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891024.673571:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 99 00000100:00100000:2.0:1788891024.673582:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+53:2394:x1875787987904640:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891024.673599:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891024.673608:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53b52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0f9 expref: 53 pid: 12407 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.673623:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53b52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0f9 expref: 53 pid: 12407 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.673650:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53b52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0f9 expref: 53 pid: 12407 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.673668:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34100) 00010000:00010000:2.0:1788891024.673673:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53bad lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.673706:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53bad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.673714:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53bad lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.673747:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788891024.673894:0:14588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53bad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891024.673902:0:14588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53bad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891024.673986:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+52:2394:x1875787987904640:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 405us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891024.673995:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 99 00000001:00080000:0.0:1788891024.674015:0:14588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:0.0:1788891024.674130:0:14588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1788891024.674399:0:14588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1262680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14588:1875787997374592:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1788891024.674454:0:14588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891024.675466:0:14588:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847300 going to sleep for 11 seconds 00000100:00100000:2.0:1788891024.675850:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997374592 00000100:00100000:2.0:1788891024.675861:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997374592 00000100:00100000:2.0:1788891024.676004:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788891024.676015:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14588:x1875787997374592:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00080000:1.0:1788891024.676017:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788891024.676148:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14588:x1875787997374592:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 134us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891024.676164:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788891024.676294:0:14588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1262680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14588:1875787997374592:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1788891024.676473:0:14588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:1.0:1788891024.676571:0:14588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823eb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14588:1875787997374720:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788891024.676609:0:14588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891024.676640:0:14588:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508a7da540 going to sleep for 11 seconds 00000100:00100000:2.0:1788891024.676648:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997374720 00000100:00100000:2.0:1788891024.676653:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997374720 00000100:00100000:2.0:1788891024.676685:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788891024.676692:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14588:x1875787997374720:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1788891024.676820:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:14588:x1875787997374720:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 128us (209us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788891024.676876:0:14588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823eb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14588:1875787997374720:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1788891024.676926:0:14588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00000100:00100000:2.0:1788891024.676939:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00010000:00010000:1.0:1788891024.676959:0:14588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53bad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891024.676969:0:14588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53bad lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891024.676977:0:14588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53bad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891024.676984:0:14588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891024.676989:0:14588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53bad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891024.676998:0:14588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53bad lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891024.677125:0:14588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34100) 00010000:00010000:1.0:1788891024.677129:0:14588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788891024.677191:0:14588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53bad lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891024.677200:0:14588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53bad lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14588 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788891024.677311:0:14588:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788891024.677379:0:14588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788891024.677392:0:14588:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 246921867968ns, next at 247921865240ns, rc = 0 00000001:00080000:1.0:1788891024.677398:0:14588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:1.0:1788891024.677425:0:14588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34100) 00010000:00010000:1.0:1788891024.677428:0:14588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788891024.677436:0:14588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53b98 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de11c expref: 56 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891024.678288:0:14588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090478050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+55:12399:x1875787987904512:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 8815us (9326us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788891024.678301:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 56 00000020:00080000:1.0:1788891024.678308:0:14588:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788891024.682497:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891024.684312:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987904768 00000100:00100000:2.0:1788891024.684330:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987904768 00000100:00100000:2.0:1788891024.684422:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 218 00000100:00100000:2.0:1788891024.684451:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+55:12399:x1875787987904768:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788891024.684486:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891024.684514:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd53bb4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de123 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.684732:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd53bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de123 expref: 56 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.684750:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd53bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de123 expref: 56 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.684778:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:2.0:1788891024.684782:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788891024.684786:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311800, rc 0) 00000100:00100000:2.0:1788891024.684873:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+56:12399:x1875787987904768:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 424us (2396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891024.684881:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 218 00000100:00100000:2.0:1788891024.690426:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891024.690467:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987905024 00000100:00100000:1.0:1788891024.690478:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987905024 00000100:00100000:1.0:1788891024.690565:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 57 00000100:00100000:1.0:1788891024.690576:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+56:12399:x1875787987905024:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:1.0:1788891024.690820:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+57:12399:x1875787987905024:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 245us (404us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788891024.690828:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 57 00000040:00080000:2.0:1788891024.700429:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788891024.700442:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788891024.700580:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788891024.700588:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788891024.758489:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.758596:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987905152 00000100:00100000:3.0:1788891024.758607:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987905152 00000100:00100000:3.0:1788891024.758664:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 219 00000100:00100000:3.0:1788891024.758674:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+57:12409:x1875787987905152:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:3.0:1788891024.758757:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53bbb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.758789:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53bbb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.758804:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53bbb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.758817:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53bc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.758824:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.758831:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.758986:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.758994:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759000:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788891024.759046:0:6495:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759057:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53bbb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759074:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53bbb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759193:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53bbb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759200:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891024.759204:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53bbb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759211:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53bbb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759223:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:3.0:1788891024.759226:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891024.759231:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53bbb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759238:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53bbb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759252:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759258:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53bc2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759263:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759268:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080031c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891024.759270:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759285:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759292:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff924f82e34e00) 00010000:00010000:3.0:1788891024.759294:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891024.759297:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53bc2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759302:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53bc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759310:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759316:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bc9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759321:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759325:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891024.759327:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759331:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759336:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:3.0:1788891024.759338:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891024.759340:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bc9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.759352:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bc9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891024.759440:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+57:12409:x1875787987905152:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 767us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891024.759449:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 219 00000100:00100000:0.0:1788891024.791667:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891024.796995:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987905408 00000100:00100000:2.0:1788891024.797014:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987905408 00000100:00100000:2.0:1788891024.797098:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 220 00000100:00100000:2.0:1788891024.797111:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+57:12412:x1875787987905408:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788891024.797135:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891024.797173:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53bd0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de12a expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797273:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53bd7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797288:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53bd7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797300:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53bd7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797312:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53bde lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797320:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53bde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797327:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53bde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797455:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53be5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797463:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53be5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797470:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53be5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891024.797480:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788891024.797594:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53bd7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797612:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53bd7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797619:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53bd7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797624:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891024.797629:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53bd7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797636:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53bd7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797648:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:2.0:1788891024.797651:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891024.797656:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53bd7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797661:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53bd7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797675:0:12407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53bde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797681:0:12407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53bde lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797687:0:12407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53bde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797691:0:12407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891024.797700:0:12407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53bde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797707:0:12407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53bde lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797715:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff924f82e34e00) 00010000:00010000:2.0:1788891024.797718:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891024.797721:0:12407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53bde lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797727:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53bde lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797765:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53bd0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de12a expref: 60 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797779:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53be5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de12a expref: 59 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.797787:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:2.0:1788891024.797789:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891024.797791:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311400, rc 0) 00000100:00100000:2.0:1788891024.797866:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+59:12412:x1875787987905408:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 758us (6209us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1788891024.797874:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 220 00000100:00100000:0.0:1788891024.805516:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.805677:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987905536 00000100:00100000:3.0:1788891024.805688:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987905536 00000100:00100000:3.0:1788891024.805747:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 221 00000100:00100000:3.0:1788891024.805758:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+59:12412:x1875787987905536:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:3.0:1788891024.805825:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bf3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.805842:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.805854:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.805898:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.805905:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bf3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.805911:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.805916:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891024.805920:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.805941:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bf3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.805953:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:3.0:1788891024.805956:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891024.805962:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bf3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.805967:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bf3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891024.806051:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+59:12412:x1875787987905536:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 294us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891024.806068:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 221 00000100:00100000:1.0:1788891024.811979:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891024.812075:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987905792 00000100:00100000:0.0:1788891024.812093:0:14588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987905792 00000100:00100000:0.0:1788891024.812154:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 58 00000100:00100000:0.0:1788891024.812165:0:14588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+59:12412:x1875787987905792:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788891024.812430:0:14588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+60:12412:x1875787987905792:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 266us (461us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788891024.812439:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 58 00000100:00100000:0.0:1788891024.879875:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.880124:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987906048 00000100:00100000:3.0:1788891024.880135:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987906048 00000100:00100000:3.0:1788891024.880195:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 222 00000100:00100000:3.0:1788891024.880206:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+60:12422:x1875787987906048:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:3.0:1788891024.880232:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891024.880235:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788891024.880273:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53b75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de10e expref: 60 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.880295:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:3.0:1788891024.880300:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788891024.880313:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bfa lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de131 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.880432:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c01 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.880446:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53be5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de12a expref: 60 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.880455:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c01 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.880491:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53be5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de12a expref: 60 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.880504:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53be5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de12a expref: 60 pid: 12407 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891024.880517:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6495:1875787997374848:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788891024.880977:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090028480 going to sleep for 11 seconds 00000100:00100000:3.0:1788891024.885365:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6495:1875787997374848:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891024.885397:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c01 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891024.886456:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.886675:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987906176 00000100:00100000:3.0:1788891024.886683:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987906176 00010000:00010000:3.0:1788891024.886719:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53be5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de12a expref: 61 pid: 12407 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891024.886767:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 100 00000100:00100000:3.0:1788891024.886791:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf785c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+61:2393:x1875787987906176:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891024.886806:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891024.886813:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53be5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de12a expref: 61 pid: 12407 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.886832:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53be5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de12a expref: 61 pid: 12407 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.886854:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53be5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de12a expref: 61 pid: 12407 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.886870:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:3.0:1788891024.886875:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c01 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.886901:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.886909:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c01 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.886932:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891024.886988:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf785c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+60:2393:x1875787987906176:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 199us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891024.886997:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 100 00010000:00010000:0.0:1788891024.888386:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891024.888399:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891024.888421:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788891024.888674:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53bfa lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de131 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891024.888728:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c01 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de131 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891024.888738:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:0.0:1788891024.888741:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788891024.888744:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080031c00, rc 0) 00000100:00100000:0.0:1788891024.889265:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+60:12422:x1875787987906048:12345-192.168.204.26@tcp:101:bash.0 Request processed in 9060us (9398us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788891024.889274:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 222 00000100:00100000:0.0:1788891024.893899:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891024.893980:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987906304 00000100:00100000:2.0:1788891024.893990:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987906304 00000100:00100000:2.0:1788891024.894351:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 223 00000100:00100000:2.0:1788891024.894363:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+60:12422:x1875787987906304:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788891024.894405:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891024.894427:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53c0f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de138 expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.894464:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53c16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.894478:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53c16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.894488:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53c16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.895613:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53c0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de138 expref: 62 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.895635:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53c16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de138 expref: 61 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.895645:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:2.0:1788891024.895648:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788891024.895652:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310e00, rc 0) 00000100:00100000:2.0:1788891024.895783:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+61:12422:x1875787987906304:12345-192.168.204.26@tcp:101:bash.0 Request processed in 1421us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891024.895790:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 223 00000100:00100000:2.0:1788891024.907384:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891024.907487:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987906560 00000100:00100000:1.0:1788891024.907497:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987906560 00000100:00100000:1.0:1788891024.909256:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 224 00000100:00100000:1.0:1788891024.909291:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+61:12422:x1875787987906560:12345-192.168.204.26@tcp:36:bash.0 00010000:00010000:1.0:1788891024.909539:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd53c1d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891024.909557:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd53c1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891024.909569:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd53c1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788891024.909612:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:1.0:1788891024.909634:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000481eb8f1 reply state 00000000d2dce907 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd53c1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891024.909648:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd53c1d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891024.909656:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:1.0:1788891024.909659:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788891024.909663:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788891024.910029:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+64:12422:x1875787987906560:12345-192.168.204.26@tcp:36:bash.0 Request processed in 742us (2655us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1788891024.910037:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 224 00000020:00080000:1.0:1788891024.910041:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788891024.913944:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891024.914093:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987906688 00000100:00100000:2.0:1788891024.914104:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987906688 00000100:00100000:2.0:1788891024.914167:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 225 00000100:00100000:2.0:1788891024.914191:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8382dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+64:12422:x1875787987906688:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788891024.914214:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891024.914234:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53c24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de13f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.914350:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.914364:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c01 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de131 expref: 65 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.914373:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c2b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.914417:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c01 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de131 expref: 65 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.914431:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c01 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de131 expref: 65 pid: 6495 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891024.914443:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83935f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6496:1875787997374976:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891024.914573:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788891024.919574:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.919673:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987906816 00000100:00100000:3.0:1788891024.919683:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987906816 00010000:00010000:3.0:1788891024.919723:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c01 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de131 expref: 66 pid: 6495 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891024.919779:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 101 00000100:00100000:3.0:1788891024.919789:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+66:2394:x1875787987906816:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891024.919806:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891024.919815:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c01 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de131 expref: 66 pid: 6495 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.919828:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c01 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de131 expref: 66 pid: 6495 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.919862:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:3.0:1788891024.919868:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.919891:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.919899:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c2b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.919919:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891024.919972:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+66:2394:x1875787987906816:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 184us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891024.919980:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 101 00010000:00010000:2.0:1788891024.920137:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c01 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de131 expref: 65 pid: 6495 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891024.920157:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83935f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6496:1875787997374976:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891024.920175:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.920190:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.920193:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891024.920240:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788891024.920243:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788891024.920259:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.920282:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53c24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de13f expref: 65 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.920292:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de13f expref: 64 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.920297:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:2.0:1788891024.920299:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891024.920301:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310400, rc 0) 00000100:00100000:2.0:1788891024.920509:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8382dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+64:12422:x1875787987906688:12345-192.168.204.26@tcp:101:bash.0 Request processed in 6319us (6575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891024.920517:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 225 00000100:00100000:0.0:1788891024.923166:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.923274:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987907072 00000100:00100000:3.0:1788891024.923283:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987907072 00000100:00100000:3.0:1788891024.923366:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:3.0:1788891024.923377:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+64:12422:x1875787987907072:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:3.0:1788891024.923628:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+65:12422:x1875787987907072:12345-192.168.204.26@tcp:35:bash.0 Request processed in 253us (471us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788891024.923637:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:0.0:1788891024.970345:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891024.971291:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987907200 00000100:00100000:2.0:1788891024.971302:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987907200 00000100:00100000:2.0:1788891024.971395:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 226 00000100:00100000:2.0:1788891024.971406:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+65:12428:x1875787987907200:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788891024.971431:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891024.971465:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53c32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de146 expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.971568:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53c39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.971583:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53c39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.971594:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53c39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891024.971645:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788891024.971649:0:9362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788891024.971667:0:9362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53c39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.971692:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311200/0xa66601b03fd53c32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de146 expref: 67 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.971711:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53c39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de146 expref: 66 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.971720:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:2.0:1788891024.971723:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788891024.971726:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311600, rc 0) 00000100:00100000:2.0:1788891024.971794:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+66:12428:x1875787987907200:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 389us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891024.971801:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 226 00000100:00100000:1.0:1788891024.974685:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891024.974786:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987907328 00000100:00100000:2.0:1788891024.974808:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987907328 00000100:00100000:2.0:1788891024.974858:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 227 00000100:00100000:2.0:1788891024.974868:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+66:12428:x1875787987907328:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788891024.974896:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891024.974916:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53c40 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de14d expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.974985:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53c47 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.974998:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53c47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975009:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53c47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975020:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53c4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975027:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53c4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975031:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53c4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975136:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53c55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975143:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53c55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975148:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53c55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891024.975184:0:14295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788891024.975188:0:14295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788891024.975200:0:14295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53c55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975209:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53c55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975214:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53c47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975218:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53c47 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975222:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53c47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975225:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891024.975228:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53c47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975233:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53c47 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975241:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:2.0:1788891024.975253:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891024.975256:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53c47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975260:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53c47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975277:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53c4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975281:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53c4e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975285:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53c4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975287:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891024.975289:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53c4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975292:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53c4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975296:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff924f82e34e00) 00010000:00010000:2.0:1788891024.975298:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891024.975299:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53c4e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975302:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311000/0xa66601b03fd53c4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975320:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53c40 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de14d expref: 68 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975328:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53c55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de14d expref: 67 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.975340:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:2.0:1788891024.975341:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891024.975343:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310200, rc 0) 00000100:00100000:2.0:1788891024.975402:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+67:12428:x1875787987907328:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 534us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891024.975409:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 227 00000100:00100000:0.0:1788891024.980832:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891024.980891:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.981206:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987907584 00000100:00100000:3.0:1788891024.981216:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987907584 00000100:00100000:3.0:1788891024.981329:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 228 00000100:00100000:3.0:1788891024.981339:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+67:12428:x1875787987907584:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891024.981358:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891024.981376:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53c5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de154 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.981477:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.981491:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c2b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de13f expref: 68 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.981499:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53c55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de14d expref: 68 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.981507:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.981558:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53c55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de14d expref: 68 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.981570:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53c55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de14d expref: 68 pid: 14295 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891024.981597:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6495:1875787997375104:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891024.981735:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de13f expref: 68 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.981744:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de13f expref: 68 pid: 6496 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891024.981753:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6495:1875787997375232:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788891024.981834:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090028c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788891024.982025:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987907712 00000100:00100000:2.0:1788891024.982031:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987907712 00010000:00010000:2.0:1788891024.982057:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53c55 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de14d expref: 69 pid: 14295 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891024.982090:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 102 00000100:00100000:2.0:1788891024.982098:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087acec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+69:2393:x1875787987907712:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891024.982108:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891024.982114:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53c55 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de14d expref: 69 pid: 14295 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.982127:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53c55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de14d expref: 69 pid: 14295 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.982146:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:2.0:1788891024.982150:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.982158:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.982175:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891024.982204:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087acec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+69:2393:x1875787987907712:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 106us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891024.982211:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 102 00010000:00010000:3.0:1788891024.984405:0:6495:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.26@tcp) returned -22 from blocking AST (req@000000003b315897 x1875787997375104) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53c55 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de14d expref: 68 pid: 14295 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.984427:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310200/0xa66601b03fd53c55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de14d expref: 68 pid: 14295 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891024.984443:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6495:1875787997375104:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788891024.984455:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6495:1875787997375232:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891024.984474:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:3.0:1788891024.984479:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.984487:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.984511:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891024.987508:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891024.987640:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987907840 00000100:00100000:2.0:1788891024.987650:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987907840 00010000:00010000:2.0:1788891024.987690:0:10317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de13f expref: 68 pid: 6496 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891024.987725:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 103 00000100:00100000:2.0:1788891024.987736:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83baf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+68:2394:x1875787987907840:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891024.987750:0:10317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891024.987757:0:10317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de13f expref: 68 pid: 6496 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.987785:0:10317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de13f expref: 68 pid: 6496 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.987808:0:10317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de13f expref: 68 pid: 6496 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.987823:0:10317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:2.0:1788891024.987828:0:10317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.987838:0:10317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.987858:0:10317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891024.987892:0:10317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891024.987953:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83baf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+67:2394:x1875787987907840:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 219us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891024.987962:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 103 00010000:00010000:3.0:1788891024.988741:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.988752:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891024.988894:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788891024.989025:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53c5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de154 expref: 68 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.989042:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de154 expref: 67 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.989049:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:3.0:1788891024.989332:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788891024.989336:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080031c00, rc 0) 00000100:00100000:3.0:1788891024.989435:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+67:12428:x1875787987907584:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 8097us (8612us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788891024.989444:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 228 00000100:00100000:0.0:1788891024.993027:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.993061:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987908096 00000100:00100000:3.0:1788891024.993072:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987908096 00000100:00100000:3.0:1788891024.993182:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:3.0:1788891024.993193:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+67:12428:x1875787987908096:12345-192.168.204.26@tcp:103:lfs.0 00010000:00010000:3.0:1788891024.993209:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891024.993243:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311800/0xa66601b03fd53bb4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de123 expref: 67 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.993262:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:3.0:1788891024.993266:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891024.993324:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+66:12428:x1875787987908096:12345-192.168.204.26@tcp:103:lfs.0 Request processed in 133us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891024.993332:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:0.0:1788891024.996655:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891024.996770:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987908224 00000100:00100000:3.0:1788891024.996779:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987908224 00000100:00100000:3.0:1788891024.996837:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 229 00000100:00100000:3.0:1788891024.996848:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+66:12428:x1875787987908224:12345-192.168.204.26@tcp:58:lfs.0 00010000:00010000:3.0:1788891024.996980:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53c71 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.996997:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53c71 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891024.997010:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53c71 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788891024.997110:0:12407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788891024.997207:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+66:12428:x1875787987908224:12345-192.168.204.26@tcp:58:lfs.0 Request processed in 359us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891024.997215:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 229 00000100:00100000:0.0:1788891024.999445:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891024.999636:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987908352 00000100:00100000:1.0:1788891024.999644:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987908352 00000100:00100000:1.0:1788891024.999758:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 230 00000100:00100000:1.0:1788891024.999768:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+66:12428:x1875787987908352:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788891024.999802:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891024.999823:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53c78 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de15b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891024.999876:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53c71 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891024.999897:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53c78 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de15b expref: 67 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891024.999916:0:6497:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53c71 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891024.999930:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53c78 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de15b expref: 67 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891024.999946:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:1.0:1788891024.999949:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788891024.999953:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53c78 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de15b expref: 67 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891024.999961:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857df400, rc 0) 00000100:00100000:1.0:1788891025.000020:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+67:12428:x1875787987908352:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 253us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891025.000027:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 230 00000100:00100000:3.0:1788891025.019855:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997375360:0@lo:400:kworker.0 00000100:00100000:0.0:1788891025.019866:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788891025.019896:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997375616:0@lo:400:kworker.0 00000100:00100000:0.0:1788891025.019953:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891025.019954:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891025.020023:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997375488:0@lo:400:kworker.0 00000100:00100000:2.0:1788891025.020102:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997375360 00000100:00100000:2.0:1788891025.020109:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997375360 00000100:00100000:2.0:1788891025.020157:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788891025.020166:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3627:x1875787997375360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891025.021928:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997375616 00000100:00100000:3.0:1788891025.021955:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997375616 00000100:00100000:3.0:1788891025.022001:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788891025.022010:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997375616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891025.022159:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997375616:12345-0@lo:400:kworker.0 Request processed in 150us (2211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891025.022168:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788891025.023163:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997375616:0@lo:400:kworker.0 00000100:00100000:1.0:1788891025.023269:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891025.023372:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3627:x1875787997375360:12345-0@lo:400:kworker.0 Request processed in 3205us (3422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891025.023381:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788891025.023408:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788891025.023416:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788891025.023418:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997375872:0@lo:400:kworker.0 00000100:00100000:2.0:1788891025.023422:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997375744:0@lo:400:kworker.0 00000100:00100000:2.0:1788891025.023448:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891025.023448:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891025.023482:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997376000:0@lo:400:kworker.0 00000100:00100000:1.0:1788891025.024064:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891025.024186:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788891025.024192:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997376384:0@lo:400:kworker.0 00000100:00100000:1.0:1788891025.024222:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891025.024260:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1875787997376512:0@lo:400:kworker.0 00000100:00100000:1.0:1788891025.024282:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891025.024328:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997376128:0@lo:400:kworker.0 00000100:00100000:0.0:1788891025.024364:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997376384 00000100:00100000:0.0:1788891025.024369:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997376384 00000100:00100000:0.0:1788891025.024415:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788891025.024424:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3628:x1875787997376384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891025.024467:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3628:x1875787997376384:12345-0@lo:400:kworker.0 Request processed in 45us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891025.024473:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1788891025.024492:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891025.024502:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997376256:0@lo:400:kworker.0 00000100:00100000:0.0:1788891025.024541:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891025.024741:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997375872 00000100:00100000:3.0:1788891025.024746:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997375872 00000100:00100000:3.0:1788891025.024782:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788891025.024790:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997375872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891025.024829:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997375872:12345-0@lo:400:kworker.0 Request processed in 40us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891025.024835:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788891025.024867:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997375360:0@lo:400:kworker.0 00000100:00100000:3.0:1788891025.024899:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997376256 00000100:00100000:3.0:1788891025.024902:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997376256 00000100:00100000:3.0:1788891025.024945:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788891025.024952:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997376256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891025.025032:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997376256:0@lo:400:kworker.0 00000100:00100000:1.0:1788891025.025038:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997376384:0@lo:400:kworker.0 00000100:00100000:1.0:1788891025.025048:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997375872:0@lo:400:kworker.0 00000100:00100000:0.0:1788891025.025050:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891025.025072:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997376256:12345-0@lo:400:kworker.0 Request processed in 33us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891025.025078:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1788891025.025092:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788891025.025100:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997376896:0@lo:400:kworker.0 00000100:00100000:1.0:1788891025.025119:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997376768:0@lo:400:kworker.0 00000100:00100000:3.0:1788891025.025124:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891025.025140:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891025.025150:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997376896 00000100:00100000:3.0:1788891025.025153:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997376896 00000100:00100000:1.0:1788891025.025154:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788891025.025158:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997376640:0@lo:400:kworker.0 00000100:00100000:3.0:1788891025.025171:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997376768 00000100:00100000:1.0:1788891025.025190:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788891025.025195:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997376768 00000100:00100000:1.0:1788891025.025196:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3627:x1875787997376896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891025.025221:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788891025.025227:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997376768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891025.025229:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3627:x1875787997376896:12345-0@lo:400:kworker.0 Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891025.025234:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788891025.025270:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997376768:12345-0@lo:400:kworker.0 Request processed in 43us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891025.025277:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788891025.025285:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997375488 00000100:00080000:3.0:1788891025.025290:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788891025.025290:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997375488 00000100:00100000:2.0:1788891025.025300:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997375744 00000100:00100000:2.0:1788891025.025302:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997375744 00000100:00100000:3.0:1788891025.025305:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997376896:0@lo:400:kworker.0 00000100:00100000:2.0:1788891025.025325:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997376000 00000100:00100000:2.0:1788891025.025329:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997376000 00000100:00100000:2.0:1788891025.025350:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997376512 00000100:00100000:2.0:1788891025.025353:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997376512 00000100:00100000:1.0:1788891025.026271:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997376128 00000100:00100000:1.0:1788891025.026278:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997376128 00000100:00100000:1.0:1788891025.026313:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788891025.026315:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891025.026325:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788891025.026326:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997375744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891025.026339:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875787997376000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891025.026399:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997375744:12345-0@lo:400:kworker.0 Request processed in 77us (2949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891025.026403:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875787997376000:12345-0@lo:400:kworker.0 Request processed in 67us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891025.026411:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788891025.026418:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788891025.026431:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997376640 00000100:00100000:1.0:1788891025.026436:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997376640 00000100:00100000:3.0:1788891025.026442:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788891025.026452:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997375488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891025.026458:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997376768:0@lo:400:kworker.0 00000100:00100000:1.0:1788891025.026466:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788891025.026476:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875787997376512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891025.026497:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997375744:0@lo:400:kworker.0 00000100:00100000:3.0:1788891025.026500:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997375488:12345-0@lo:400:kworker.0 Request processed in 49us (3230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891025.026513:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788891025.026520:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875787997376512:12345-0@lo:400:kworker.0 Request processed in 46us (2234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891025.026549:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788891025.026555:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788891025.026565:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997376128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891025.026569:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788891025.026581:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875787997376640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891025.026611:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997376128:12345-0@lo:400:kworker.0 Request processed in 48us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891025.026620:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788891025.026636:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875787997376640:12345-0@lo:400:kworker.0 Request processed in 56us (323us total) trans 0 rc 0/0 00010000:00080000:0.0:1788891025.026638:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83b28380 x1875787997376128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891025.026652:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788891025.026657:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997376128:0@lo:400:kworker.0 00000100:00080000:3.0:1788891025.026692:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788891025.026697:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891025.026711:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1875787997376512:0@lo:400:kworker.0 00010000:00080000:0.0:1788891025.026780:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83b2a680 x1875787997376640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891025.026790:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997376640:0@lo:400:kworker.0 00000100:00100000:1.0:1788891025.027745:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997376000:0@lo:400:kworker.0 00000100:00100000:1.0:1788891025.027758:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997375488:0@lo:400:kworker.0 00010000:00010000:3.0:1788891025.339944:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891025.532707:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83934700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997377024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788891025.532790:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891025.534329:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997377152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788891025.534385:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891025.534542:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997377024 00000100:00100000:2.0:1788891025.534550:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997377024 00000100:00100000:2.0:1788891025.534603:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997377152 00000100:00100000:2.0:1788891025.534607:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997377152 00000100:00100000:2.0:1788891025.534641:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788891025.534649:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3628:x1875787997377024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788891025.534672:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788891025.534720:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3628:x1875787997377024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (1929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891025.534727:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788891025.534744:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788891025.534750:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83baea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997377152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788891025.534760:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788891025.536691:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83934700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997377024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788891025.536980:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83baea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997377152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2228us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891025.536990:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788891025.539520:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997377152:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1788891025.723774:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788891025.723852:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788891025.723892:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788891025.723901:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788891025.724027:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83935500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875787997377280:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788891025.727048:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788891025.736981:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891025.737234:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987908480 00000100:00100000:3.0:1788891025.737248:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987908480 00000100:00100000:2.0:1788891025.737454:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83935500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875787997377280:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788891025.737663:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 231 00000100:00100000:3.0:1788891025.737676:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+67:12429:x1875787987908480:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788891025.737717:0:12407:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788891025.737859:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+67:12429:x1875787987908480:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 185us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891025.737879:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 231 00000100:00100000:0.0:1788891025.741103:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891025.741209:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987908608 00000100:00100000:3.0:1788891025.741224:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987908608 00000100:00100000:3.0:1788891025.741304:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 232 00000100:00100000:3.0:1788891025.741315:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+67:12429:x1875787987908608:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788891025.741391:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53c7f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741409:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53c7f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741421:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53c7f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741435:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53c86 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741442:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53c86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741464:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53c86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741489:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53c8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741498:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53c8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741505:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53c8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891025.741577:0:14295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788891025.741582:0:14295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891025.741594:0:14295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53c8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741605:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53c7f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741610:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53c7f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741617:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53c7f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741623:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891025.741628:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53c7f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741634:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53c7f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741653:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9250905a3b00) 00010000:00010000:3.0:1788891025.741656:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891025.741661:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53c7f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741668:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53c7f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741683:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53c86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741689:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53c86 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741695:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53c86 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741700:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891025.741702:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53c86 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741707:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53c86 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741714:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff925082bfc700) 00010000:00010000:3.0:1788891025.741716:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891025.741719:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53c86 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741725:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53c86 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741931:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53c8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741938:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53c8d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741944:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53c8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741950:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891025.741953:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53c8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741960:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53c8d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741969:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:3.0:1788891025.741972:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891025.741976:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53c8d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.741981:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53c8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891025.742320:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+67:12429:x1875787987908608:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 Request processed in 1004us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891025.742330:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 232 00000100:00100000:0.0:1788891025.745263:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891025.745340:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987908864 00000100:00100000:2.0:1788891025.745827:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987908864 00000100:00100000:2.0:1788891025.746026:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 233 00000100:00100000:2.0:1788891025.746040:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+67:12429:x1875787987908864:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891025.746070:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891025.746099:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c94 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de162 expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.746277:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53c9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.746298:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53c9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.746313:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53c9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891025.746327:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788891025.746459:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53c9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.746468:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53c9b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.746475:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53c9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.746482:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891025.746487:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53c9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.746496:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53c9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.746511:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:2.0:1788891025.746514:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788891025.746543:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53c9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.746578:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310800/0xa66601b03fd53c9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.746639:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c94 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de162 expref: 69 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.746653:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9250905a3b00) 00010000:00010000:2.0:1788891025.746656:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788891025.746662:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310400/0xa66601b03fd53c94 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de162 expref: 69 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.746675:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310400, rc 0) 00000100:00100000:2.0:1788891025.746768:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+68:12429:x1875787987908864:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 730us (1514us total) trans 4294967506 rc 301/301 00000100:00100000:2.0:1788891025.746777:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 233 00000100:00100000:0.0:1788891025.751481:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891025.751652:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987908992 00000100:00100000:1.0:1788891025.751663:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987908992 00000100:00100000:1.0:1788891025.751840:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 234 00000100:00100000:1.0:1788891025.751852:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+68:12429:x1875787987908992:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788891025.751923:0:6496:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788891025.752231:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+68:12429:x1875787987908992:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 381us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891025.752247:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 234 00000100:00100000:0.0:1788891025.755013:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891025.755159:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987909248 00000100:00100000:1.0:1788891025.755168:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987909248 00000100:00100000:1.0:1788891025.755225:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 235 00000100:00100000:1.0:1788891025.755236:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+68:12429:x1875787987909248:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788891025.755264:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891025.755267:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788891025.755294:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd53c39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de146 expref: 68 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.755313:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:1.0:1788891025.755319:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788891025.755333:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df200/0xa66601b03fd53ca9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de169 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788891025.755762:0:6497:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:1.0:1788891025.755921:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53cb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.755934:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.755944:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.756178:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df200/0xa66601b03fd53ca9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de169 expref: 70 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.756217:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de169 expref: 69 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.756230:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9250b65fdf00) 00010000:00010000:1.0:1788891025.756233:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788891025.756236:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857dfa00, rc 0) 00000100:00100000:1.0:1788891025.756396:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+69:12429:x1875787987909248:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 1161us (1392us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788891025.756404:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 235 00000100:00100000:0.0:1788891025.759704:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891025.761237:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987909504 00000100:00100000:1.0:1788891025.761252:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987909504 00000100:00100000:1.0:1788891025.761323:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 236 00000100:00100000:1.0:1788891025.761333:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+69:12429:x1875787987909504:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788891025.761392:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891025.761420:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfa00/0xa66601b03fd53cb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de169 expref: 69 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761442:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9250b65fdf00) 00010000:00010000:1.0:1788891025.761454:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788891025.761476:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53cbe lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761488:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53cbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761497:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53cbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761547:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53cc5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xed33bb28 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761555:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xed33bb28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761561:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xed33bb28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761608:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53cbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761615:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53cbe lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761621:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53cbe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761628:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857de200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891025.761631:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53cbe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761639:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53cbe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761647:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:1.0:1788891025.761650:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891025.761653:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53cbe lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761659:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de200/0xa66601b03fd53cbe lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761675:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xed33bb28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761681:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53cc5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xed33bb28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761687:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53cc5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xed33bb28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761692:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857de800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891025.761695:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53cc5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xed33bb28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761701:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53cc5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xed33bb28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761709:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xed33bb28 (ffff9250b65fdd00) 00010000:00010000:1.0:1788891025.761712:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891025.761716:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53cc5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xed33bb28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.761722:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53cc5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xed33bb28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891025.761803:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+68:12429:x1875787987909504:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 471us (2109us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788891025.761811:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 236 00000100:00100000:0.0:1788891025.765037:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891025.765923:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987909632 00000100:00100000:3.0:1788891025.765943:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987909632 00000100:00100000:3.0:1788891025.766001:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 237 00000100:00100000:3.0:1788891025.766031:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+68:12429:x1875787987909632:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788891025.766055:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891025.766080:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53ccc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de170 expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.766117:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53cd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.766130:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.766141:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.766253:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53ccc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de170 expref: 70 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.766273:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de170 expref: 69 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.766281:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff925082bfc700) 00010000:00010000:3.0:1788891025.766284:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788891025.766288:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8ac00, rc 0) 00000100:00100000:3.0:1788891025.766359:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+69:12429:x1875787987909632:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 331us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891025.766366:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 237 00000100:00100000:0.0:1788891025.769997:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891025.770121:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987909888 00000100:00100000:3.0:1788891025.770131:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987909888 00000100:00100000:3.0:1788891025.770195:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 238 00000100:00100000:3.0:1788891025.770223:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+69:12429:x1875787987909888:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788891025.770321:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53cda lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.770337:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53cda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.770350:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53cda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788891025.770501:0:14295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1788891025.770510:0:14295:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 248014986700ns, next at 249014984453ns, rc = 0 00000004:00010000:3.0:1788891025.770600:0:14295:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079dcd299 reply state 00000000517d9f26 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53cda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.770614:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53cda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.770622:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff925082bfc700) 00010000:00010000:3.0:1788891025.770624:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788891025.770628:0:14295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788891025.770716:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+71:12429:x1875787987909888:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 496us (726us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1788891025.770723:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 238 00000100:00100000:0.0:1788891025.778936:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891025.779964:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987910016 00000100:00100000:1.0:1788891025.779977:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987910016 00000100:00100000:1.0:1788891025.780051:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 239 00000100:00100000:1.0:1788891025.780073:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+71:12429:x1875787987910016:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788891025.780099:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891025.780122:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53ce1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de177 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.780183:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de177 expref: 72 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.780198:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de177 expref: 72 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.780217:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff925082bfc700) 00010000:00010000:1.0:1788891025.780221:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788891025.780225:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857de800, rc 0) 00000100:00100000:1.0:1788891025.780291:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+72:12429:x1875787987910016:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 220us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891025.780299:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 239 00000100:00100000:0.0:1788891025.784122:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891025.784227:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987910144 00000100:00100000:1.0:1788891025.784238:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987910144 00000100:00100000:1.0:1788891025.784360:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:1.0:1788891025.784370:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+9:2394:x1875787987910144:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788891025.784616:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+10:2394:x1875787987910144:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 247us (503us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788891025.784625:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00080000:3.0:1788891025.786457:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891025.787122:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891025.787268:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987910400 00000100:00100000:1.0:1788891025.787278:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987910400 00000100:00100000:1.0:1788891025.787393:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:1.0:1788891025.787404:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+72:12429:x1875787987910400:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788891025.787656:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+73:12429:x1875787987910400:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 253us (538us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1788891025.787666:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:2.0:1788891025.789746:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891025.789837:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987910656 00000100:00100000:3.0:1788891025.789847:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987910656 00000100:00100000:3.0:1788891025.789920:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 240 00000100:00100000:3.0:1788891025.789931:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+73:12429:x1875787987910656:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788891025.790065:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+73:12429:x1875787987910656:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 137us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891025.790073:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 240 00000100:00100000:2.0:1788891025.792471:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891025.792558:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987910784 00000100:00100000:3.0:1788891025.792568:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987910784 00000100:00100000:3.0:1788891025.792626:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 241 00000100:00100000:3.0:1788891025.792636:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+73:12429:x1875787987910784:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788891025.792654:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891025.792675:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53ce8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de17e expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.792790:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53cef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.792806:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53cef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.792818:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53cef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891025.792873:0:14295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891025.792893:0:14295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53cef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.792919:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030200/0xa66601b03fd53ce8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de17e expref: 75 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.792938:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53cef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de17e expref: 74 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.792964:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff925082bfc700) 00010000:00010000:3.0:1788891025.792967:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788891025.792971:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8a600, rc 0) 00000100:00100000:3.0:1788891025.793033:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+74:12429:x1875787987910784:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 397us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891025.793040:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 241 00000100:00100000:0.0:1788891025.796219:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891025.796466:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987910912 00000100:00100000:3.0:1788891025.796477:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987910912 00000100:00100000:3.0:1788891025.796594:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 71 00000100:00100000:3.0:1788891025.796603:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+10:2393:x1875787987910912:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788891025.796619:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891025.796641:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53cf6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de185 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788891025.796666:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa04f91, blocks: 0x0 00010000:00010000:3.0:1788891025.796684:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=248s v=(0 0) 00010000:00010000:3.0:1788891025.796688:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891025.796696:0:8408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53cf6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de185 expref: 11 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.796714:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53cf6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de185 expref: 11 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.796728:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ede00, rc 0) 00000100:00100000:3.0:1788891025.796793:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+11:2393:x1875787987910912:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 191us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891025.796801:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 71 00000100:00100000:2.0:1788891025.799070:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891025.799158:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987911168 00000100:00100000:1.0:1788891025.799167:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987911168 00000100:00100000:1.0:1788891025.799226:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 242 00000100:00100000:1.0:1788891025.799245:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+74:12429:x1875787987911168:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788891025.799353:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+74:12429:x1875787987911168:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 109us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891025.799360:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 242 00000100:00100000:2.0:1788891025.801833:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891025.801928:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987911296 00000100:00100000:3.0:1788891025.801941:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987911296 00000100:00100000:3.0:1788891025.802008:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 72 00000100:00100000:3.0:1788891025.802019:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+11:12429:x1875787987911296:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788891025.802049:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891025.802072:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd53cfd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de18c expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.802106:0:8410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53cf6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de185 expref: 12 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.802116:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891025.802121:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891025.802126:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd53cfd lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de18c expref: 12 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.802162:0:8410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53cf6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de185 expref: 12 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.802180:0:8410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53cf6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de185 expref: 12 pid: 8408 timeout: 348 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891025.802195:0:8410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8410:1875787997377408:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788891025.802305:0:8410:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090028180 going to sleep for 11 seconds 00000100:00100000:0.0:1788891025.804685:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891025.804784:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987911424 00000100:00100000:1.0:1788891025.804793:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987911424 00010000:00010000:1.0:1788891025.804832:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53cf6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de185 expref: 13 pid: 8408 timeout: 348 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891025.804886:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 104 00000100:00100000:1.0:1788891025.804896:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+13:2393:x1875787987911424:12345-192.168.204.26@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788891025.804903:0:8410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8410:1875787997377408:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891025.804910:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891025.804929:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd53cfd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de18c expref: 13 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.804932:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53cf6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de185 expref: 13 pid: 8408 timeout: 348 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.804945:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53cf6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de185 expref: 13 pid: 8408 timeout: 348 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.805819:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ec600, rc 0) 00010000:00010000:1.0:1788891025.805905:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5ed39a6/0xa66601b03fd53cf6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de185 expref: 13 pid: 8408 timeout: 348 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.805922:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891025.805927:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891025.805935:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd53cfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de18c expref: 12 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.805945:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd53cfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de18c expref: 12 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.805981:0:6481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd53cfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de18c expref: 12 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891025.805996:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b29880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6481:1875787997377536:192.168.204.26@tcp:105: 00000100:00100000:1.0:1788891025.806086:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff925087ad8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788891025.806332:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+12:12429:x1875787987911296:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 4313us (4506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891025.806342:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 72 00000100:00100000:1.0:1788891025.809765:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b29880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6481:1875787997377536:192.168.204.26@tcp:105: 00010000:00010000:1.0:1788891025.809795:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891025.809849:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+11:2393:x1875787987911424:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 4955us (5171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891025.809871:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 104 00000100:00100000:0.0:1788891025.810640:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891025.810739:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987911552 00000100:00100000:2.0:1788891025.810747:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987911552 00002000:00100000:2.0:1788891025.810806:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff924f8416f100 x1875787987911552/t0(0) o4->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:76/0 lens 504/0 e 0 to 0 dl 1788891036 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788891025.810835:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f8416f100 with x1875787987911552 ext(0->12) 00002000:00010000:2.0:1788891025.810840:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924f8416f100 00000100:00100000:2.0:1788891025.810883:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:2.0:1788891025.810891:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df03475d-d91a-4e91-8125-742ac4d4c589+11:2393:x1875787987911552:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788891025.812176:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df03475d-d91a-4e91-8125-742ac4d4c589+13:2393:x1875787987911552:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 Request processed in 1281us (1534us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788891025.812184:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 6 00002000:00100000:2.0:1788891025.812190:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff924f8416f100 x1875787987911552/t4294967321(0) o4->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:76/0 lens 504/448 e 0 to 0 dl 1788891036 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788891025.812197:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f8416f100 with x1875787987911552 ext(0->12) 00002000:00010000:2.0:1788891025.812200:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924f8416f100 00000100:00100000:0.0:1788891025.813910:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891025.813955:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987911680 00000100:00100000:3.0:1788891025.813963:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987911680 00000100:00100000:3.0:1788891025.814027:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 243 00000100:00100000:3.0:1788891025.814045:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+74:12429:x1875787987911680:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788891025.815494:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:1.0:1788891025.815509:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00010000:00010000:3.0:1788891025.815593:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53a02 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815606:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53a02 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815614:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53a02 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815619:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891025.815625:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53a02 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815633:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53a02 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815649:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff925082bfce00) 00010000:00010000:3.0:1788891025.815652:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891025.815668:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53a02 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815675:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd53a02 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815699:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd53aaa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815705:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd53aaa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815710:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd53aaa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815715:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891025.815718:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd53aaa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815723:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd53aaa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815730:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff925082bfc900) 00010000:00010000:3.0:1788891025.815733:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891025.815736:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd53aaa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815741:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310a00/0xa66601b03fd53aaa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815751:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b28 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815756:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b28 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815767:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b28 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815772:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891025.815775:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b28 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815781:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b28 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815787:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff924f82e34e00) 00010000:00010000:3.0:1788891025.815789:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891025.815791:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b28 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815796:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310c00/0xa66601b03fd53b28 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815806:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd53b4b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815811:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd53b4b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815816:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd53b4b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815821:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891025.815824:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd53b4b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815840:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd53b4b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815848:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff924f82e34e00) 00010000:00010000:3.0:1788891025.815851:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891025.815853:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd53b4b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815859:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd53b4b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815886:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd53c1d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815892:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd53c1d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815897:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd53c1d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815902:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857de600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891025.815904:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd53c1d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815910:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd53c1d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815917:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:3.0:1788891025.815919:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891025.815922:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd53c1d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815940:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de600/0xa66601b03fd53c1d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815952:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53cda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815958:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53cda lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815966:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53cda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815970:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891025.815974:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53cda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815979:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53cda lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815986:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff925082bfc700) 00010000:00010000:3.0:1788891025.815988:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788891025.815991:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53cda lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.815996:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030a00/0xa66601b03fd53cda lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788891025.816156:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788891025.816185:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9250830bb780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788891025.816189:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff924f81727800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9250830bbf00 00000020:00080000:1.0:1788891025.816192:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff924f81727a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff924f831ed600 00000020:00080000:1.0:1788891025.816229:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff925090028e40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788891025.816233:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff924f839b3800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff925090028600 00000100:00100000:3.0:1788891025.816236:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997377664:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1788891025.816236:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff924f839b3e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff924f8302f400 00000100:00100000:3.0:1788891025.816299:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891025.816360:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+21:12429:x1875787987911680:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 Request processed in 2319us (2453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891025.816371:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 243 00000020:00080000:1.0:1788891025.816403:0:6527:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:0.0:1788891025.816409:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997377792:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788891025.816441:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788891025.816455:0:6527:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788891025.816473:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997377664 00000100:00100000:0.0:1788891025.816479:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997377664 00000100:00100000:0.0:1788891025.816509:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997377792 00000100:00100000:0.0:1788891025.816512:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997377792 00000100:00100000:0.0:1788891025.816551:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788891025.816560:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3630:x1875787997377664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788891025.816583:0:8596:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:0.0:1788891025.816604:0:8596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072089ddc/0xa66601b03fd53d04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.816622:0:8596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f97a1f3/0xa66601b03fd53ab8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0e4 expref: 12 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.816632:0:8596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788891025.816636:0:8596:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788891025.816641:0:8596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072089ddc/0xa66601b03fd53d04 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.816667:0:8596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f97a1f3/0xa66601b03fd53ab8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0e4 expref: 12 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.816681:0:8596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f97a1f3/0xa66601b03fd53ab8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0e4 expref: 12 pid: 8410 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891025.816692:0:8596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8596:1875787997377920:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891025.816731:0:8596:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847840 going to sleep for 11 seconds 00000100:00100000:0.0:1788891025.816753:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788891025.816760:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3627:x1875787997377792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788891025.816775:0:8411:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:0.0:1788891025.816798:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa04f90, atime: 0x6aa04f90, ctime: 0x6aa04f90, blocks: 0x8 00010000:00010000:0.0:1788891025.816805:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd53d0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.816814:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=248s v=(0 0) 00010000:00010000:0.0:1788891025.816817:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891025.816829:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd53d0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.816844:0:8411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd53d0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.816854:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd53d0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.816871:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd53d0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.816890:0:8411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788891025.816933:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997378048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788891025.816960:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891025.816992:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3627:x1875787997377792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 232us (549us total) trans 4294967311 rc 0/0 00010000:00010000:1.0:1788891025.817000:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788891025.817000:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1788891025.817006:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd53d0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891025.817011:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997378048 00010000:00010000:1.0:1788891025.817014:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522800 already unused, calling callback (ffffffffc0e13260) 00000100:00100000:0.0:1788891025.817014:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997378048 00010000:00010000:1.0:1788891025.817018:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd53d0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.817027:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd53d0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.817043:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd53d0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891025.817046:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788891025.817053:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3628:x1875787997378048:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788891025.817117:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bd01453/0xa66601b03fd53d0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788891025.817125:0:8411:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788891025.817128:0:8411:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788891025 00002000:00010000:0.0:1788891025.817131:0:8411:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:1.0:1788891025.817133:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891025.817133:0:8411:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788891025 -> 1788891025 00010000:00010000:1.0:1788891025.817135:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891025.817136:0:8411:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788891025.817137:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891025.817164:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3628:x1875787997378048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (203us total) trans 4294967322 rc 0/0 00000004:00080000:1.0:1788891025.817170:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff924f8416d880/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788891025.817170:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788891025.817175:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997377792:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788891025.817194:0:3628:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff924f83937480/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788891025.817198:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997378048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788891025.820174:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891025.820277:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891025.820339:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987911808 00000100:00100000:1.0:1788891025.820347:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987911808 00000100:00100000:3.0:1788891025.820352:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987911936 00000100:00100000:3.0:1788891025.820369:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987911936 00010000:00010000:3.0:1788891025.820393:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f97a1f3/0xa66601b03fd53ab8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0e4 expref: 14 pid: 8410 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891025.820427:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 105 00000100:00100000:1.0:1788891025.820428:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 76 00000100:00100000:3.0:1788891025.820437:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+14:2394:x1875787987911936:12345-192.168.204.26@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788891025.820437:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+14:2393:x1875787987911808:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1788891025.820450:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891025.820456:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f97a1f3/0xa66601b03fd53ab8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0e4 expref: 14 pid: 8410 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.820469:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f97a1f3/0xa66601b03fd53ab8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0e4 expref: 14 pid: 8410 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.820494:0:7436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788891025.820498:0:7436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788891025.820504:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000072089ddc/0xa66601b03fd53d04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.820514:0:7436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072089ddc/0xa66601b03fd53d04 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.820553:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891025.820610:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+14:2394:x1875787987911936:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 174us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891025.820618:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 105 00010000:00010000:3.0:1788891025.820680:0:8596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f97a1f3/0xa66601b03fd53ab8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0e4 expref: 13 pid: 8410 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891025.820705:0:8596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8596:1875787997377920:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891025.820725:0:8596:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000072089ddc/0xa66601b03fd53d04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.820733:0:8596:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000072089ddc/0xa66601b03fd53d04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.820740:0:8596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072089ddc/0xa66601b03fd53d04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.820751:0:8596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072089ddc/0xa66601b03fd53d04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.820759:0:8596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072089ddc/0xa66601b03fd53d04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.820781:0:8596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891025.820901:0:10315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891025.820909:0:10315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072089ddc/0xa66601b03fd53d04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.820919:0:10315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081523200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891025.820923:0:10315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072089ddc/0xa66601b03fd53d04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.820933:0:10315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072089ddc/0xa66601b03fd53d04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.820948:0:10315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072089ddc/0xa66601b03fd53d04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.820968:0:10315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072089ddc/0xa66601b03fd53d04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.820990:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891025.820993:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891025.820995:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891025.822046:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3630:x1875787997377664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5484us (5743us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788891025.822117:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:1.0:1788891025.822316:0:3630:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff924f83936680/2, rc 0, transno 4294967323 00000100:00100000:1.0:1788891025.822324:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997377664:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1788891025.822571:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1788891025.822578:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1788891025.822738:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df03475d-d91a-4e91-8125-742ac4d4c589+7:2393:x1875787987911808:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 Request processed in 2301us (2571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891025.822746:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 76 00000100:00100000:0.0:1788891025.825077:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891025.825750:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987912192 00000100:00100000:3.0:1788891025.825762:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987912192 00000100:00100000:3.0:1788891025.825827:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 244 00000100:00100000:3.0:1788891025.825837:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+21:12429:x1875787987912192:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788891025.825924:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891025.825960:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53cef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de17e expref: 21 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.825980:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff925082bfc700) 00010000:00010000:3.0:1788891025.825985:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788891025.826629:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53d12 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.826644:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53d12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.826655:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53d12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788891025.827715:0:14295:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f88b2b91 reply state 00000000ef28c4cc transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53d12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.827732:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53d12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.827739:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff925082bfc700) 00010000:00010000:2.0:1788891025.827742:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788891025.827745:0:14295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788891025.827879:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+22:12429:x1875787987912192:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 2040us (2809us total) trans 4294967510 rc 0/0 00000100:00100000:2.0:1788891025.827889:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 244 00000100:00100000:0.0:1788891025.831500:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891025.831582:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987912320 00000100:00100000:1.0:1788891025.831594:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987912320 00000100:00100000:1.0:1788891025.831645:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00100000:1.0:1788891025.831655:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df03475d-d91a-4e91-8125-742ac4d4c589+7:2393:x1875787987912320:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788891025.831794:0:11803:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788891025.831799:0:11803:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788891025 -> 1788891024 00002000:00010000:1.0:1788891025.831801:0:11803:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788891024 00002000:00010000:1.0:1788891025.831817:0:11803:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788891025 -> 1788891024 00002000:00010000:1.0:1788891025.831820:0:11803:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788891025.831890:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df03475d-d91a-4e91-8125-742ac4d4c589+8:2393:x1875787987912320:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 236us (409us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788891025.831897:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00100000:1.0:1788891025.843202:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891025.843305:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987912576 00000100:00100000:3.0:1788891025.843316:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987912576 00000100:00100000:3.0:1788891025.843376:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 245 00000100:00100000:3.0:1788891025.843386:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+22:12429:x1875787987912576:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788891025.843455:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53d19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.843471:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53cd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de170 expref: 22 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.843481:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53d19 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.843515:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de170 expref: 22 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.843683:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53cd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de170 expref: 22 pid: 12407 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891025.843699:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6495:1875787997378176:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788891025.843776:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090028f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788891025.852115:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6495:1875787997378176:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891025.852144:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53d19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891025.853793:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891025.854253:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987912704 00000100:00100000:3.0:1788891025.854262:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987912704 00010000:00010000:3.0:1788891025.854305:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53cd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de170 expref: 23 pid: 12407 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891025.854352:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 106 00000100:00100000:3.0:1788891025.854362:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+23:2394:x1875787987912704:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891025.854378:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891025.854385:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53cd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de170 expref: 23 pid: 12407 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.854400:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de170 expref: 23 pid: 12407 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.854422:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53cd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de170 expref: 23 pid: 12407 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.854457:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff925082bfc700) 00010000:00010000:3.0:1788891025.854462:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53d19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.854472:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53d19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.854479:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53d19 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.854513:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891025.854761:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+22:2394:x1875787987912704:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 398us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891025.854771:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 106 00010000:00010000:1.0:1788891025.854838:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53d19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.854847:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53d19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.854898:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53d19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.854906:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53d19 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.854912:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53d19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.854918:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891025.854923:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53d19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.854930:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53d19 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.854939:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff925082bfc700) 00010000:00010000:1.0:1788891025.854941:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788891025.854953:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53d19 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.854959:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53d19 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891025.854999:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+21:12429:x1875787987912576:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 Request processed in 11614us (11807us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788891025.855007:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 245 00000100:00100000:0.0:1788891025.864291:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891025.866372:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987912832 00000100:00100000:1.0:1788891025.866387:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987912832 00000100:00100000:1.0:1788891025.866555:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00100000:1.0:1788891025.866567:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+8:2393:x1875787987912832:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788891025.866614:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b1d692e7/0xa66601b03fd53d20 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.866637:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd53cfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de18c expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.866647:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891025.866653:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788891025.866657:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1d692e7/0xa66601b03fd53d20 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.866697:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd53cfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de18c expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.866711:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd53cfd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de18c expref: 8 pid: 8410 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891025.866741:0:8411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8411:1875787997378304:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891025.866832:0:8411:0:(client.c:2715:ptlrpc_set_wait()) set ffff925087ad8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788891025.870902:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891025.870999:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987912960 00000100:00100000:0.0:1788891025.871008:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987912960 00010000:00010000:0.0:1788891025.871056:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd53cfd lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de18c expref: 9 pid: 8410 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891025.871576:0:8411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8411:1875787997378304:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891025.871602:0:8411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b1d692e7/0xa66601b03fd53d20 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891025.871728:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 107 00000100:00100000:0.0:1788891025.871740:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+9:2394:x1875787987912960:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891025.871756:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891025.871792:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd53cfd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de18c expref: 9 pid: 8410 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.871807:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd53cfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de18c expref: 9 pid: 8410 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.871829:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd53cfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de18c expref: 9 pid: 8410 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.871846:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788891025.871851:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788891025.871856:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1d692e7/0xa66601b03fd53d20 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.871878:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1d692e7/0xa66601b03fd53d20 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.871911:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891025.871964:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df03475d-d91a-4e91-8125-742ac4d4c589+8:2394:x1875787987912960:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 226us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891025.871971:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 107 00010000:00010000:1.0:1788891025.872128:0:8411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b1d692e7/0xa66601b03fd53d20 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.872138:0:8411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1d692e7/0xa66601b03fd53d20 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.872159:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b1d692e7/0xa66601b03fd53d20 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.872167:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1d692e7/0xa66601b03fd53d20 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.872176:0:8411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1d692e7/0xa66601b03fd53d20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.872183:0:8411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857de400 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891025.872188:0:8411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1d692e7/0xa66601b03fd53d20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.872209:0:8411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1d692e7/0xa66601b03fd53d20 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.872221:0:8411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1d692e7/0xa66601b03fd53d20 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.872229:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1d692e7/0xa66601b03fd53d20 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891025.872272:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df03475d-d91a-4e91-8125-742ac4d4c589+7:2393:x1875787987912832:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 Request processed in 5708us (7992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891025.872281:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00100000:0.0:1788891025.886376:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891025.886476:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987913216 00000100:00100000:1.0:1788891025.886487:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987913216 00000100:00100000:1.0:1788891025.886584:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 246 00000100:00100000:1.0:1788891025.886597:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+21:12429:x1875787987913216:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788891025.886674:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd53d27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.886693:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53c16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de138 expref: 21 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.886703:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd53d27 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.886740:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53c16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de138 expref: 21 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.886767:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53c16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de138 expref: 21 pid: 12407 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891025.886782:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b29500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6496:1875787997378432:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891025.886877:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff925087ad8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788891025.890319:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891025.890387:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987913344 00000100:00100000:3.0:1788891025.890396:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987913344 00010000:00010000:3.0:1788891025.890433:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53c16 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de138 expref: 22 pid: 12407 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891025.890470:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 108 00000100:00100000:3.0:1788891025.890478:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087acd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+22:2393:x1875787987913344:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891025.890492:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891025.890498:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53c16 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de138 expref: 22 pid: 12407 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.890512:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53c16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de138 expref: 22 pid: 12407 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.890586:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:3.0:1788891025.890592:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53c78 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de15b expref: 22 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.890603:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd53d27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.890611:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd53d27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.890617:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd53d27 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.890634:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891025.890680:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087acd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df03475d-d91a-4e91-8125-742ac4d4c589+22:2393:x1875787987913344:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 202us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891025.890687:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 108 00010000:00010000:1.0:1788891025.891556:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310e00/0xa66601b03fd53c16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de138 expref: 21 pid: 12407 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891025.891579:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b29500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6496:1875787997378432:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891025.891605:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd53d27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.891614:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd53d27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.891620:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd53d27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.891799:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd53d2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.891814:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53ce1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de177 expref: 21 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.891823:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd53d2e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.891871:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de177 expref: 21 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.892014:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53ce1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de177 expref: 21 pid: 6495 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891025.892029:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b29500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6496:1875787997378560:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891025.892107:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff925087ad8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788891025.898446:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b29500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6496:1875787997378560:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788891025.898477:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd53d2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891025.901152:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891025.901730:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987913472 00000100:00100000:3.0:1788891025.901740:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987913472 00010000:00010000:3.0:1788891025.901778:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53ce1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de177 expref: 22 pid: 6495 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891025.901809:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 109 00000100:00100000:3.0:1788891025.901819:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+22:2393:x1875787987913472:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891025.901833:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891025.901840:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53ce1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de177 expref: 22 pid: 6495 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.901878:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de177 expref: 22 pid: 6495 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.901901:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de800/0xa66601b03fd53ce1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de177 expref: 22 pid: 6495 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.901916:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff925082bfc700) 00010000:00010000:3.0:1788891025.901921:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd53d2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.901930:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd53d2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.901938:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd53d2e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891025.901976:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788891025.902025:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd53d2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.902040:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd53d2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891025.902048:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df03475d-d91a-4e91-8125-742ac4d4c589+21:2393:x1875787987913472:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 231us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891025.902056:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 109 00000001:00080000:1.0:1788891025.902164:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1788891025.902276:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:1.0:1788891025.902310:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1788891025.902384:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6496:1875787997378688:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788891025.902430:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891025.902467:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff925087ad8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788891025.902790:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997378688 00000100:00100000:3.0:1788891025.902795:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997378688 00000100:00100000:3.0:1788891025.902829:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788891025.902836:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6496:x1875787997378688:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788891025.902994:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6496:x1875787997378688:12345-0@lo:1000:mdt00_001.0 Request processed in 158us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891025.903001:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788891025.903204:0:6496:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788891025.903210:0:6496:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1788891025.903228:0:6496:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff924f83937480, transno 4294967322 00000100:00100000:2.0:1788891025.903248:0:6496:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff924f83936680 x1875787997377664/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788891041 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891025.903259:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6496:1875787997378688:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788891025.903363:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:2.0:1788891025.903415:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83937800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6496:1875787997378816:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788891025.903447:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891025.903510:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788891025.903764:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997378816 00000100:00100000:1.0:1788891025.903770:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997378816 00000100:00100000:1.0:1788891025.903832:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788891025.903841:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6496:x1875787997378816:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788891025.903976:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6496:x1875787997378816:12345-0@lo:1000:mdt00_001.0 Request processed in 136us (527us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788891025.903983:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788891025.904051:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83937800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6496:1875787997378816:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788891025.904082:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd53d2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.904091:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd53d2e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.904098:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd53d2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.904103:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857de000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891025.904108:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd53d2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.904116:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd53d2e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.904141:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff925082bfc700) 00010000:00010000:2.0:1788891025.904144:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788891025.904149:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd53d2e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.904155:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd53d2e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.904179:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53c71 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.904185:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53c71 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.904198:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53c71 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.904203:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891025.904206:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53c71 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.904212:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53c71 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.904221:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:2.0:1788891025.904223:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788891025.904229:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53c78 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de15b expref: 24 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.904240:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53c78 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de15b expref: 24 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.904248:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53c78 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de15b expref: 24 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.904272:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53c78 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de15b expref: 24 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891025.904282:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83936300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6496:1875787997378944:192.168.204.26@tcp:105: 00000100:00100000:2.0:1788891025.904345:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788891025.906043:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83936300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6496:1875787997378944:192.168.204.26@tcp:105: 00010000:00010000:2.0:1788891025.906079:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53c71 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.906088:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53c71 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.906117:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53d35 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.906143:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53d35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.906155:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53d35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.906164:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53d35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.906171:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53d35 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.906177:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53d35 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.906183:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891025.906186:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53d35 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.906193:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53d35 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.906203:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:2.0:1788891025.906206:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891025.906216:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53d35 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.906222:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311400/0xa66601b03fd53d35 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.906239:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd53d27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.906245:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd53d27 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.906251:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd53d27 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.906256:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857de400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891025.906260:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd53d27 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.906266:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd53d27 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.906274:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:2.0:1788891025.906276:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788891025.906279:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd53d27 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.906285:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de400/0xa66601b03fd53d27 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788891025.906578:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788891025.906583:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788891025.907074:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788891025.907083:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788891025.907358:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+24:12429:x1875787987913216:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 20760us (20988us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788891025.907370:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 246 00000020:00080000:2.0:1788891025.907386:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788891025.908735:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891025.908914:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987913600 00000100:00100000:1.0:1788891025.908924:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987913600 00000100:00100000:1.0:1788891025.908975:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:1.0:1788891025.908995:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+24:12428:x1875787987913600:12345-192.168.204.26@tcp:49:lfs.0 00000100:00100000:1.0:1788891025.909122:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+24:12428:x1875787987913600:12345-192.168.204.26@tcp:49:lfs.0 Request processed in 128us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891025.909138:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:2.0:1788891025.911688:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891025.911732:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891025.911793:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987913856 00000100:00100000:1.0:1788891025.911802:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987913856 00000100:00100000:1.0:1788891025.911848:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:1.0:1788891025.911857:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509047b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+24:12429:x1875787987913856:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788891025.912151:0:6499:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788891025.912183:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:1.0:1788891025.912217:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53d3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.912239:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53d3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.912250:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53d3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.912258:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53d3c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.912265:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53d3c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.912271:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53d3c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.912287:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788891025.912468:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987914112 00000100:00100000:3.0:1788891025.912473:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987914112 00000100:00100000:3.0:1788891025.912501:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 247 00000100:00100000:3.0:1788891025.912508:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+27:12428:x1875787987914112:12345-192.168.204.26@tcp:58:lfs.0 00000040:00080000:3.0:1788891025.912619:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788891025.913476:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509047b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+27:12429:x1875787987913856:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 1612us (1789us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788891025.913505:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 62 00000020:00080000:1.0:1788891025.913512:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788891025.913584:0:10314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891025.913591:0:10314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53d3c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.913600:0:10314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891025.913604:0:10314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53d3c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.913613:0:10314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53d3c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.913627:0:10314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff925082bfc700) 00010000:00010000:1.0:1788891025.913630:0:10314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788891025.913634:0:10314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53d3c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.913640:0:10314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df800/0xa66601b03fd53d3c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891025.913652:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891025.913654:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891025.913655:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891025.913714:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+26:12428:x1875787987914112:12345-192.168.204.26@tcp:58:lfs.0 Request processed in 1205us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891025.913721:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 247 00000100:00100000:2.0:1788891025.942661:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891025.942777:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987914240 00000100:00100000:0.0:1788891025.942788:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987914240 00000100:00100000:0.0:1788891025.942855:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 248 00000100:00100000:0.0:1788891025.942877:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+26:12432:x1875787987914240:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891025.942903:0:9362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891025.942929:0:9362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53d43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de193 expref: -99 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.942990:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53d4a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.943006:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53d4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.943017:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53d4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.943290:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53d51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.943300:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53d51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.943308:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53d51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.943411:0:9362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53d58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.943424:0:9362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de154 expref: 27 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.943433:0:9362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53d58 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.943471:0:9362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de154 expref: 27 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.943486:0:9362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de154 expref: 27 pid: 6495 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891025.943501:0:9362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9362:1875787997379072:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891025.943703:0:9362:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788891025.947217:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891025.947497:0:9362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9362:1875787997379072:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891025.947544:0:9362:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53d58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891025.947657:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987914496 00000100:00100000:0.0:1788891025.947665:0:14588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987914496 00000100:00100000:0.0:1788891025.947754:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:0.0:1788891025.947765:0:14588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+28:6154:x1875787987914496:12345-192.168.204.26@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788891025.948005:0:14588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+29:6154:x1875787987914496:12345-192.168.204.26@tcp:35:ldlm_bl.0 Request processed in 240us (793us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788891025.948014:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:0.0:1788891025.950710:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891025.952285:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987914624 00000100:00100000:3.0:1788891025.952298:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987914624 00010000:00010000:2.0:1788891025.953026:0:7436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de154 expref: 29 pid: 6495 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891025.953150:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 110 00000100:00100000:2.0:1788891025.953161:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+29:2393:x1875787987914624:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891025.953177:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891025.953185:0:7436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de154 expref: 29 pid: 6495 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.953201:0:7436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de154 expref: 29 pid: 6495 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.953229:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53c63 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de154 expref: 29 pid: 6495 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.953252:0:7436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:2.0:1788891025.953258:0:7436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53d58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.953267:0:7436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53d58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.953287:0:7436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53d58 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891025.953326:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788891025.953376:0:9362:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53d58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.953391:0:9362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53d58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891025.953404:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df03475d-d91a-4e91-8125-742ac4d4c589+28:2393:x1875787987914624:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 245us (2704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891025.953412:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 110 00000004:00200000:0.0:1788891025.953460:0:9362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788891025.953470:0:9362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788891025.953491:0:9362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53d58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.953504:0:9362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53d58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.953513:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53d4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.953545:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53d4a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.953553:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53d4a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.953559:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081523800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891025.953563:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53d4a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.953570:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53d4a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.953578:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:0.0:1788891025.953581:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891025.953585:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53d4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.953601:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523800/0xa66601b03fd53d4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.953625:0:9362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53d51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.953631:0:9362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53d51 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.953637:0:9362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53d51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.953642:0:9362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891025.953645:0:9362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53d51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.953651:0:9362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53d51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.953658:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9250c130ba00) 00010000:00010000:0.0:1788891025.953662:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891025.953664:0:9362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53d51 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.953669:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522800/0xa66601b03fd53d51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.953703:0:9362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081523200/0xa66601b03fd53d43 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de193 expref: 28 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.953715:0:9362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53d58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de193 expref: 27 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891025.953728:0:9362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:0.0:1788891025.953731:0:9362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788891025.953733:0:9362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925081522a00, rc 0) 00000100:00100000:0.0:1788891025.953761:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df03475d-d91a-4e91-8125-742ac4d4c589+27:12432:x1875787987914240:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 10887us (11110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891025.953768:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 248 00010000:00010000:2.0:1788891026.365260:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788891026.552336:0:14678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788891026.552347:0:14678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788891026.552383:0:14678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788891026.552391:0:14678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788891026.939745:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788891026.939755:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788891026.939801:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788891026.939812:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788891026.939969:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875787997379200:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788891026.940791:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bf6c7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788891026.944866:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13771:1875787997379200:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788891026.947367:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891026.947658:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987914752 00000100:00100000:3.0:1788891026.947668:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987914752 00000100:00100000:3.0:1788891026.947803:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 249 00000100:00100000:3.0:1788891026.947814:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+27:12444:x1875787987914752:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788891026.947860:0:12407:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788891026.947991:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+27:12444:x1875787987914752:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 177us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891026.947999:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 249 00000100:00080000:0.0:1788891026.948631:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788891026.954248:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891026.958564:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987915008 00000100:00100000:3.0:1788891026.958639:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987915008 00000100:00100000:3.0:1788891026.958720:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 250 00000100:00100000:3.0:1788891026.958732:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+27:12444:x1875787987915008:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788891026.958753:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891026.958772:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53d5f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de19a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891026.958915:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53d66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891026.958930:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53d66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891026.958944:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53d66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891026.958956:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788891026.959053:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53d5f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de19a expref: 30 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891026.959073:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53d66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de19a expref: 29 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891026.959083:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:3.0:1788891026.959086:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788891026.959090:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8ac00, rc 0) 00000100:00100000:3.0:1788891026.959224:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+29:12444:x1875787987915008:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 494us (4988us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788891026.959233:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 250 00000100:00100000:1.0:1788891026.963943:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891026.964619:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891026.964774:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987915392 00000100:00100000:1.0:1788891026.964785:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987915392 00000100:00100000:1.0:1788891026.964872:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 251 00000100:00100000:1.0:1788891026.964883:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+29:12444:x1875787987915392:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788891026.964975:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd53d74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891026.964991:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd53d74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891026.965002:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd53d74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891026.965401:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd53d74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891026.965409:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd53d74 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891026.965416:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd53d74 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891026.965422:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857dfe00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891026.965426:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd53d74 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891026.965433:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd53d74 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891026.965446:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:1.0:1788891026.965449:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788891026.965454:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd53d74 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891026.965459:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd53d74 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891026.965927:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987915136 00000100:00100000:2.0:1788891026.965935:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987915136 00000100:00100000:1.0:1788891026.966235:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+31:12444:x1875787987915392:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 1352us (1617us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788891026.966244:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 251 00000100:00100000:2.0:1788891026.966562:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:2.0:1788891026.966574:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+30:2393:x1875787987915136:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891026.966589:0:10317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891026.966609:0:10317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53d66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de19a expref: 30 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891026.966624:0:10317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:2.0:1788891026.966629:0:10317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891026.966660:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:df03475d-d91a-4e91-8125-742ac4d4c589+29:2393:x1875787987915136:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 90us (2727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891026.966667:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 17 00000040:00080000:0.0:1788891026.966787:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788891026.966792:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788891026.967354:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788891026.967365:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788891026.970219:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891026.970657:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987915648 00000100:00100000:1.0:1788891026.970668:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987915648 00000100:00100000:1.0:1788891026.970733:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:1.0:1788891026.970744:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+29:12444:x1875787987915648:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788891026.971035:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+30:12444:x1875787987915648:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 292us (1023us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788891026.971043:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:3.0:1788891027.067966:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997379328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788891027.068053:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891027.068184:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997379328 00000100:00100000:0.0:1788891027.068192:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997379328 00000100:00100000:0.0:1788891027.068269:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788891027.068279:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3629:x1875787997379328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788891027.068301:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1788891027.068357:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3629:x1875787997379328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891027.068365:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1788891027.068598:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788891027.068635:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997379328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788891027.068765:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997379456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788891027.068800:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891027.068833:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997379456 00000100:00100000:1.0:1788891027.068848:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997379456 00000100:00100000:1.0:1788891027.068876:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788891027.068883:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997379456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788891027.068907:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788891027.068945:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997379456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891027.068951:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788891027.068980:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997379456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788891027.069153:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788891027.069163:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997379584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788891027.069193:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891027.069567:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997379584 00000100:00100000:3.0:1788891027.069581:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997379584 00000100:00100000:3.0:1788891027.069614:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788891027.069621:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997379584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788891027.069632:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1788891027.069665:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997379584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891027.069671:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788891027.069685:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891027.069946:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997379584:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788891027.389213:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788891027.590404:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1788891027.590422:0:9489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:0.0:1788891028.093103:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788891028.093127:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997379712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788891028.093202:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891028.093268:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997379712 00000100:00100000:0.0:1788891028.093275:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997379712 00000100:00100000:0.0:1788891028.093321:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788891028.093331:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997379712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788891028.093365:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788891028.093415:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997379712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891028.093423:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788891028.093473:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997379712:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788891028.128632:0:14729:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788891028.128643:0:14729:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788891028.128677:0:14729:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788891028.128685:0:14729:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788891028.241216:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891028.241252:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987915904 00000100:00100000:3.0:1788891028.241260:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987915904 00000100:00100000:3.0:1788891028.241320:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 252 00000100:00100000:3.0:1788891028.241331:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+30:12464:x1875787987915904:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891028.241355:0:12407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891028.241376:0:12407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53d7b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de1a1 expref: -99 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891028.241480:0:12407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53d82 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891028.241495:0:12407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53d82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891028.241509:0:12407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53d82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891028.241544:0:12407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788891028.241646:0:12407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd53d7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de1a1 expref: 33 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891028.241674:0:12407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53d82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de1a1 expref: 32 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891028.241682:0:12407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:3.0:1788891028.241685:0:12407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788891028.241688:0:12407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8ac00, rc 0) 00000100:00100000:3.0:1788891028.241737:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+32:12464:x1875787987915904:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 409us (530us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788891028.241745:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 252 00000100:00080000:3.0:1788891028.241765:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788891028.243892:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891028.243956:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987916032 00000100:00100000:3.0:1788891028.243965:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987916032 00000100:00100000:3.0:1788891028.244078:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 253 00000100:00100000:3.0:1788891028.244088:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+32:12464:x1875787987916032:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:3.0:1788891028.244143:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53d90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891028.244157:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53d90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891028.244169:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53d90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891028.244213:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53d90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891028.244221:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53d90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891028.244238:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53d90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891028.244244:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080031c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891028.244249:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53d90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891028.244257:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53d90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891028.244268:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:3.0:1788891028.244271:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891028.244275:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53d90 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891028.244281:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53d90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891028.244345:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+32:12464:x1875787987916032:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 258us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891028.244352:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 253 00000100:00100000:3.0:1788891028.310298:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891028.310382:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987916160 00000100:00100000:1.0:1788891028.310406:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987916160 00000100:00100000:2.0:1788891028.310571:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 79 00000100:00100000:2.0:1788891028.310585:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+7:2391:x1875787987916160:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:2.0:1788891028.310604:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891028.310624:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53d97 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de1a8 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891028.310650:0:8410:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa04f90, atime: 0x6aa04f90, ctime: 0x6aa04f90, blocks: 0x8 00010000:00010000:2.0:1788891028.310672:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=250s v=(0 0) 00010000:00010000:2.0:1788891028.310677:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891028.310688:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53d97 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de1a8 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891028.310707:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53d97 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de1a8 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891028.310721:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310400, rc 0) 00000100:00100000:2.0:1788891028.310784:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+8:2391:x1875787987916160:12345-192.168.204.26@tcp:101:cat.0 Request processed in 202us (497us total) trans 0 rc 0/0 00000100:00080000:3.0:1788891028.312133:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788891028.315374:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891028.315461:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987916288 00000100:00100000:0.0:1788891028.315472:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987916288 00000100:00100000:2.0:1788891028.315488:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 79 00002000:00100000:0.0:1788891028.315641:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff924f83b28700 x1875787987916288/t0(0) o3->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:79/0 lens 488/0 e 0 to 0 dl 1788891039 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788891028.315671:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f83b28700 with x1875787987916288 ext(0->4095) 00002000:00010000:0.0:1788891028.315677:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924f83b28700 00000100:00100000:0.0:1788891028.315741:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:0.0:1788891028.315751:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df03475d-d91a-4e91-8125-742ac4d4c589+8:2392:x1875787987916288:12345-192.168.204.26@tcp:3:cat.0 00000100:00100000:0.0:1788891028.315913:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df03475d-d91a-4e91-8125-742ac4d4c589+8:2392:x1875787987916288:12345-192.168.204.26@tcp:3:cat.0 Request processed in 164us (549us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788891028.315920:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00002000:00100000:0.0:1788891028.315926:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff924f83b28700 x1875787987916288/t0(0) o3->df03475d-d91a-4e91-8125-742ac4d4c589@192.168.204.26@tcp:79/0 lens 488/4536 e 0 to 0 dl 1788891039 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788891028.315934:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f83b28700 with x1875787987916288 ext(0->4095) 00002000:00010000:0.0:1788891028.315937:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924f83b28700 00010000:00010000:1.0:1788891028.412563:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891028.943769:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891028.943823:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891028.943857:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891028.943886:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891028.943904:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891028.943922:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891028.943941:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891028.943967:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987916544 00000100:00100000:0.0:1788891028.944032:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987916544 00000100:00100000:0.0:1788891028.944084:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987917056 00000100:00100000:0.0:1788891028.944087:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987917056 00000100:00100000:0.0:1788891028.944109:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987916672 00000100:00100000:0.0:1788891028.944112:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987916672 00000100:00100000:0.0:1788891028.944125:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987917184 00000100:00100000:0.0:1788891028.944127:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987917184 00000100:00100000:3.0:1788891028.944222:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987916800 00000100:00100000:3.0:1788891028.944227:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987916800 00000100:00100000:3.0:1788891028.944255:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987916928 00000100:00100000:3.0:1788891028.944258:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987916928 00000100:00100000:3.0:1788891028.944281:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 117 00000100:00100000:3.0:1788891028.944291:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df03475d-d91a-4e91-8125-742ac4d4c589+8:2392:x1875787987916800:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891028.944368:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df03475d-d91a-4e91-8125-742ac4d4c589+8:2392:x1875787987916800:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 79us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891028.944376:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 117 00000100:00100000:3.0:1788891028.944392:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 118 00000100:00100000:3.0:1788891028.944399:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987916928:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891028.944418:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987916928:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 20us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891028.944424:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 118 00000100:00100000:0.0:1788891028.944459:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 226 00000100:00100000:0.0:1788891028.944469:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+32:2392:x1875787987916544:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891028.944498:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+32:2392:x1875787987916544:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 32us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891028.946250:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 227 00000100:00100000:3.0:1788891028.946267:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2392:x1875787987917056:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891028.946321:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2392:x1875787987917056:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 61us (2463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891028.946329:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 227 00000100:00100000:3.0:1788891028.946356:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 228 00000100:00100000:3.0:1788891028.946364:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987916672:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891028.946388:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+5:2392:x1875787987916672:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 26us (2483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891028.946762:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 228 00000100:00100000:3.0:1788891028.946781:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 229 00000100:00100000:3.0:1788891028.946790:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2392:x1875787987917184:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891028.946833:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2392:x1875787987917184:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 44us (2891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891028.946839:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 229 00000100:00080000:3.0:1788891028.946881:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788891028.946887:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788891028.946890:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891028.947363:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987916416 00000100:00100000:3.0:1788891028.947371:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987916416 00000100:00100000:3.0:1788891028.947420:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 367 00000100:00100000:3.0:1788891028.947428:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2392:x1875787987916416:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891028.947462:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2392:x1875787987916416:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 35us (3575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891028.947469:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 367 00000100:00100000:0.0:1788891028.948008:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 226 00010000:00010000:2.0:1788891029.436447:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891030.140827:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997379968:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.140945:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891030.141015:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1875787997380480:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.141043:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891030.141068:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1875787997380992:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.141094:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891030.141120:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788891030.141126:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf7f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997379840:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.141172:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891030.141197:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997380352:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.141222:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891030.141241:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997380864:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.141264:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891030.141280:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997381376:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.141298:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891030.141332:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997380096:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.141353:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891030.141370:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997380608:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.141400:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891030.141419:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997381120:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.141437:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891030.141452:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788891030.141457:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997380224:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.141475:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891030.141492:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997380736:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.141508:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891030.141542:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997381248:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.141561:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891030.141592:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997379968 00000100:00100000:3.0:1788891030.141599:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997379968 00000100:00100000:3.0:1788891030.141637:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997380480 00000100:00100000:3.0:1788891030.141640:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997380480 00000100:00100000:3.0:1788891030.141661:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997380992 00000100:00100000:3.0:1788891030.141664:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997380992 00000100:00100000:3.0:1788891030.141678:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997380608 00000100:00100000:3.0:1788891030.141680:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997380608 00000100:00100000:3.0:1788891030.141694:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997381120 00000100:00100000:3.0:1788891030.141696:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997381120 00000100:00100000:3.0:1788891030.141710:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997380224 00000100:00100000:3.0:1788891030.141713:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997380224 00000100:00100000:3.0:1788891030.141728:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788891030.141737:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997379968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.141802:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997379968:12345-0@lo:400:kworker.0 Request processed in 65us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891030.141816:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788891030.141835:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788891030.141842:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875787997380480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.141873:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875787997380480:12345-0@lo:400:kworker.0 Request processed in 32us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891030.141878:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788891030.141890:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788891030.141897:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875787997380992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.141923:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875787997380992:12345-0@lo:400:kworker.0 Request processed in 27us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891030.141929:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788891030.141940:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788891030.141946:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997380608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.141988:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997380608:12345-0@lo:400:kworker.0 Request processed in 42us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891030.141995:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788891030.142007:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788891030.142013:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997381120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.142040:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997381120:12345-0@lo:400:kworker.0 Request processed in 28us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891030.142046:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788891030.142058:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788891030.142065:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997380224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.142090:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997380224:12345-0@lo:400:kworker.0 Request processed in 26us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891030.142102:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788891030.142129:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997379840 00000100:00100000:3.0:1788891030.142132:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997379840 00000100:00100000:3.0:1788891030.142157:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788891030.142163:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3630:x1875787997379840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.142193:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3630:x1875787997379840:12345-0@lo:400:kworker.0 Request processed in 31us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891030.142200:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788891030.142225:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997380352 00000100:00100000:3.0:1788891030.142228:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997380352 00000100:00100000:3.0:1788891030.142249:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997380096 00000100:00100000:3.0:1788891030.142251:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997380096 00000100:00100000:3.0:1788891030.142262:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788891030.142268:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997380352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.142298:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997380352:12345-0@lo:400:kworker.0 Request processed in 30us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891030.142303:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788891030.142312:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788891030.142317:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997380096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.142338:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997380096:12345-0@lo:400:kworker.0 Request processed in 22us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891030.142344:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788891030.142357:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997380864 00000100:00100000:3.0:1788891030.142360:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997380864 00000100:00100000:3.0:1788891030.142380:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997381376 00000100:00100000:3.0:1788891030.142382:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997381376 00000100:00100000:3.0:1788891030.142392:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997380736 00000100:00100000:3.0:1788891030.142399:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997380736 00000100:00100000:3.0:1788891030.142412:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997381248 00000100:00100000:3.0:1788891030.142414:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997381248 00000100:00100000:3.0:1788891030.142424:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788891030.142429:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3630:x1875787997380864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.142456:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3630:x1875787997380864:12345-0@lo:400:kworker.0 Request processed in 26us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891030.142462:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788891030.142471:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788891030.142476:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997381376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.142496:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997381376:12345-0@lo:400:kworker.0 Request processed in 20us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891030.142501:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788891030.142509:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788891030.142514:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997380736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.142556:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997380736:12345-0@lo:400:kworker.0 Request processed in 41us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891030.142562:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788891030.142575:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788891030.142583:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997381248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891030.142628:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997380224:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.142841:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997381248:12345-0@lo:400:kworker.0 Request processed in 259us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891030.142847:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1788891030.142889:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788891030.142894:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788891030.142897:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788891030.142899:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891030.142941:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf7f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997379840:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.142957:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997380352:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.142971:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997380864:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.142981:0:3630:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1788891030.142987:0:3630:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:3.0:1788891030.143006:0:3630:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9250bf792d80, transno 4294967308 00000004:00080000:3.0:1788891030.143019:0:3630:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1788891030.143033:0:3630:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff924f8416d880, transno 4294967311 00000100:00100000:3.0:1788891030.143040:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997381376:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.143056:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997379968:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.143067:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1875787997380480:0@lo:400:kworker.0 00000100:00100000:3.0:1788891030.143079:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1875787997380992:0@lo:400:kworker.0 00000100:00100000:1.0:1788891030.145086:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997380736:0@lo:400:kworker.0 00000100:00100000:1.0:1788891030.145105:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997381248:0@lo:400:kworker.0 00000100:00100000:1.0:1788891030.145118:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997380096:0@lo:400:kworker.0 00010000:00080000:1.0:1788891030.145135:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84293480 x1875787997380608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891030.145147:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997380608:0@lo:400:kworker.0 00010000:00080000:1.0:1788891030.145160:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84292300 x1875787997381120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891030.145169:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997381120:0@lo:400:kworker.0 00010000:00010000:1.0:1788891030.459879:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891030.655807:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997381504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788891030.655880:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891030.657554:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997381504 00000100:00100000:3.0:1788891030.657566:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997381504 00000100:00100000:3.0:1788891030.657635:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788891030.657645:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997381504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788891030.657677:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788891030.657749:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997381504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891030.657757:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788891030.657820:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997381504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788891030.666902:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997381632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788891030.666977:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891030.667146:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997381632 00000100:00100000:1.0:1788891030.667154:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997381632 00000100:00100000:1.0:1788891030.667207:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788891030.667217:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997381632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788891030.667241:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788891030.667297:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997381632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891030.667305:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788891030.667347:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997381632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788891031.437266:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891031.437919:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987917312 00000100:00100000:3.0:1788891031.437930:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987917312 00000100:00100000:3.0:1788891031.438015:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 254 00000100:00100000:3.0:1788891031.438027:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+32:12118:x1875787987917312:12345-192.168.204.26@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788891031.438143:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df03475d-d91a-4e91-8125-742ac4d4c589+32:12118:x1875787987917312:12345-192.168.204.26@tcp:60:lhsmtool_posix.0 Request processed in 119us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891031.438152:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 254 00000100:00080000:0.0:1788891031.438226:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891031.441739:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891031.441923:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987917440 00000100:00100000:0.0:1788891031.441942:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987917440 00000100:00100000:0.0:1788891031.442016:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 255 00000100:00100000:0.0:1788891031.442027:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+5:12118:x1875787987917440:12345-192.168.204.26@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788891031.442130:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:df03475d-d91a-4e91-8125-742ac4d4c589+5:12118:x1875787987917440:12345-192.168.204.26@tcp:60:lhsmtool_posix.0 Request processed in 104us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891031.442138:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 255 00000100:00080000:3.0:1788891031.442195:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788891031.445747:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891031.447511:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987917696 00000100:00100000:0.0:1788891031.447566:0:14588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987917696 00000100:00100000:0.0:1788891031.447625:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:0.0:1788891031.447635:0:14588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+32:12118:x1875787987917696:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788891031.447901:0:14588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+33:12118:x1875787987917696:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 266us (2164us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788891031.447909:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 65 00000001:00080000:2.0:1788891031.451140:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:2.0:1788891031.451189:0:6475:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff924f8388d240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788891031.451195:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff924f81e45700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff924f8388d9c0 00000020:00080000:2.0:1788891031.451199:0:6475:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff924f81e45d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff924f832a8a00 00000020:00080000:2.0:1788891031.451234:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1788891031.452458:0:6527:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788891031.452560:0:6527:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1788891031.454509:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53d12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891031.454551:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53d12 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891031.454559:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53d12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891031.454566:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ede00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891031.454571:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53d12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891031.454580:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53d12 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891031.454602:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff925082bfc700) 00010000:00010000:1.0:1788891031.454605:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891031.454610:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53d12 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891031.454616:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd53d12 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891031.484878:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891031.613205:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891031.613315:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987917824 00000100:00100000:3.0:1788891031.613326:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987917824 00000100:00080000:0.0:1788891031.613396:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891031.613447:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 256 00000100:00100000:3.0:1788891031.613458:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:12921:x1875787987917824:12345-192.168.204.26@tcp:101:lsof.0 00010000:00010000:3.0:1788891031.613488:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891031.613507:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53d9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de1af expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891031.613601:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53da5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891031.613616:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53da5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891031.613633:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53da5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891031.613677:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788891031.613681:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891031.613697:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53da5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891031.613735:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080030800/0xa66601b03fd53d9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de1af expref: 7 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891031.613764:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53da5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de1af expref: 6 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891031.613773:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250b65fd200) 00010000:00010000:3.0:1788891031.613776:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788891031.613779:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080031c00, rc 0) 00000100:00100000:3.0:1788891031.613842:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:12921:x1875787987917824:12345-192.168.204.26@tcp:101:lsof.0 Request processed in 385us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891031.613849:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 256 00000001:00080000:0.0:1788891031.681367:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:0.0:1788891031.681380:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000100:00100000:1.0:1788891032.187723:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788891032.187760:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997381760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788891032.187839:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891032.187956:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997381760 00000100:00100000:2.0:1788891032.187965:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997381760 00000100:00100000:2.0:1788891032.188016:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788891032.188027:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997381760:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788891032.188042:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997381888:0@lo:13:osp-pre-0-0.0 00000004:00000024:2.0:1788891032.188066:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788891032.188082:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891032.188128:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997381760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891032.188136:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788891032.188217:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997381888 00000100:00100000:1.0:1788891032.188222:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997381888 00000100:00100000:1.0:1788891032.188270:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788891032.188278:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997381888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788891032.188297:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788891032.188341:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997381888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891032.188347:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788891032.188389:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997381760:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788891032.188466:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891032.188541:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1788891032.188547:0:3629:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff924f83936680, transno 4294967323 00000004:00080000:0.0:1788891032.188564:0:3629:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1788891032.188585:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997381888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788891032.188597:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788891032.188603:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997382016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788891032.188629:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891032.188703:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997382016 00000100:00100000:1.0:1788891032.188707:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997382016 00000100:00100000:1.0:1788891032.188757:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788891032.188764:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997382016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788891032.188775:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788891032.188808:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997382016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891032.188814:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788891032.188843:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997382016:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788891032.189099:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788891032.507717:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891033.211790:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997382144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788891033.211870:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891033.211916:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997382144 00000100:00100000:2.0:1788891033.211924:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997382144 00000100:00100000:2.0:1788891033.211975:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788891033.211987:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997382144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788891033.212022:0:7721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788891033.212086:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997382144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891033.212093:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788891033.212248:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997382144:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788891033.533745:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788891033.746865:0:14926:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 14:10:32 (1788891032) 00000100:00100000:3.0:1788891034.067816:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891034.067854:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891034.067882:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891034.067902:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891034.067918:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891034.067938:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891034.067971:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891034.067999:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987918336 00000100:00100000:3.0:1788891034.068007:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987918336 00000100:00100000:3.0:1788891034.068061:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987918464 00000100:00100000:3.0:1788891034.068064:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987918464 00000100:00100000:3.0:1788891034.068085:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 123 00000100:00100000:3.0:1788891034.068093:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+7:2393:x1875787987918336:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891034.068160:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+7:2393:x1875787987918336:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 68us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891034.068174:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 123 00000100:00100000:3.0:1788891034.068190:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 124 00000100:00100000:3.0:1788891034.068198:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+5:2394:x1875787987918464:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891034.068224:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df03475d-d91a-4e91-8125-742ac4d4c589+5:2394:x1875787987918464:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891034.068231:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 124 00000100:00100000:3.0:1788891034.068249:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987917952 00000100:00100000:3.0:1788891034.068252:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987917952 00000100:00100000:3.0:1788891034.068276:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 369 00000100:00100000:3.0:1788891034.068282:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2394:x1875787987917952:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891034.068305:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2394:x1875787987917952:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 24us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891034.068312:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 369 00000100:00100000:3.0:1788891034.068338:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987918080 00000100:00100000:3.0:1788891034.068342:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987918080 00000100:00100000:3.0:1788891034.068368:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987918592 00000100:00100000:3.0:1788891034.068371:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987918592 00000100:00100000:3.0:1788891034.068388:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987918208 00000100:00100000:3.0:1788891034.068391:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987918208 00000100:00100000:1.0:1788891034.068402:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987918720 00000100:00100000:3.0:1788891034.068406:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 236 00000100:00100000:1.0:1788891034.068406:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987918720 00000100:00100000:3.0:1788891034.068412:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+18:2393:x1875787987918080:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788891034.068427:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 237 00000100:00100000:1.0:1788891034.068433:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:2393:x1875787987918592:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891034.068443:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+18:2393:x1875787987918080:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 31us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891034.068450:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 236 00000100:00100000:1.0:1788891034.068454:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:2393:x1875787987918592:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 22us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891034.068459:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 237 00000100:00080000:2.0:1788891034.068644:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788891034.068649:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788891034.068652:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788891034.068653:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788891034.068749:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 238 00000100:00100000:3.0:1788891034.068763:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+5:2394:x1875787987918208:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891034.068789:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df03475d-d91a-4e91-8125-742ac4d4c589+5:2394:x1875787987918208:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 28us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891034.068795:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 238 00000100:00100000:3.0:1788891034.068808:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 239 00000100:00100000:3.0:1788891034.068813:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987918720:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891034.068833:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2394:x1875787987918720:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 20us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891034.068840:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 239 00000040:00080000:0.0:1788891034.171706:0:13771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788891034.171715:0:13771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788891034.171806:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788891034.171814:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788891034.301209:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788891034.559286:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891035.259774:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997382272:0@lo:400:kworker.0 00000100:00100000:0.0:1788891035.259852:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891035.259989:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997382272 00000100:00100000:1.0:1788891035.259997:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997382272 00000100:00100000:1.0:1788891035.260058:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788891035.260067:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3628:x1875787997382272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891035.260231:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997382656:0@lo:400:kworker.0 00000100:00100000:2.0:1788891035.260266:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891035.260329:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997382528:0@lo:400:kworker.0 00000100:00100000:2.0:1788891035.260356:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891035.260376:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788891035.260381:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997382400:0@lo:400:kworker.0 00000100:00100000:2.0:1788891035.260400:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891035.260428:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997382656 00000100:00100000:2.0:1788891035.260432:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997382656 00000100:00100000:2.0:1788891035.260465:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997382400 00000100:00100000:2.0:1788891035.260468:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997382400 00000100:00100000:1.0:1788891035.260473:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3628:x1875787997382272:12345-0@lo:400:kworker.0 Request processed in 405us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891035.260483:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788891035.260492:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788891035.260502:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997382656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891035.260558:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788891035.260568:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997382400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891035.260571:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997382656:12345-0@lo:400:kworker.0 Request processed in 70us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891035.260581:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788891035.260617:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997382400:12345-0@lo:400:kworker.0 Request processed in 51us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891035.260625:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788891035.260626:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997382656:0@lo:400:kworker.0 00000100:00100000:1.0:1788891035.260664:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997382528 00000100:00100000:2.0:1788891035.260665:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997382400:0@lo:400:kworker.0 00000100:00100000:1.0:1788891035.260669:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997382528 00000100:00100000:1.0:1788891035.260712:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788891035.260720:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997382528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891035.260770:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997382528:12345-0@lo:400:kworker.0 Request processed in 51us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891035.260776:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788891035.261003:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997382272:0@lo:400:kworker.0 00000100:00100000:2.0:1788891035.261036:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997382528:0@lo:400:kworker.0 00000100:00100000:2.0:1788891035.261173:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788891035.261252:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788891035.261260:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997383168:0@lo:400:kworker.0 00000100:00100000:0.0:1788891035.261288:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891035.261335:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997383168 00000100:00100000:0.0:1788891035.261343:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997383168 00000100:00100000:1.0:1788891035.261372:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997382912:0@lo:400:kworker.0 00000100:00100000:0.0:1788891035.261384:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788891035.261393:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997383168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891035.261439:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997383168:12345-0@lo:400:kworker.0 Request processed in 48us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891035.261445:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1788891035.261461:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891035.261469:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1875787997383040:0@lo:400:kworker.0 00000100:00100000:1.0:1788891035.261475:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891035.261499:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891035.261542:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997382912 00000100:00100000:1.0:1788891035.261548:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997382912 00000100:00100000:0.0:1788891035.261559:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997383168:0@lo:400:kworker.0 00000100:00080000:0.0:1788891035.261583:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891035.261598:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997383040 00000100:00100000:1.0:1788891035.261603:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997383040 00000100:00100000:0.0:1788891035.261603:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788891035.261614:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997382912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891035.261636:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788891035.261651:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997382912:12345-0@lo:400:kworker.0 Request processed in 39us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891035.261655:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875787997383040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891035.261662:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:0.0:1788891035.261703:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788891035.261728:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1875787997383040:12345-0@lo:400:kworker.0 Request processed in 77us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891035.261742:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997382912:0@lo:400:kworker.0 00000100:00100000:1.0:1788891035.261747:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00010000:00080000:0.0:1788891035.261776:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84297800 x1875787997383040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891035.261787:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3630:1875787997383040:0@lo:400:kworker.0 00000100:00100000:2.0:1788891035.261970:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997382784:0@lo:400:kworker.0 00000100:00100000:2.0:1788891035.261997:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891035.262162:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997383296:0@lo:400:kworker.0 00000100:00100000:3.0:1788891035.262176:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997383424:0@lo:400:kworker.0 00000100:00100000:1.0:1788891035.262192:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891035.262213:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891035.262222:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997383808:0@lo:400:kworker.0 00000100:00100000:3.0:1788891035.262239:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788891035.262248:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997383552:0@lo:400:kworker.0 00000100:00100000:1.0:1788891035.262254:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891035.262277:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788891035.262283:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891035.262287:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997383680:0@lo:400:kworker.0 00000100:00100000:1.0:1788891035.262314:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891035.262320:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997383424 00000100:00100000:3.0:1788891035.262325:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997383424 00000100:00100000:3.0:1788891035.262360:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997383552 00000100:00100000:3.0:1788891035.262364:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997383552 00000100:00100000:1.0:1788891035.262368:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997383296 00000100:00100000:1.0:1788891035.262374:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997383296 00000100:00100000:3.0:1788891035.262387:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788891035.262396:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997383424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891035.262430:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997383424:12345-0@lo:400:kworker.0 Request processed in 37us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891035.262436:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788891035.262448:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788891035.262454:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997383552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891035.262471:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997383808 00000100:00100000:1.0:1788891035.262477:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997383808 00000100:00100000:3.0:1788891035.262492:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997383552:12345-0@lo:400:kworker.0 Request processed in 37us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891035.262500:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788891035.262505:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997383680 00000100:00100000:1.0:1788891035.262509:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997383680 00000100:00080000:3.0:1788891035.262518:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788891035.262538:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788891035.262540:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788891035.262544:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788891035.262564:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84296300 x1875787997383552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891035.262574:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997383552:0@lo:400:kworker.0 00000100:00100000:3.0:1788891035.262581:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997383424:0@lo:400:kworker.0 00000100:00100000:1.0:1788891035.262612:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788891035.262623:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997383296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891035.262662:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997383296:12345-0@lo:400:kworker.0 Request processed in 42us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891035.262667:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788891035.262686:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788891035.262687:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997383808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891035.262721:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997383808:12345-0@lo:400:kworker.0 Request processed in 46us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891035.262805:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997382784 00000100:00100000:0.0:1788891035.262809:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997382784 00000100:00100000:1.0:1788891035.262831:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788891035.262833:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788891035.262840:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997382784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891035.262870:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997382784:12345-0@lo:400:kworker.0 Request processed in 30us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891035.262885:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788891035.262973:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997383680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891035.263003:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997383680:12345-0@lo:400:kworker.0 Request processed in 34us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891035.263009:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788891035.263042:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997383680:0@lo:400:kworker.0 00000100:00100000:1.0:1788891035.263068:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997383808:0@lo:400:kworker.0 00000100:00100000:1.0:1788891035.263080:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997383296:0@lo:400:kworker.0 00000100:00100000:1.0:1788891035.263121:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997382784:0@lo:400:kworker.0 00000100:00100000:3.0:1788891035.263179:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00010000:1.0:1788891035.579783:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891035.771784:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997383936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788891035.771872:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891035.772384:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997383936 00000100:00100000:2.0:1788891035.772394:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997383936 00000100:00100000:2.0:1788891035.772457:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788891035.772468:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997383936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788891035.772505:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788891035.772594:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997383936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891035.772627:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788891035.772703:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997383936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788891035.772786:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788891035.772846:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997384064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788891035.772880:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891035.772996:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997384064 00000100:00100000:1.0:1788891035.773002:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997384064 00000100:00100000:1.0:1788891035.773074:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788891035.773082:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997384064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788891035.773094:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788891035.773135:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997384064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891035.773142:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788891035.773201:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997384064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788891036.136750:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891036.136852:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987918976 00000100:00100000:3.0:1788891036.136869:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987918976 00000100:00080000:0.0:1788891036.136950:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891036.136980:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:3.0:1788891036.136996:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+18:13143:x1875787987918976:12345-192.168.204.26@tcp:35:umount.0 00000100:00100000:3.0:1788891036.137373:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+19:13143:x1875787987918976:12345-192.168.204.26@tcp:35:umount.0 Request processed in 380us (634us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788891036.137383:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:3.0:1788891036.144675:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891036.144809:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987919232 00000100:00100000:1.0:1788891036.144824:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987919232 00000100:00100000:1.0:1788891036.144898:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:1.0:1788891036.144911:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+19:13143:x1875787987919232:12345-192.168.204.26@tcp:35:umount.0 00000100:00100000:1.0:1788891036.145313:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df03475d-d91a-4e91-8125-742ac4d4c589+20:13143:x1875787987919232:12345-192.168.204.26@tcp:35:umount.0 Request processed in 403us (661us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788891036.145323:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:0.0:1788891036.149162:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891036.149418:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987919488 00000100:00100000:1.0:1788891036.149428:0:14588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987919488 00000100:00100000:1.0:1788891036.149513:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:1.0:1788891036.149582:0:14588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509047a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+20:13143:x1875787987919488:12345-192.168.204.26@tcp:35:umount.0 00000100:00100000:1.0:1788891036.149845:0:14588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509047a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:df03475d-d91a-4e91-8125-742ac4d4c589+21:13143:x1875787987919488:12345-192.168.204.26@tcp:35:umount.0 Request processed in 254us (680us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788891036.149854:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:0.0:1788891036.155514:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891036.155639:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987919744 00000100:00100000:3.0:1788891036.155648:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987919744 00000100:00100000:3.0:1788891036.155776:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:3.0:1788891036.155788:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+21:13143:x1875787987919744:12345-192.168.204.26@tcp:35:umount.0 00000100:00100000:3.0:1788891036.156089:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df03475d-d91a-4e91-8125-742ac4d4c589+22:13143:x1875787987919744:12345-192.168.204.26@tcp:35:umount.0 Request processed in 304us (584us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1788891036.156097:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:2.0:1788891036.160019:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891036.160063:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891036.160152:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987919872 00000100:00100000:0.0:1788891036.160162:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987919872 00000100:00100000:0.0:1788891036.160244:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987920000 00000100:00100000:0.0:1788891036.160247:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987920000 00000100:00100000:0.0:1788891036.160279:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:0.0:1788891036.160290:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83937480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+14:2392:x1875787987919872:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891036.160305:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891036.160326:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c6000/0xa66601b03fd52cfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd02 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891036.160342:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891036.160397:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83937480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+13:2392:x1875787987919872:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 108us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891036.160404:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:0.0:1788891036.160421:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:0.0:1788891036.160427:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:2392:x1875787987920000:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891036.160435:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891036.160444:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8be00/0xa66601b03fd52cbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddcc3 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891036.160454:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891036.160471:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:2392:x1875787987920000:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 44us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891036.160494:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:0.0:1788891036.165346:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891036.166174:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891036.166241:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987920256 00000100:00100000:2.0:1788891036.166250:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987920256 00000100:00100000:2.0:1788891036.166315:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:2.0:1788891036.166327:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+11:2391:x1875787987920256:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891036.166342:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891036.166364:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8b800/0xa66601b03fd52f90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddddb expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891036.166381:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891036.166452:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+10:2391:x1875787987920256:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 127us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891036.166460:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:1.0:1788891036.167229:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987920128 00000100:00100000:1.0:1788891036.167237:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987920128 00000100:00100000:1.0:1788891036.167335:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 80 00000100:00100000:1.0:1788891036.167345:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df03475d-d91a-4e91-8125-742ac4d4c589+5:2390:x1875787987920128:12345-192.168.204.26@tcp:9:umount.0 00000020:00000080:1.0:1788891036.167371:0:11803:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd5309a 00000100:00080000:1.0:1788891036.167380:0:11803:0:(import.c:65:import_set_state_nolock()) ffff924f832d8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788891036.167436:0:11803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788891036.167602:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df03475d-d91a-4e91-8125-742ac4d4c589+2:2390:x1875787987920128:12345-192.168.204.26@tcp:9:umount.0 Request processed in 258us (2264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891036.167609:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 80 00010000:00010000:3.0:1788891036.167771:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788891036.168310:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788891036.177496:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891036.177676:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987920640 00000100:00100000:2.0:1788891036.177686:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987920640 00000100:00100000:2.0:1788891036.177758:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 81 00000100:00100000:2.0:1788891036.177769:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b6b70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+7:2390:x1875787987920640:12345-192.168.204.26@tcp:9:umount.0 00000020:00000080:2.0:1788891036.177799:0:8596:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53309 00000020:00010000:2.0:1788891036.177806:0:8596:0:(genops.c:1921:obd_stale_export_put()) Put export ffff924f839d0000: total 0 00000100:00080000:2.0:1788891036.177811:0:8596:0:(import.c:65:import_set_state_nolock()) ffff924f839d1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788891036.177880:0:8596:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788891036.178051:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b6b70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df03475d-d91a-4e91-8125-742ac4d4c589+5:2390:x1875787987920640:12345-192.168.204.26@tcp:9:umount.0 Request processed in 284us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891036.178060:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 81 00000020:00010000:1.0:1788891036.178470:0:6484:0:(genops.c:1907:obd_stale_export_get()) Get export ffff924f839d0000: total 0 00010000:00010000:1.0:1788891036.178511:0:6484:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff924f839d0000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788891036.178584:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efd58ceb/0xa66601b03fd53d97 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de1a8 expref: 4 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891036.178620:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a817130c/0xa66601b03fd536c8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfc5 expref: 3 pid: 8596 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891036.178636:0:6484:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff924f839d0000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788891036.178648:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891036.178650:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891036.178652:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788891036.179155:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788891036.194991:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891036.195240:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987921664 00000100:00100000:2.0:1788891036.195253:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987921664 00000100:00100000:2.0:1788891036.195331:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 257 00000100:00100000:2.0:1788891036.195344:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+22:2390:x1875787987921664:12345-192.168.204.26@tcp:39:umount.0 00000020:00000080:2.0:1788891036.195397:0:6496:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52ccd 00000020:00010000:2.0:1788891036.195419:0:6496:0:(genops.c:1921:obd_stale_export_put()) Put export ffff924f8325e800: total 0 00000100:00080000:2.0:1788891036.195425:0:6496:0:(import.c:65:import_set_state_nolock()) ffff924f8325f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788891036.195465:0:6496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1788891036.195720:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df03475d-d91a-4e91-8125-742ac4d4c589+21:2390:x1875787987921664:12345-192.168.204.26@tcp:39:umount.0 Request processed in 379us (745us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1788891036.195729:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 257 00000020:00010000:3.0:1788891036.195945:0:6485:0:(genops.c:1907:obd_stale_export_get()) Get export ffff924f8325e800: total 0 00010000:00010000:3.0:1788891036.196020:0:6485:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff924f8325e800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788891036.196065:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9250b65fcc00) 00010000:00010000:3.0:1788891036.196070:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788891036.196079:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd52ff9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddde9 expref: 20 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891036.196107:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:3.0:1788891036.196110:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788891036.196115:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031800/0xa66601b03fd5374d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfe8 expref: 19 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891036.196130:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:3.0:1788891036.196133:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788891036.196155:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522a00/0xa66601b03fd53d58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de193 expref: 18 pid: 9362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891036.196174:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:3.0:1788891036.196176:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788891036.196181:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd535a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddf78 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891036.196194:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff924f82e36b00) 00010000:00010000:3.0:1788891036.196197:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788891036.196201:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031200/0xa66601b03fd53a3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de0c1 expref: 16 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891036.196218:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250b65fd200) 00010000:00010000:3.0:1788891036.196220:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788891036.196224:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd53731 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfe1 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891036.196236:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:3.0:1788891036.196239:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788891036.196243:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd53d82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de1a1 expref: 14 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891036.196257:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:3.0:1788891036.196259:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788891036.196263:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd53070 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dde05 expref: 13 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891036.196276:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff924f82e34a00) 00010000:00010000:3.0:1788891036.196284:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788891036.196289:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df400/0xa66601b03fd53c78 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de15b expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891036.196307:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:3.0:1788891036.196310:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788891036.196314:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dec00/0xa66601b03fd536b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfbe expref: 11 pid: 12407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891036.196326:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff925095f80700) 00010000:00010000:3.0:1788891036.196329:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788891036.196332:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311e00/0xa66601b03fd5336b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddede expref: 10 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891036.196348:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9250905a3b00) 00010000:00010000:3.0:1788891036.196351:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891036.196354:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925081522e00/0xa66601b03fd53015 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddf0 expref: 9 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891036.196383:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff925095f80800) 00010000:00010000:3.0:1788891036.196386:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788891036.196390:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd53689 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddfb0 expref: 8 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891036.196404:0:6485:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff924f8325e800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788891036.196421:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891036.196423:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891036.196425:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891036.205780:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891036.206046:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987921792 00000100:00100000:3.0:1788891036.206078:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987921792 00000100:00100000:3.0:1788891036.206185:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 258 00000100:00100000:3.0:1788891036.206198:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+5:2390:x1875787987921792:12345-192.168.204.26@tcp:39:umount.0 00000020:00000080:3.0:1788891036.206240:0:6497:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52cd4 00000100:00080000:3.0:1788891036.206263:0:6497:0:(import.c:65:import_set_state_nolock()) ffff924f81c25000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788891036.206302:0:6497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788891036.206545:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df03475d-d91a-4e91-8125-742ac4d4c589+3:2390:x1875787987921792:12345-192.168.204.26@tcp:39:umount.0 Request processed in 325us (758us total) trans 4294967299 rc 0/0 00000100:00080000:0.0:1788891036.206825:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788891036.206938:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 258 00010000:00010000:2.0:1788891036.207709:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891036.607136:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788891036.801906:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of df03475d-d91a-4e91-8125-742ac4d4c589 00000001:00080000:2.0:1788891036.801921:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1788891036.801936:0:6475:0:(genops.c:885:class_export_put()) final put ffff924f8325e800/df03475d-d91a-4e91-8125-742ac4d4c589 00000020:00080000:2.0:1788891036.802106:0:6475:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1788891036.802162:0:6527:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788891036.802181:0:6527:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00000080:1.0:1788891036.803510:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f8325e800/df03475d-d91a-4e91-8125-742ac4d4c589 for lustre-MDT0000 00000020:00000080:1.0:1788891036.804201:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f8325f800 for lustre-MDT0000 00000100:00100000:1.0:1788891037.307887:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997384192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788891037.307964:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891037.308142:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997384192 00000100:00100000:1.0:1788891037.308151:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997384192 00000100:00100000:1.0:1788891037.308202:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788891037.308211:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997384192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788891037.308238:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788891037.308276:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997384192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891037.308282:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788891037.308323:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997384192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788891037.308416:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788891037.308424:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83934700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997384448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788891037.308451:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891037.308488:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997384448 00000100:00100000:2.0:1788891037.308491:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997384448 00000100:00100000:2.0:1788891037.308675:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788891037.308683:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997384448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788891037.308705:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788891037.308737:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997384448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891037.308743:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788891037.308781:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83934700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997384448:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788891037.308804:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788891037.309739:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788891037.309756:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997384320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788891037.309792:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891037.311276:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997384320 00000100:00100000:1.0:1788891037.311286:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997384320 00000100:00100000:1.0:1788891037.311341:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788891037.311348:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997384320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788891037.311368:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788891037.311419:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997384320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891037.311426:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1788891037.311469:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788891037.314280:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997384320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788891037.343902:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891037.343941:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891037.344124:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891037.347723:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987921920 00000100:00100000:2.0:1788891037.347745:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987921920 00000100:00100000:3.0:1788891037.347765:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987922048 00000100:00100000:3.0:1788891037.347773:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987922048 00000100:00100000:2.0:1788891037.347845:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987922176 00000100:00100000:2.0:1788891037.347850:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987922176 00000100:00100000:3.0:1788891037.347876:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:3.0:1788891037.347891:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087acc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:2393:x1875787987921920:12345-192.168.204.26@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788891037.347893:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:2.0:1788891037.347907:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:2393:x1875787987922048:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891037.347915:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891037.347919:0:10317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788891037.347921:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:0.0:1788891037.347935:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+12:2391:x1875787987922176:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891037.347947:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891037.347948:0:10317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8ae00/0xa66601b03fd52dd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd48 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891037.347949:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae4200/0xa66601b03fd52dd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd17 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891037.347962:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8b600/0xa66601b03fd52f89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204dddd4 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891037.347984:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891037.347984:0:10317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788891037.347984:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891037.348059:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+9:2393:x1875787987922048:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 154us (4116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891037.348065:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+9:2391:x1875787987922176:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 131us (3938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891037.348074:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:0.0:1788891037.348081:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:3.0:1788891037.348104:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087acc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+7:2393:x1875787987921920:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 216us (4216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891037.348112:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:1.0:1788891037.356249:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891037.356685:0:9362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987922432 00000100:00100000:3.0:1788891037.356700:0:9362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987922432 00000100:00080000:1.0:1788891037.357331:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891037.357403:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 259 00000100:00100000:3.0:1788891037.357418:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+6:2390:x1875787987922432:12345-192.168.204.26@tcp:39:umount.0 00000020:00000080:3.0:1788891037.357472:0:9362:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52de5 00000020:00010000:3.0:1788891037.357482:0:9362:0:(genops.c:1921:obd_stale_export_put()) Put export ffff924f83372800: total 0 00000100:00080000:3.0:1788891037.357504:0:9362:0:(import.c:65:import_set_state_nolock()) ffff924f83374800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788891037.357572:0:9362:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00010000:2.0:1788891037.357651:0:10316:0:(genops.c:1907:obd_stale_export_get()) Get export ffff924f83372800: total 0 00000100:00100000:3.0:1788891037.357822:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2390:x1875787987922432:12345-192.168.204.26@tcp:39:umount.0 Request processed in 407us (1586us total) trans 4294967529 rc 0/0 00000100:00100000:3.0:1788891037.357832:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 259 00010000:00010000:2.0:1788891037.357949:0:10316:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff924f83372800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788891037.357984:0:10316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250b65fd200) 00010000:00010000:2.0:1788891037.357988:0:10316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788891037.357996:0:10316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925080031c00/0xa66601b03fd53da5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de1af expref: 4 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891037.358020:0:10316:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff924f83372800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788891037.358047:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891037.358049:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891037.358052:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891037.366443:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891037.366590:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987922560 00000100:00100000:1.0:1788891037.366623:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987922560 00000100:00080000:2.0:1788891037.366708:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788891037.366727:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 260 00000100:00100000:1.0:1788891037.366739:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c240b24-a098-4d30-bfbf-dd53172bbf52+5:2390:x1875787987922560:12345-192.168.204.26@tcp:39:umount.0 00000020:00000080:1.0:1788891037.366781:0:6496:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52dec 00000100:00080000:1.0:1788891037.366790:0:6496:0:(import.c:65:import_set_state_nolock()) ffff924f832d9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788891037.366825:0:6496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788891037.366990:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1c240b24-a098-4d30-bfbf-dd53172bbf52+3:2390:x1875787987922560:12345-192.168.204.26@tcp:39:umount.0 Request processed in 250us (561us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788891037.366998:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 260 00010000:00010000:2.0:1788891037.367058:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891037.398739:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891037.398920:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987922816 00000100:00100000:3.0:1788891037.398995:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987922816 00000100:00100000:3.0:1788891037.399060:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 371 00000100:00100000:3.0:1788891037.399075:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+7:2390:x1875787987922816:12345-192.168.204.26@tcp:251:umount.0 00000020:00000080:3.0:1788891037.399121:0:6491:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52caa 00000020:00010000:3.0:1788891037.399130:0:6491:0:(genops.c:1921:obd_stale_export_put()) Put export ffff924f83258800: total 0 00000100:00080000:3.0:1788891037.399134:0:6491:0:(import.c:65:import_set_state_nolock()) ffff924f8325a000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788891037.399319:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:006bd3d3-7a27-4ed0-8905-1d0eccd862a9+3:2390:x1875787987922816:12345-192.168.204.26@tcp:251:umount.0 Request processed in 249us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891037.399328:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 371 00000020:00010000:2.0:1788891037.401860:0:6485:0:(genops.c:1907:obd_stale_export_get()) Get export ffff924f83258800: total 0 00010000:00010000:2.0:1788891037.401926:0:6485:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff924f83258800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788891037.401965:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813ed200/0xa66601b03fd52d05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204ddd09 expref: 2 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891037.401983:0:6485:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff924f83258800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788891037.401994:0:6485:0:(genops.c:885:class_export_put()) final put ffff924f83258800/006bd3d3-7a27-4ed0-8905-1d0eccd862a9 00010000:00010000:2.0:1788891037.402062:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891037.402064:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891037.402067:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788891037.402091:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f83258800/006bd3d3-7a27-4ed0-8905-1d0eccd862a9 for MGS 00000020:00000080:3.0:1788891037.402237:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f8325a000 for MGS 00010000:00010000:2.0:1788891037.630653:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891038.333208:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997384576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788891038.333290:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891038.335702:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997384576 00000100:00100000:0.0:1788891038.335722:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997384576 00000100:00100000:0.0:1788891038.335798:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788891038.335808:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997384576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788891038.335860:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788891038.336965:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997384576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1155us (3672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891038.336976:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788891038.337637:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997384576:0@lo:41:osp-pre-0-1.0 00000020:01000004:2.0:1788891038.552401:0:15120:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788891038.573974:0:15120:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788891038.574037:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd52d98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.574053:0:15120:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd52d98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52d9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.574061:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd52d98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52d9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.574068:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd52d98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52d9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.574108:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788891038.574113:0:15120:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788891038.574140:0:15120:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788891038.574145:0:15120:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788891038.574151:0:15120:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788891038.574176:0:15120:0:(import.c:65:import_set_state_nolock()) ffff9250c122d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788891038.574238:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875787997384704:0@lo:39:umount.0 00000100:00100000:3.0:1788891038.574306:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891038.574454:0:12407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997384704 00000100:00100000:0.0:1788891038.574462:0:12407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997384704 00000100:00100000:0.0:1788891038.574515:0:12407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788891038.574552:0:12407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875787997384704:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788891038.574579:0:12407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd528c1 00000100:00080000:0.0:1788891038.574586:0:12407:0:(import.c:65:import_set_state_nolock()) ffff92508475c800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788891038.575706:0:10314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891038.575717:0:10314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd52d98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52d9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.575726:0:10314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7400 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788891038.575731:0:10314:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd52d98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52d9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.575740:0:10314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd52d98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd52d9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891038.575748:0:10314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd52d98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd52d9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891038.575754:0:10314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788891038.575769:0:10314:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788891038.575771:0:10314:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788891038.575804:0:10314:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd52d98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52d9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.575811:0:10314:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788891038.575838:0:10314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd52d98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52d9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.575846:0:10314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd52d98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52d9f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.575860:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891038.575862:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891038.575864:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891038.575872:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788891038.575886:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997384832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891038.575934:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891038.575982:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997384832 00000100:00100000:1.0:1788891038.575987:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997384832 00000100:00100000:1.0:1788891038.576027:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788891038.576051:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc9e9f5-fe04-4428-a993-651ed6fecbec+24:3628:x1875787997384832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891038.576063:0:10317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891038.576079:0:10317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8b200/0xa66601b03fd52d9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd52d98 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.576092:0:10317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891038.576126:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:3628:x1875787997384832:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891038.576133:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788891038.576272:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997384832:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891038.576313:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891038.576417:0:12407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3626:x1875787997384704:12345-0@lo:39:umount.0 Request processed in 1866us (2108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891038.576427:0:12407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:3.0:1788891038.576428:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250c122d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:0.0:1788891038.576438:0:12407:0:(genops.c:885:class_export_put()) final put ffff925084759800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1788891038.576452:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875787997384704:0@lo:39:umount.0 00000100:00080000:2.0:1788891038.576480:0:15120:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788891038.576484:0:15120:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788891038.576489:0:15120:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788891038.577491:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c6200/0xa66601b03fd52da6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52dad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.577505:0:15120:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c6200/0xa66601b03fd52da6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52dad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.577512:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c6200/0xa66601b03fd52da6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52dad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.577519:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9250b69c6200/0xa66601b03fd52da6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52dad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.577620:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891038.577628:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7200/0xa66601b03fd52c64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c6b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.577635:0:15120:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7200/0xa66601b03fd52c64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52c6b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.577657:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7200/0xa66601b03fd52c64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52c6b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.577664:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9250b69c7200/0xa66601b03fd52c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52c6b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.577679:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788891038.577693:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788891038.577699:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250b69c6200/0xa66601b03fd52da6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52dad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.577707:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6200 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891038.577711:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c6200/0xa66601b03fd52da6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52dad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.577719:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250b69c6200/0xa66601b03fd52da6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd52dad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891038.577726:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c6200/0xa66601b03fd52da6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd52dad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891038.577732:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788891038.577735:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788891038.577757:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250b69c6200/0xa66601b03fd52da6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52dad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.577764:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788891038.577837:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891038.577843:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250b69c7200/0xa66601b03fd52c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52c6b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.577851:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7200 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:3.0:1788891038.577854:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c7200/0xa66601b03fd52c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52c6b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.577869:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250b69c7200/0xa66601b03fd52c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd52c6b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788891038.577876:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c7200/0xa66601b03fd52c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd52c6b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891038.577881:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788891038.577883:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788891038.577885:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788891038.577900:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250b69c7200/0xa66601b03fd52c64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52c6b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.577906:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788891038.577929:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250b69c7200/0xa66601b03fd52c64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52c6b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.577937:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250b69c7200/0xa66601b03fd52c64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52c6b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891038.577945:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997385088:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788891038.577951:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891038.577954:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891038.577957:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891038.577984:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52fc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52fc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.577993:0:15120:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52fc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52fc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891038.578002:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788891038.578005:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52fc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52fc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.578024:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52fc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52fc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.578040:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891038.578047:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925080031600/0xa66601b03fd52820 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52827 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.578053:0:15120:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925080031600/0xa66601b03fd52820 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52827 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.578058:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925080031600/0xa66601b03fd52820 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52827 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.578064:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff925080031600/0xa66601b03fd52820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52827 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.578077:0:15120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788891038.578080:0:15120:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788891038.578084:0:15120:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:0.0:1788891038.578117:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997385088 00000020:01000004:3.0:1788891038.578119:0:15120:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000100:00100000:0.0:1788891038.578124:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997385088 00000020:01000000:3.0:1788891038.578125:0:15120:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788891038.578131:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891038.578138:0:15120:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1788891038.578144:0:15120:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff924f82ead800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788891038.578151:0:15120:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff924f81c23800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788891038.578157:0:15120:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9250c1532000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788891038.578163:0:15120:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9250b6774000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000100:00100000:0.0:1788891038.578168:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788891038.578179:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:3629:x1875787997385088:12345-0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788891038.578187:0:15120:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff924f83372800 1c240b24-a098-4d30-bfbf-dd53172bbf52 192.168.204.26@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788891038.578193:0:15120:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff92508f413370) has exports, disconnecting them 00010000:00010000:0.0:1788891038.578194:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:3.0:1788891038.578200:0:15120:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff924f82ead800), last request at 1788891035 00000020:00000080:3.0:1788891038.578209:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52bd1 00010000:00010000:0.0:1788891038.578212:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c7600/0xa66601b03fd52c6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd52c64 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788891038.578226:0:15120:0:(import.c:65:import_set_state_nolock()) ffff924f82ea8800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788891038.578228:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:1.0:1788891038.578239:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff925084759800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1788891038.578272:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:3629:x1875787997385088:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891038.578281:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00080000:3.0:1788891038.578284:0:15120:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff924f82ead800): rc 0 00000020:00000080:3.0:1788891038.578289:0:15120:0:(genops.c:885:class_export_put()) final put ffff924f82ead800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788891038.578297:0:15120:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff924f81c23800), last request at 1788891035 00000020:00000080:3.0:1788891038.578302:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52aab 00000020:00000080:1.0:1788891038.578302:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92508475c800 for lustre-MDT0000 00000100:00080000:3.0:1788891038.578312:0:15120:0:(import.c:65:import_set_state_nolock()) ffff924f81c26000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788891038.578313:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f82ead800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:3.0:1788891038.578329:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788891038.578335:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52fc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52fc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.578342:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a200 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:3.0:1788891038.578346:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52fc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52fc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.578354:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52fc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd52fc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788891038.578355:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f82ea8800 for lustre-MDT0000 10000000:00010000:3.0:1788891038.578365:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52fc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd52fc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.578370:0:10316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1788891038.578372:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788891038.578377:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788891038.578377:0:10316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925080031600/0xa66601b03fd52820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52827 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891038.578379:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788891038.578389:0:10316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080031600 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788891038.578393:0:10316:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925080031600/0xa66601b03fd52820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52827 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.578395:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52fc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52fc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.578407:0:10316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925080031600/0xa66601b03fd52820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd52827 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891038.578426:0:10316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925080031600/0xa66601b03fd52820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd52827 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.578427:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1788891038.578437:0:10316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1788891038.578441:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52fc1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52fc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891038.578441:0:10316:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788891038.578445:0:10316:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788891038.578452:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8a200/0xa66601b03fd52fc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52fc8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.578464:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891038.578466:0:10316:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925080031600/0xa66601b03fd52820 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52827 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.578467:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891038.578470:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891038.578477:0:10316:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788891038.578483:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997385216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788891038.578489:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997385088:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891038.578495:0:10316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925080031600/0xa66601b03fd52820 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52827 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.578515:0:10316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925080031600/0xa66601b03fd52820 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52827 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891038.578544:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788891038.578546:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891038.578549:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891038.578552:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891038.578565:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997385344:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788891038.578586:0:15120:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff924f81c23800): rc 0 00000020:00000080:3.0:1788891038.578589:0:15120:0:(genops.c:885:class_export_put()) final put ffff924f81c23800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788891038.578598:0:15120:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9250c1532000), last request at 1788890874 00000020:00000080:3.0:1788891038.578601:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd529a8 00000100:00080000:3.0:1788891038.578605:0:15120:0:(import.c:65:import_set_state_nolock()) ffff9250c1537800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788891038.578629:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788891038.578636:0:15120:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9250c1532000): rc 0 00000020:00000080:3.0:1788891038.578638:0:15120:0:(genops.c:885:class_export_put()) final put ffff9250c1532000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788891038.578643:0:15120:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9250b6774000), last request at 1788890874 00000020:00000080:3.0:1788891038.578646:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52969 00000100:00080000:3.0:1788891038.578650:0:15120:0:(import.c:65:import_set_state_nolock()) ffff9250c12d8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788891038.578659:0:15120:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00080000:3.0:1788891038.578731:0:15120:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9250b6774000): rc 0 00000004:00000080:3.0:1788891038.578738:0:15120:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbbfc48647ae0 00000100:00080000:3.0:1788891038.578757:0:15120:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788891038.578765:0:15120:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:1.0:1788891038.578852:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891038.578886:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997385216 00000100:00100000:1.0:1788891038.578891:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997385216 00000100:00100000:1.0:1788891038.578917:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997385344 00000100:00100000:1.0:1788891038.578920:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997385344 00000100:00100000:1.0:1788891038.578937:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788891038.578944:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+23:3630:x1875787997385216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891038.578953:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891038.578964:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c6400/0xa66601b03fd52fc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd52fc1 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.578974:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891038.579006:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+22:3630:x1875787997385216:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891038.579013:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788891038.579026:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788891038.579033:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+21:3627:x1875787997385344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891038.579040:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891038.579050:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925081522c00/0xa66601b03fd52827 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd52820 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.579065:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891038.579091:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:3627:x1875787997385344:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891038.579097:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788891038.579125:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997385216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891038.579143:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891038.579387:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997385344:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891038.579411:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788891038.579423:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81c23800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788891038.579452:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9250c1532000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788891038.579473:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f81c26000 for lustre-MDT0000 00000020:00000080:1.0:1788891038.579478:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9250c1537800 for lustre-MDT0000 00000100:00080000:3.0:1788891038.579658:0:15120:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788891038.579675:0:15120:0:(import.c:65:import_set_state_nolock()) ffff9250c10e2000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788891038.579714:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788891038.579847:0:15120:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788891038.579851:0:15120:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1788891038.579860:0:15120:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788891038.579925:0:15120:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788891038.579936:0:15120:0:(import.c:65:import_set_state_nolock()) ffff9250ba96c000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788891038.579943:0:15120:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788891038.579945:0:15120:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1788891038.579954:0:15120:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788891038.580023:0:15120:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788891038.580035:0:15120:0:(import.c:65:import_set_state_nolock()) ffff924f81c20000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788891038.580064:0:15120:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff92508f413370) has no exports 00010000:00010000:2.0:1788891038.580152:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250b69c6200/0xa66601b03fd52da6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52dad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.580175:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250b69c6200/0xa66601b03fd52da6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52dad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.580187:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891038.580189:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891038.580190:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891038.580199:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788891038.580211:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997384960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891038.580263:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891038.580287:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997385472:0@lo:39:umount.0 00000100:00100000:1.0:1788891038.580329:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891038.580367:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997384960 00000100:00100000:0.0:1788891038.580374:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997384960 00000100:00100000:0.0:1788891038.580411:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788891038.580418:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087acf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+20:3627:x1875787997384960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788891038.580429:0:7436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891038.580442:0:7436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8bc00/0xa66601b03fd52dad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd52da6 expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.580453:0:7436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891038.580486:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087acf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:3627:x1875787997384960:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891038.580494:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788891038.580568:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3627:1875787997384960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891038.580959:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997385600:0@lo:9:umount.0 00000100:00100000:1.0:1788891038.580988:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891038.581016:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997385728:0@lo:9:umount.0 00000100:00100000:1.0:1788891038.581038:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891038.581082:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997385600 00000100:00100000:1.0:1788891038.581086:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997385600 00000100:00100000:3.0:1788891038.581263:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997385728 00000100:00100000:3.0:1788891038.581268:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997385728 00000100:00100000:3.0:1788891038.581321:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788891038.581329:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875787997385728:12345-0@lo:9:umount.0 00000100:00100000:1.0:1788891038.581349:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000020:00000080:3.0:1788891038.581354:0:8408:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52ca3 00000100:00100000:1.0:1788891038.581361:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3626:x1875787997385600:12345-0@lo:9:umount.0 00000100:00080000:3.0:1788891038.581365:0:8408:0:(import.c:65:import_set_state_nolock()) ffff9250baadd800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788891038.581405:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000020:00000080:1.0:1788891038.581567:0:11803:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52b61 00000100:00100000:3.0:1788891038.581574:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3626:x1875787997385728:12345-0@lo:9:umount.0 Request processed in 245us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891038.581583:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:3.0:1788891038.581600:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788891038.581689:0:11803:0:(import.c:65:import_set_state_nolock()) ffff924f81770800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788891038.581731:0:11803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:0.0:1788891038.581743:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788891038.581825:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997385472 00000100:00100000:1.0:1788891038.581826:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3626:x1875787997385600:12345-0@lo:9:umount.0 Request processed in 467us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891038.581832:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997385472 00000100:00100000:1.0:1788891038.581839:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788891038.581868:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788891038.581877:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875787997385472:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788891038.581894:0:7721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52a03 00000100:00080000:2.0:1788891038.581899:0:7721:0:(import.c:65:import_set_state_nolock()) ffff9250ba8e1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788891038.581918:0:7721:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1788891038.582031:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3626:x1875787997385472:12345-0@lo:39:umount.0 Request processed in 155us (1701us total) trans 4294967301 rc 0/0 00010000:00010000:1.0:1788891038.582039:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891038.582040:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00010000:00010000:2.0:1788891038.582065:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788891038.582073:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250c10e2000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788891038.582082:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997385472:0@lo:39:umount.0 00000100:00080000:1.0:1788891038.582094:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250ba96c000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788891038.582160:0:3626:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788891038.582261:0:3626:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788891038.582266:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997385600:0@lo:9:umount.0 00000100:00080000:1.0:1788891038.582282:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f81c20000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788891038.582297:0:3626:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788891038.582299:0:3626:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788891038.582302:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997385728:0@lo:9:umount.0 00000020:00080000:1.0:1788891038.585361:0:15120:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff92508f413370) has no exports 00000020:00000080:1.0:1788891038.630937:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd5287b 00000020:00000080:1.0:1788891038.630957:0:15120:0:(genops.c:885:class_export_put()) final put ffff92508477a800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788891038.630976:0:15120:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788891038.631067:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92508477a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788891038.631217:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788891038.631231:0:15120:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788891038.631237:0:15120:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff92508f414d28) has no exports 00000020:00000080:0.0:1788891038.631849:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52874 00000020:00000080:0.0:1788891038.631855:0:15120:0:(genops.c:885:class_export_put()) final put ffff9250c10e0800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788891038.631909:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891038.631918:0:15120:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788891038.631921:0:15120:0:(genops.c:885:class_export_put()) final put ffff92508f425800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788891038.631923:0:15120:0:(genops.c:844:class_export_destroy()) destroying export ffff92508f425800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788891038.631932:0:15120:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788891038.632023:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9250c10e0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788891038.652341:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891039.675971:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891040.380185:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997386112:0@lo:400:kworker.0 00000100:00100000:3.0:1788891040.380195:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997385984:0@lo:400:kworker.0 00000100:00100000:2.0:1788891040.380295:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997385856:0@lo:400:kworker.0 00000100:00100000:0.0:1788891040.380344:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997386240:0@lo:400:kworker.0 00000100:00100000:1.0:1788891040.380830:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891040.380886:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1875787997386624:0@lo:400:kworker.0 00000100:00100000:1.0:1788891040.380911:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891040.380958:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997386112 00000100:00100000:1.0:1788891040.380965:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997386112 00000100:00100000:1.0:1788891040.381117:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997386624 00000100:00100000:1.0:1788891040.381122:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997386624 00000100:00100000:1.0:1788891040.381143:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788891040.381158:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c1262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3630:x1875787997386112:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788891040.381167:0:6495:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788891040.381210:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c1262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3630:x1875787997386112:12345-0@lo:400:kworker.0 Request processed in 51us (381us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788891040.381217:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788891040.381235:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788891040.381239:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3630:x1875787997386624:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788891040.381244:0:6495:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788891040.381267:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3630:x1875787997386624:12345-0@lo:400:kworker.0 Request processed in 26us (355us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788891040.381272:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788891040.381307:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788891040.381327:0:3630:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788891040.381333:0:3630:0:(import.c:65:import_set_state_nolock()) ffff9250c10e4800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788891040.381338:0:3630:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788891040.381340:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997386496:0@lo:400:kworker.0 00000100:00100000:3.0:1788891040.381431:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891040.381639:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997386496 00000100:00100000:3.0:1788891040.381644:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997386496 00000100:00100000:3.0:1788891040.381693:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788891040.381702:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997386496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891040.381711:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891040.381751:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997386368:0@lo:400:kworker.0 00000100:00100000:3.0:1788891040.381759:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997386496:12345-0@lo:400:kworker.0 Request processed in 58us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891040.381770:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788891040.381795:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788891040.381802:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788891040.381821:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997386880:0@lo:400:kworker.0 00000100:00100000:3.0:1788891040.381835:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997386496:0@lo:400:kworker.0 00000100:00100000:2.0:1788891040.381849:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891040.381878:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997386368 00000100:00100000:3.0:1788891040.381883:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997386368 00000100:00100000:2.0:1788891040.381903:0:8596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997386880 00000100:00100000:2.0:1788891040.381909:0:8596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997386880 00000100:00100000:3.0:1788891040.381918:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788891040.381927:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875787997386368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891040.381945:0:8596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788891040.381957:0:8596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997386880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891040.381972:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875787997386368:12345-0@lo:400:kworker.0 Request processed in 46us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891040.381979:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788891040.382000:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997385856 00000100:00100000:3.0:1788891040.382005:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997385856 00000100:00100000:2.0:1788891040.382012:0:8596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997386880:12345-0@lo:400:kworker.0 Request processed in 59us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891040.382021:0:8596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788891040.382034:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788891040.382043:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509144f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:3628:x1875787997385856:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788891040.382067:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf6cd180 x1875787997386368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891040.382079:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509144f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0dc9e9f5-fe04-4428-a993-651ed6fecbec+19:3628:x1875787997385856:12345-0@lo:400:kworker.0 Request processed in 35us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891040.382084:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997386368:0@lo:400:kworker.0 00000100:00100000:3.0:1788891040.382091:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788891040.382102:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997386880:0@lo:400:kworker.0 00000100:00100000:2.0:1788891040.382124:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997385856:0@lo:400:kworker.0 00000100:00100000:2.0:1788891040.382164:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997385984 00000100:00100000:2.0:1788891040.382168:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997385984 00000100:00100000:2.0:1788891040.382191:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788891040.382197:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1875787997385984:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788891040.382202:0:6501:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788891040.382235:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1875787997385984:12345-0@lo:400:kworker.0 Request processed in 37us (930us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788891040.382241:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:2.0:1788891040.382268:0:3629:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788891040.382271:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9250c1535800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788891040.382282:0:3629:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788891040.382288:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9250c1535800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788891040.382292:0:3629:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 96 00000100:00080000:2.0:1788891040.382298:0:3629:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9250c1535800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788891040.382321:0:3629:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83adf100 x1875787997387008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788891040.382340:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997385984:0@lo:400:kworker.0 00000100:00100000:2.0:1788891040.382361:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997387008:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788891040.382387:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891040.382413:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997387008 00000100:00100000:2.0:1788891040.382417:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997387008 00000100:00100000:2.0:1788891040.382433:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788891040.382438:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1875787997387008:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1788891040.382452:0:6500:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788891040.383246:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891040.383277:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997386752:0@lo:400:kworker.0 00000100:00100000:0.0:1788891040.383303:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891040.383350:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997386240 00000100:00100000:0.0:1788891040.383354:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997386240 00000100:00100000:0.0:1788891040.383375:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997386752 00000100:00100000:0.0:1788891040.383378:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997386752 00000100:00100000:0.0:1788891040.383401:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788891040.383408:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997386752:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788891040.383444:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788891040.383450:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997386752:12345-0@lo:400:kworker.0 Request processed in 41us (143us total) trans 0 rc 0/0 00000100:00080000:3.0:1788891040.383452:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788891040.383460:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788891040.383471:0:9362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788891040.383479:0:9362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3627:x1875787997386240:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788891040.383486:0:9362:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00010000:00080000:0.0:1788891040.383504:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c1262a00 x1875787997386752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891040.383517:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997386752:0@lo:400:kworker.0 00000100:00080000:0.0:1788891040.383627:0:3627:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788891040.383632:0:3627:0:(import.c:65:import_set_state_nolock()) ffff924f81ede000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788891040.383635:0:3627:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788891040.383640:0:3627:0:(import.c:65:import_set_state_nolock()) ffff924f81ede000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891040.383643:0:3627:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 112 00000100:00080000:0.0:1788891040.383648:0:3627:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff924f81ede000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891040.383665:0:3627:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83a5f100 x1875787997387136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788891040.383684:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997386240:0@lo:400:kworker.0 00000100:00100000:0.0:1788891040.383724:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1875787997387136:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788891040.383919:0:9362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3627:x1875787997386240:12345-0@lo:400:kworker.0 Request processed in 439us (674us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788891040.383926:0:9362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788891040.383947:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891040.383986:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997387136 00000100:00100000:3.0:1788891040.383991:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997387136 00000100:00100000:3.0:1788891040.384012:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788891040.384017:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875787997387136:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788891040.384028:0:6497:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788891040.384063:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875787997387136:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 43us (116us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788891040.384069:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1788891040.384098:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f81ede000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788891040.384103:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788891040.384106:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1875787997387136:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788891040.388566:0:3630:0:(import.c:65:import_set_state_nolock()) ffff9250c10e4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788891040.388588:0:3630:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 96 00000100:00080000:1.0:1788891040.388602:0:3630:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9250c10e4800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891040.388665:0:3630:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f831dad80 x1875787997387264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788891040.388707:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997386112:0@lo:400:kworker.0 00000100:00080000:1.0:1788891040.388754:0:3630:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788891040.388758:0:3630:0:(import.c:65:import_set_state_nolock()) ffff924f82210800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788891040.388764:0:3630:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788891040.388770:0:3630:0:(import.c:65:import_set_state_nolock()) ffff924f82210800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788891040.388770:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875787997387264:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1788891040.388798:0:3630:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 133 00000100:00080000:1.0:1788891040.388811:0:3630:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff924f82210800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891040.388836:0:3630:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83badf80 x1875787997387392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788891040.388855:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1875787997386624:0@lo:400:kworker.0 00000100:00100000:0.0:1788891040.388894:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891040.388943:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997387264 00000100:00100000:1.0:1788891040.388952:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997387264 00000100:00100000:0.0:1788891040.388962:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1875787997387392:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788891040.388993:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891040.389493:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997387392 00000100:00100000:1.0:1788891040.389499:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997387392 00000100:00100000:1.0:1788891040.389566:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788891040.389584:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3626:x1875787997387264:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1788891040.389605:0:6496:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788891040.389633:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788891040.389645:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3626:x1875787997387392:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1788891040.389666:0:14295:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788891040.389695:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3626:x1875787997387264:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 116us (800us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788891040.389705:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788891040.389733:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3626:x1875787997387392:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 86us (735us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788891040.389744:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1788891040.389774:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f82210800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788891040.389782:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788891040.389787:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1875787997387392:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1788891040.389803:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250c10e4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788891040.389808:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788891040.389812:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875787997387264:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788891040.397204:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1875787997387008:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 14753us (14805us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788891040.397219:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:1.0:1788891040.397710:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250c1535800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788891040.397717:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788891040.397723:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997387008:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1788891040.699774:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891040.892072:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997387520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788891040.892179:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891040.892239:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997387520 00000100:00100000:1.0:1788891040.892266:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997387520 00000100:00100000:1.0:1788891040.892408:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788891040.892420:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997387520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788891040.892456:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788891040.892703:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997387520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 285us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891040.892711:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788891040.892735:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997387520:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788891041.727947:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788891041.918439:0:7425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788891041.918453:0:7425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1788891041.918459:0:7425:0:(genops.c:885:class_export_put()) final put ffff9250c10e1800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788891041.918625:0:7425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1c240b24-a098-4d30-bfbf-dd53172bbf52 00000001:00080000:2.0:1788891041.918632:0:7425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1788891041.918635:0:7425:0:(genops.c:885:class_export_put()) final put ffff924f832db800/1c240b24-a098-4d30-bfbf-dd53172bbf52 00000001:00100000:0.0:1788891041.918836:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788891041.918840:0:8404:0:(genops.c:885:class_export_put()) final put ffff924f81777000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788891041.918973:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9250c10e1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788891041.919216:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9250ba8e1000 for lustre-MDT0001 00000001:00100000:2.0:1788891041.919306:0:7425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of df03475d-d91a-4e91-8125-742ac4d4c589 00000001:00080000:2.0:1788891041.919312:0:7425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1788891041.919314:0:7425:0:(genops.c:885:class_export_put()) final put ffff924f8325d800/df03475d-d91a-4e91-8125-742ac4d4c589 00000001:00100000:0.0:1788891041.919380:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df03475d-d91a-4e91-8125-742ac4d4c589 00000020:00000080:0.0:1788891041.919383:0:8404:0:(genops.c:885:class_export_put()) final put ffff924f839d0000/df03475d-d91a-4e91-8125-742ac4d4c589 00000020:00000080:3.0:1788891041.920177:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f832db800/1c240b24-a098-4d30-bfbf-dd53172bbf52 for lustre-MDT0001 00000020:00000080:3.0:1788891041.920227:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f8325d800/df03475d-d91a-4e91-8125-742ac4d4c589 for lustre-MDT0001 00000020:00000080:3.0:1788891041.920260:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81777000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788891041.920288:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f839d0000/df03475d-d91a-4e91-8125-742ac4d4c589 for lustre-OST0000 00000020:00000080:3.0:1788891041.920338:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f832d9000 for lustre-MDT0001 00000020:00000080:3.0:1788891041.920425:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f81c25000 for lustre-MDT0001 00000020:00000080:3.0:1788891041.920430:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f81770800 for lustre-OST0000 00000020:00000080:3.0:1788891041.920436:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f839d1000 for lustre-OST0000 00000001:00100000:0.0:1788891041.921159:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788891041.921165:0:9489:0:(genops.c:885:class_export_put()) final put ffff9250baadf800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788891041.921184:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df03475d-d91a-4e91-8125-742ac4d4c589 00000020:00000080:0.0:1788891041.921187:0:9489:0:(genops.c:885:class_export_put()) final put ffff924f8332f000/df03475d-d91a-4e91-8125-742ac4d4c589 00000020:00000080:2.0:1788891041.921239:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9250baadf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788891041.921279:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f8332f000/df03475d-d91a-4e91-8125-742ac4d4c589 for lustre-OST0001 00000020:00000080:2.0:1788891041.921295:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9250baadd800 for lustre-OST0001 00000020:00000080:2.0:1788891041.921299:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f832d8000 for lustre-OST0001 00000100:00100000:3.0:1788891042.429544:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788891042.429572:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997387648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788891042.429652:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891042.429946:0:9105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997387648 00000100:00100000:1.0:1788891042.429955:0:9105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997387648 00000100:00080000:2.0:1788891042.429986:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788891042.430005:0:9105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788891042.430016:0:9105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997387648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788891042.430049:0:9105:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788891042.430887:0:9105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997387648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 869us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891042.430897:0:9105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788891042.433346:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997387648:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788891042.748452:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788891042.941736:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788891042.941747:0:6475:0:(genops.c:885:class_export_put()) final put ffff9250b6774000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788891042.941775:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1c240b24-a098-4d30-bfbf-dd53172bbf52 00000001:00080000:2.0:1788891042.941783:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:2.0:1788891042.941786:0:6475:0:(genops.c:885:class_export_put()) final put ffff924f83372800/1c240b24-a098-4d30-bfbf-dd53172bbf52 00000020:00000080:0.0:1788891042.941850:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff9250b6774000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788891042.941910:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f83372800/1c240b24-a098-4d30-bfbf-dd53172bbf52 for lustre-MDT0000 00000020:00000080:0.0:1788891042.941934:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9250c12d8000 for lustre-MDT0000 00000020:00000080:0.0:1788891042.941939:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f83374800 for lustre-MDT0000 00010000:00010000:3.0:1788891043.773072:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788891044.544120:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:3.0:1788891044.669898:0:15120:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff924f82d2c000 - data ffff9250b0af75e8/ffff924f8313d000 00000020:01000000:3.0:1788891044.670036:0:15120:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9250903a1600 - data ffff9250b08ab510/ffff925092fff000 00000001:00000004:3.0:1788891044.678169:0:15120:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:1.0:1788891044.733462:0:15120:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788891044.733470:0:15120:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1788891044.733486:0:15120:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff924f84295f80 x1875787997385472/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788891048 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891044.734232:0:15120:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788891044.738048:0:15120:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788891044.738056:0:15120:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1788891044.738076:0:15120:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788891044.738079:0:15120:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788891044.738359:0:8591:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788891044.738364:0:8591:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1788891044.738376:0:8591:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788891044.739055:0:15120:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788891044.739059:0:15120:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1788891044.739086:0:15120:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788891044.739088:0:15120:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788891044.739377:0:9803:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788891044.739381:0:9803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1788891044.739389:0:9803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788891044.740477:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52843 00000020:00000080:1.0:1788891044.740499:0:15120:0:(genops.c:885:class_export_put()) final put ffff925090902000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788891044.741545:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925090902000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788891044.744094:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52858 00000020:00000080:1.0:1788891044.744407:0:15120:0:(genops.c:885:class_export_put()) final put ffff92508f422000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788891044.744428:0:15120:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788891044.744433:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891044.744442:0:15120:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788891044.744447:0:15120:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff92508f4119b8) has no exports 00000020:00000080:2.0:1788891044.744898:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92508f422000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1788891044.745068:0:15120:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788891044.745079:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52c8e 00000020:00000080:1.0:1788891044.745086:0:15120:0:(genops.c:885:class_export_put()) final put ffff924f8325c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788891044.745446:0:15120:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788891044.745451:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891044.745462:0:15120:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788891044.745465:0:15120:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9250bf67b370) has no exports 00000020:00000080:1.0:1788891044.745472:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52c87 00000020:00000080:1.0:1788891044.745478:0:15120:0:(genops.c:885:class_export_put()) final put ffff924f81c27800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788891044.745575:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f8325c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788891044.747603:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81c27800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788891044.747802:0:15120:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788891044.747807:0:15120:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788891044.747812:0:15120:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1788891044.747819:0:15120:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788891044.747821:0:15120:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788891044.747905:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788891044.747919:0:15120:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788891044.747927:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52b4c 00000020:00000080:1.0:1788891044.747935:0:15120:0:(genops.c:885:class_export_put()) final put ffff924f81772800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788891044.748296:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f81c20000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788891044.748303:0:36:0:(genops.c:885:class_export_put()) final put ffff924f82c1f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788891044.748306:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f82c1f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788891044.748310:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788891044.748436:0:15120:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788891044.748441:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891044.748448:0:15120:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788891044.748451:0:15120:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9250bf67cd28) has no exports 00000020:00000080:1.0:1788891044.748468:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52b45 00000020:00000080:1.0:1788891044.748472:0:15120:0:(genops.c:885:class_export_put()) final put ffff924f82169000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788891044.751468:0:15120:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788891044.751476:0:15120:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788891044.751481:0:15120:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1788891044.751497:0:15120:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788891044.751500:0:15120:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788891044.751554:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788891044.751568:0:15120:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788891044.751584:0:15120:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788891044.751593:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd529fc 00000020:00000080:1.0:1788891044.751602:0:15120:0:(genops.c:885:class_export_put()) final put ffff9250ba8f7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788891044.751609:0:15120:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788891044.751613:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891044.751618:0:15120:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788891044.751621:0:15120:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9250baa68000) has no exports 00000020:00000080:1.0:1788891044.751630:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd529f5 00000020:00000080:1.0:1788891044.751634:0:15120:0:(genops.c:885:class_export_put()) final put ffff9250c10e1000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788891044.753038:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81772800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788891044.753066:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f82169000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788891044.753073:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9250ba96c000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788891044.753082:0:36:0:(genops.c:885:class_export_put()) final put ffff924f8216e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788891044.753084:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f8216e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788891044.753091:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788891044.753197:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9250ba8f7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788891044.753203:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9250c10e1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788891044.757580:0:15120:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788891044.757589:0:15120:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788891044.757593:0:15120:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788891044.757611:0:15120:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788891044.757674:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891044.757676:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9250c10e2000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788891044.757689:0:15120:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788891044.757696:0:15120:0:(genops.c:885:class_export_put()) final put ffff9250b6775000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788891044.757700:0:15120:0:(genops.c:844:class_export_destroy()) destroying export ffff9250b6775000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1788891044.757708:0:15120:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788891044.757818:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891044.757822:0:15120:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788891044.757826:0:15120:0:(genops.c:885:class_export_put()) final put ffff92508475b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788891044.757828:0:15120:0:(genops.c:844:class_export_destroy()) destroying export ffff92508475b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788891044.757831:0:15120:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788891044.757890:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd5285f 00000020:00000080:0.0:1788891044.757897:0:15120:0:(genops.c:885:class_export_put()) final put ffff92508f421000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788891044.757913:0:15120:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788891044.757917:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788891044.757922:0:15120:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788891044.757925:0:15120:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff92508f410000) has no exports 00000020:00000080:0.0:1788891044.757944:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891044.757948:0:15120:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788891044.757952:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52866 00000020:00000080:0.0:1788891044.757956:0:15120:0:(genops.c:885:class_export_put()) final put ffff92508f420000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788891044.757964:0:15120:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92509099a000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788891044.757967:0:15120:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92509099a000 3 00000020:01000004:0.0:1788891044.757971:0:15120:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff92509099a000 from lustre-MDT0000 00000020:00000080:0.0:1788891044.757989:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891044.757993:0:15120:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788891044.757995:0:15120:0:(genops.c:885:class_export_put()) final put ffff92509099d800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788891044.757997:0:15120:0:(genops.c:844:class_export_destroy()) destroying export ffff92509099d800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788891044.758004:0:15120:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788891044.758031:0:15120:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788891044.758034:0:15120:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788891044.758043:0:15120:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788891044.758046:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788891044.758048:0:15120:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788891044.758055:0:15120:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9250830a2800 0dc9e9f5-fe04-4428-a993-651ed6fecbec 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788891044.758059:0:15120:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff925090b24d28) has exports, disconnecting them 00000020:00080000:0.0:1788891044.758064:0:15120:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9250830a2800), last request at 1788890865 00000020:00000080:0.0:1788891044.758078:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52804 00000020:00010000:0.0:1788891044.758081:0:15120:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9250830a2800: total 2 00000100:00080000:0.0:1788891044.758085:0:15120:0:(import.c:65:import_set_state_nolock()) ffff9250830a7000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788891044.758096:0:15120:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9250830a2800): rc 0 00000020:00080000:0.0:1788891044.758100:0:15120:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff925090b24d28) has no exports 00000100:00100000:3.0:1788891044.758255:0:6491:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff925091ad1400:6491] 2 exiting: rc = 0 00000100:00100000:2.0:1788891044.758566:0:6490:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9250909b2400:6490] 1 exiting: rc = 0 00000100:00100000:3.0:1788891044.760077:0:6488:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9250905ae600:6488] 0 exiting: rc = 1 00000020:00010000:2.0:1788891044.761783:0:6485:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9250830a2800: total 2 00010000:00010000:2.0:1788891044.761790:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891044.761855:0:6485:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9250830a2800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788891044.761890:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250c214a600/0xa66601b03fd5290e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd52907 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891044.761913:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813ece00/0xa66601b03fd52d59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd52d52 expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891044.761925:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813ed800/0xa66601b03fd52c25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd52c1e expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891044.761938:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8ba00/0xa66601b03fd52d75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd52d6e expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891044.761950:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae4000/0xa66601b03fd52d83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd52d7c expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891044.761964:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c7800/0xa66601b03fd52fac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd52fa5 expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891044.761995:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae4600/0xa66601b03fd52d21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd52d1a expref: 8 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891044.762006:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae4e00/0xa66601b03fd52f9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd52f97 expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891044.762018:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae5e00/0xa66601b03fd52d2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd52d28 expref: 6 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891044.762031:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae4a00/0xa66601b03fd52fba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd52fb3 expref: 5 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891044.762132:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762151:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762158:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762163:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762168:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788891044.762175:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813ec400/0xa66601b03fd52d4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd52d44 expref: 4 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891044.762176:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788891044.762193:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae5400/0xa66601b03fd52dc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd52dc2 expref: 3 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891044.762197:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762209:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788891044.762214:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250c214b600/0xa66601b03fd52900 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd528f9 expref: 2 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891044.762222:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762232:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788891044.762235:0:6485:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9250830a2800, canceled 13 locks, left on hash table 0. 00000100:00100000:0.0:1788891044.762242:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762253:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788891044.762260:0:6485:0:(genops.c:885:class_export_put()) final put ffff9250830a2800/0dc9e9f5-fe04-4428-a993-651ed6fecbec 00000100:00100000:0.0:1788891044.762262:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788891044.762270:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891044.762274:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891044.762275:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788891044.762277:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891044.762284:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788891044.762290:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92508f421000/lustre-MDD0000_UUID for lustre-MDD0000 00000100:00100000:0.0:1788891044.762296:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788891044.762300:0:36:0:(genops.c:885:class_export_put()) final put ffff925083391800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788891044.762305:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925083391800/lustre-MDD0000_UUID for lustre-MDD0000 00000100:00100000:0.0:1788891044.762306:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762316:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788891044.762320:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000100:00100000:0.0:1788891044.762325:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762331:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762336:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762342:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762361:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788891044.762369:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92508f420000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1788891044.762373:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788891044.762377:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9250830a2800/0dc9e9f5-fe04-4428-a993-651ed6fecbec for MGS 00000100:00100000:0.0:1788891044.762383:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762391:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762398:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762407:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788891044.762411:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9250830a7000 for MGS 00000100:00100000:0.0:1788891044.762417:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762426:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762435:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762441:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762448:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762453:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762458:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762463:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762468:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762473:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762478:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762484:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762784:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762795:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762802:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762809:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762816:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762824:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762829:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762838:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762845:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762850:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762855:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762859:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762870:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762885:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762891:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762896:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762901:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762914:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762919:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762923:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762928:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762933:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762939:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891044.762946:0:15120:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788891044.765123:0:15120:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff924f82d2c960 - data ffff92509203b288/ffff9250baabb000 00000020:01000000:0.0:1788891044.765257:0:15120:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff925088ac4060 - data ffff9250b08f7360/ffff92509094e400 00000020:00000080:0.0:1788891044.765865:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd527e8 00000020:00000080:0.0:1788891044.765874:0:15120:0:(genops.c:885:class_export_put()) final put ffff92509099d000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788891044.765891:0:15120:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92509099a000 from MGS, refs=2 00000020:01000004:0.0:1788891044.765895:0:15120:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92509099a000 2 00000020:01000004:0.0:1788891044.765898:0:15120:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff92509099a000 from MGS 00000020:00000080:0.0:1788891044.765918:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891044.765925:0:15120:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788891044.765928:0:15120:0:(genops.c:885:class_export_put()) final put ffff92509099b000/MGS 00000020:00000080:0.0:1788891044.765930:0:15120:0:(genops.c:844:class_export_destroy()) destroying export ffff92509099b000/MGS for MGS 00000020:01000000:0.0:1788891044.765937:0:15120:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788891044.765998:0:15120:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788891044.766001:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788891044.766006:0:15120:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788891044.766012:0:15120:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9250c122f800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788891044.766017:0:15120:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9250c12219b8) has exports, disconnecting them 00000020:00080000:0.0:1788891044.766021:0:15120:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9250c122f800), last request at 1788890865 00000020:00000080:0.0:1788891044.766025:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd528b3 00000020:00080000:0.0:1788891044.766035:0:15120:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9250c122f800): rc 0 00000020:00000080:0.0:1788891044.766040:0:15120:0:(genops.c:885:class_export_put()) final put ffff9250c122f800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788891044.766666:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff92509099d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788891044.766678:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff9250c122f800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788891044.772631:0:15120:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788891044.772640:0:15120:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788891044.772644:0:15120:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788891044.772652:0:15120:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788891044.772688:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9250c122d800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788891044.772865:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891044.772874:0:15120:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788891044.772880:0:15120:0:(genops.c:885:class_export_put()) final put ffff9250c10e5800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788891044.772884:0:15120:0:(genops.c:844:class_export_destroy()) destroying export ffff9250c10e5800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788891044.772890:0:15120:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788891044.772966:0:15120:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92509099a000 1 00000020:00000080:2.0:1788891044.772971:0:15120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd527da 00000020:00000080:2.0:1788891044.772977:0:15120:0:(genops.c:885:class_export_put()) final put ffff92509099e000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788891044.772986:0:15120:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788891044.772993:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff92509099e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788891044.773002:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788891044.773006:0:15120:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788891044.773016:0:15120:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff925090b20000) has no exports 00010000:00010000:2.0:1788891044.804315:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788891044.842407:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891044.842419:0:15120:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788891044.842425:0:15120:0:(genops.c:885:class_export_put()) final put ffff92509099b800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788891044.842429:0:15120:0:(genops.c:844:class_export_destroy()) destroying export ffff92509099b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788891044.842449:0:15120:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788891044.843020:0:15120:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff92509099a800 00000020:02000400:0.0:1788891044.843083:0:15120:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:2.0:1788891045.500286:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788891045.500293:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788891045.500296:0:467:0:(import.c:65:import_set_state_nolock()) ffff9250c1535800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788891045.500304:0:467:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 262 00000100:00080000:2.0:1788891045.500319:0:467:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788891045.500327:0:467:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9250c1535800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788891045.500353:0:467:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9250c1262a00 x1875787997387904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788891045.500372:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788891045.500376:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788891045.500377:0:467:0:(import.c:65:import_set_state_nolock()) ffff9250c10e4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788891045.500382:0:467:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 262 00000100:00080000:2.0:1788891045.500384:0:467:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788891045.500388:0:467:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9250c10e4800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788891045.500400:0:467:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9250c1261880 x1875787997388032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788891045.500408:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788891045.500411:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788891045.500412:0:467:0:(import.c:65:import_set_state_nolock()) ffff924f81ede000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788891045.500415:0:467:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 262 00000100:00080000:2.0:1788891045.500417:0:467:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788891045.500420:0:467:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff924f81ede000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788891045.500430:0:467:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9250bf6cc380 x1875787997388160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788891045.500459:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788891045.500463:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788891045.500465:0:467:0:(import.c:65:import_set_state_nolock()) ffff924f82210800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788891045.500468:0:467:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 262 00000100:00080000:2.0:1788891045.500487:0:467:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788891045.500491:0:467:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff924f82210800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788891045.500507:0:467:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9250c1e77b80 x1875787997388544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788891045.500600:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997388288:0@lo:400:kworker.0 00000100:00100000:2.0:1788891045.500677:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891045.500733:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788891045.500739:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997387776:0@lo:400:kworker.0 00000400:00000100:2.0:1788891045.500760:0:3628:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875787997387776 offset 0 length 224: 4 00000100:00100000:2.0:1788891045.500778:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997388800:0@lo:400:kworker.0 00000100:00100000:2.0:1788891045.500804:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891045.500830:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997387904:0@lo:38:kworker.0 00000100:00100000:2.0:1788891045.500856:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891045.500873:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875787997388032:0@lo:38:kworker.0 00000100:00100000:2.0:1788891045.500897:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891045.500913:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf6cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1875787997388160:0@lo:38:kworker.0 00000100:00100000:2.0:1788891045.500932:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891045.500947:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c1e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1875787997388544:0@lo:38:kworker.0 00000100:00100000:2.0:1788891045.500965:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891045.500990:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997388416:0@lo:400:kworker.0 00000100:00100000:2.0:1788891045.501012:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891045.501030:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788891045.501034:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997388672:0@lo:400:kworker.0 00000100:00100000:2.0:1788891045.501055:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891045.501094:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997388800 00000100:00100000:2.0:1788891045.501102:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997388800 00000100:00100000:2.0:1788891045.501157:0:11803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997388416 00000100:00100000:2.0:1788891045.501161:0:11803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997388416 00000100:00100000:2.0:1788891045.501184:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788891045.501194:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997388800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891045.501246:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997388800:12345-0@lo:400:kworker.0 Request processed in 54us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891045.501254:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788891045.501274:0:11803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788891045.501280:0:11803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997388416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891045.501313:0:11803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997388416:12345-0@lo:400:kworker.0 Request processed in 34us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891045.501319:0:11803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788891045.501336:0:7721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997387904 00000100:00100000:2.0:1788891045.501339:0:7721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997387904 00000100:00100000:2.0:1788891045.501358:0:7721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788891045.501363:0:7721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3626:x1875787997387904:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788891045.501383:0:7721:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788891045.501417:0:7721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3626:x1875787997387904:12345-0@lo:38:kworker.0 Request processed in 54us (561us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788891045.501424:0:7721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788891045.501441:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997388288 00000100:00100000:2.0:1788891045.501444:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997388288 00000100:00100000:2.0:1788891045.501469:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997388032 00000100:00100000:2.0:1788891045.501472:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997388032 00000100:00100000:2.0:1788891045.501495:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997388160 00000100:00100000:2.0:1788891045.501498:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997388160 00000100:00100000:2.0:1788891045.501516:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997388544 00000100:00100000:2.0:1788891045.501519:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997388544 00000100:00100000:2.0:1788891045.501554:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997388672 00000100:00100000:2.0:1788891045.501557:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997388672 00000100:00100000:2.0:1788891045.501573:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788891045.501579:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875787997388288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891045.501612:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875787997388288:12345-0@lo:400:kworker.0 Request processed in 33us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891045.501618:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788891045.501629:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788891045.501634:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997388672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891045.501658:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997388672:12345-0@lo:400:kworker.0 Request processed in 24us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891045.501664:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788891045.501674:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788891045.501677:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087bb1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3626:x1875787997388032:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788891045.501687:0:6496:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788891045.501708:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087bb1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3626:x1875787997388032:12345-0@lo:38:kworker.0 Request processed in 29us (810us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788891045.501714:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788891045.503019:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788891045.503029:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3626:x1875787997388160:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788891045.503048:0:6496:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788891045.503452:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788891045.503460:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875787997388544:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788891045.503472:0:6497:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788891045.503564:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875787997388544:12345-0@lo:38:kworker.0 Request processed in 104us (2597us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788891045.503572:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:3.0:1788891045.503630:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788891045.503635:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788891045.503637:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788891045.503692:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff924f83b29500 x1875787997388672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891045.503707:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997388672:0@lo:400:kworker.0 00000100:00100000:3.0:1788891045.503722:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997388416:0@lo:400:kworker.0 00000100:00100000:3.0:1788891045.503775:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83b28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997388800:0@lo:400:kworker.0 00010000:00080000:3.0:1788891045.503788:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9250bf6cd180 x1875787997388288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891045.503798:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997388288:0@lo:400:kworker.0 00000100:00080000:3.0:1788891045.503831:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250c1535800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788891045.503836:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788891045.503839:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997387904:0@lo:38:kworker.0 00000100:00080000:3.0:1788891045.503849:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250c10e4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788891045.503852:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788891045.503855:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875787997388032:0@lo:38:kworker.0 00000100:00080000:3.0:1788891045.503863:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f82210800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788891045.503865:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788891045.503868:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c1e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1875787997388544:0@lo:38:kworker.0 00000100:00100000:2.0:1788891045.507072:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3626:x1875787997388160:12345-0@lo:38:kworker.0 Request processed in 4033us (6129us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788891045.507087:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:3.0:1788891045.507184:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f81ede000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788891045.507191:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788891045.507196:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf6cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1875787997388160:0@lo:38:kworker.0 00010000:00010000:1.0:1788891045.819847:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891046.012276:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997388928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788891046.012343:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891046.012473:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997388928 00000100:00100000:0.0:1788891046.012482:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997388928 00000100:00100000:0.0:1788891046.012639:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788891046.012953:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997388928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788891046.012991:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788891046.013068:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997388928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 419us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891046.013137:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997388928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788891046.013840:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00010000:1.0:1788891046.843710:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788891047.304021:0:15323:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788891047.316693:0:15323:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788891047.316753:0:15323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd52d6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d75 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.316769:0:15323:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd52d6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52d75 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.316791:0:15323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd52d6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52d75 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.316798:0:15323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd52d6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52d75 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.316822:0:15323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788891047.316828:0:15323:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788891047.316859:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788891047.316863:0:15323:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788891047.316869:0:15323:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788891047.316875:0:15323:0:(import.c:65:import_set_state_nolock()) ffff9250c10e4800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788891047.316893:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788891047.316895:0:15323:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788891047.316899:0:15323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788891047.317297:0:10315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891047.317306:0:10315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd52d6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52d75 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891047.317427:0:10315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5c00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891047.317433:0:10315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd52d6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52d75 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891047.317453:0:10315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd52d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd52d75 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891047.317460:0:10315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd52d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd52d75 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891047.317466:0:10315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788891047.317468:0:10315:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788891047.317471:0:10315:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788891047.317509:0:10315:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd52d6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52d75 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891047.317688:0:10315:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891047.317710:0:10315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd52d6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52d75 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891047.317718:0:10315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd52d6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52d75 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891047.317730:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891047.317732:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891047.317741:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891047.317864:0:15323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7c00/0xa66601b03fd52d7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d83 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.317875:0:15323:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7c00/0xa66601b03fd52d7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52d83 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891047.317876:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1788891047.317887:0:15323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7c00/0xa66601b03fd52d7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52d83 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.317894:0:15323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9250b69c7c00/0xa66601b03fd52d7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52d83 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891047.317899:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997389056:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891047.317911:0:15323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891047.317924:0:15323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd52c1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52c25 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.317931:0:15323:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd52c1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52c25 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.317938:0:15323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd52c1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52c25 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.317945:0:15323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd52c1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52c25 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.317959:0:15323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788891047.317965:0:15323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52fb3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52fba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.317973:0:15323:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52fb3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52fba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891047.317977:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788891047.317985:0:15323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52fb3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52fba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.317993:0:15323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52fb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52fba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.318007:0:15323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788891047.318017:0:10316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788891047.318022:0:10316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250b69c7c00/0xa66601b03fd52d7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52d83 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.318029:0:10316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7c00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788891047.318038:0:10316:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c7c00/0xa66601b03fd52d7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52d83 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.318047:0:10316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250b69c7c00/0xa66601b03fd52d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd52d83 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891047.318054:0:10316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c7c00/0xa66601b03fd52d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd52d83 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891047.318059:0:10316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788891047.318062:0:10316:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1788891047.318069:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788891047.318075:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd52c1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52c25 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.318080:0:10316:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250b69c7c00/0xa66601b03fd52d7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52d83 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891047.318083:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b000 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891047.318089:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd52c1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52c25 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.318092:0:10316:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891047.318102:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd52c1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd52c25 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.318107:0:10316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250b69c7c00/0xa66601b03fd52d7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52d83 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891047.318109:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd52c1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd52c25 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891047.318118:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788891047.318121:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788891047.318124:0:6485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788891047.318128:0:10316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250b69c7c00/0xa66601b03fd52d7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52d83 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.318142:0:10316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891047.318143:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd52c1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52c25 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.318146:0:10316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52fb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52fba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891047.318157:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788891047.318162:0:10316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a000 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788891047.318166:0:10316:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52fb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52fba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.318174:0:10316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52fb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd52fba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891047.318179:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd52c1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52c25 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891047.318196:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd52c1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52c25 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891047.318200:0:10316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52fb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd52fba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891047.318209:0:10316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788891047.318212:0:10316:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788891047.318215:0:10316:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788891047.318232:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891047.318232:0:10316:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52fb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52fba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891047.318235:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891047.318238:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891047.318243:0:10316:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891047.318246:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891047.318252:0:10316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52fb3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52fba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.318260:0:10316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd52fb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd52fba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891047.318261:0:10317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997389056 00000100:00100000:2.0:1788891047.318270:0:10317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997389056 00010000:00010000:1.0:1788891047.318273:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891047.318276:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891047.318278:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891047.318290:0:15323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd52907 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5290e expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.318298:0:15323:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd52907 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd5290e expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.318306:0:15323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd52907 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd5290e expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.318313:0:15323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd52907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd5290e expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891047.318339:0:10317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1788891047.318340:0:15323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788891047.318346:0:15323:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1788891047.318351:0:15323:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000100:00100000:2.0:1788891047.318352:0:10317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3630:x1875787997389056:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788891047.318362:0:10317:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788891047 with bad export cookie 11990272914417330180 00010000:00010000:1.0:1788891047.318379:0:10314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891047.318384:0:10314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd52907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd5290e expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.318392:0:10314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081523400 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788891047.318395:0:10314:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd52907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd5290e expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.318407:0:10314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd52907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd5290e expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891047.318415:0:10314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd52907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd5290e expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891047.318421:0:10314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788891047.318423:0:10314:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788891047.318425:0:10314:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788891047.318448:0:10314:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd52907 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd5290e expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.318455:0:10314:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788891047.318462:0:10314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd52907 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd5290e expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.318469:0:10314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd52907 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd5290e expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.318491:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891047.318493:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891047.318494:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788891047.318507:0:15323:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788891047.318511:0:15323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1788891047.318515:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891047.318520:0:15323:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788891047.318546:0:15323:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff924f81ed8800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788891047.318552:0:15323:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff924f8216f000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788891047.318557:0:15323:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9250c1220000) has exports, disconnecting them 00000020:00080000:1.0:1788891047.318562:0:15323:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff924f81ed8800), last request at 1788891045 00000020:00000080:1.0:1788891047.318568:0:15323:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52be6 00000100:00080000:1.0:1788891047.318581:0:15323:0:(import.c:65:import_set_state_nolock()) ffff924f81eda800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788891047.318620:0:15323:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff924f81ed8800): rc 0 00000020:00000080:1.0:1788891047.318623:0:15323:0:(genops.c:885:class_export_put()) final put ffff924f81ed8800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1788891047.318629:0:15323:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff924f8216f000), last request at 1788891045 00000020:00000080:1.0:1788891047.318632:0:15323:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52ac0 00000100:00080000:1.0:1788891047.318638:0:15323:0:(import.c:65:import_set_state_nolock()) ffff924f8216a800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788891047.318648:0:15323:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff924f8216f000): rc 0 00000020:00000080:1.0:1788891047.318650:0:15323:0:(genops.c:885:class_export_put()) final put ffff924f8216f000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1788891047.318656:0:15323:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbbfc41c8fae0 00000100:00080000:1.0:1788891047.318673:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788891047.318676:0:15323:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:3.0:1788891047.318875:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997389568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788891047.318919:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891047.318954:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788891047.318960:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997389184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788891047.318995:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891047.319021:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997389568 00000100:00100000:3.0:1788891047.319033:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997389568 00000100:00100000:3.0:1788891047.319277:0:7436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997389184 00000100:00100000:3.0:1788891047.319281:0:7436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997389184 00000100:00100000:3.0:1788891047.319297:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788891047.319302:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3629:x1875787997389568:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788891047.319307:0:7436:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788891047 with bad export cookie 11990272914417330180 00000100:00100000:3.0:1788891047.319353:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3629:x1875787997389568:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (433us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788891047.319361:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788891047.319378:0:7436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788891047.319382:0:7436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84297800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3629:x1875787997389184:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788891047.319386:0:7436:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788891047 with bad export cookie 11990272914417330180 00000100:00100000:3.0:1788891047.319411:0:7436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84297800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3629:x1875787997389184:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (417us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788891047.319417:0:7436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788891047.319469:0:3629:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.126@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788891047.319473:0:3629:0:(import.c:65:import_set_state_nolock()) ffff925083396800 MGS: changing import state from FULL to DISCONN 00000020:00000080:0.0:1788891047.319477:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81ed8800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:02020000:3.0:1788891047.319479:0:3629:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00000080:0.0:1788891047.319544:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f8216f000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788891047.319567:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f81eda800 for lustre-MDT0001 00000020:00000080:0.0:1788891047.319571:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f8216a800 for lustre-MDT0001 00000100:00080000:1.0:1788891047.320787:0:15323:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788891047.320795:0:15323:0:(import.c:65:import_set_state_nolock()) ffff9250c1535800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788891047.321132:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788891047.321138:0:15323:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1788891047.321250:0:15323:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788891047.321315:0:15323:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788891047.321334:0:15323:0:(import.c:65:import_set_state_nolock()) ffff9250c1537000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788891047.321353:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788891047.321355:0:15323:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1788891047.321364:0:15323:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788891047.321491:0:15323:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788891047.321505:0:15323:0:(import.c:65:import_set_state_nolock()) ffff924f83107000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788891047.321552:0:15323:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9250c1220000) has no exports 00000100:00100000:2.0:1788891047.330918:0:10317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3630:x1875787997389056:12345-0@lo:103:ldlm_bl.0 Request processed in 12564us (12939us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788891047.330933:0:10317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1788891047.330980:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891047.330986:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891047.331034:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997389696:0@lo:9:umount.0 00000100:00100000:2.0:1788891047.331080:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891047.331114:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997389824:0@lo:9:umount.0 00000100:00100000:2.0:1788891047.331135:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891047.331170:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997389696 00000100:00100000:2.0:1788891047.331178:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997389696 00000100:00100000:2.0:1788891047.331248:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997389824 00000100:00100000:2.0:1788891047.331252:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997389824 00000100:00100000:2.0:1788891047.331277:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788891047.331286:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875787997389696:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788891047.331313:0:8410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52b1b 00000100:00080000:2.0:1788891047.331322:0:8410:0:(import.c:65:import_set_state_nolock()) ffff924f81ede800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788891047.331368:0:8410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788891047.332654:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3626:x1875787997389696:12345-0@lo:9:umount.0 Request processed in 1366us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891047.332665:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788891047.332684:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788891047.332692:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875787997389824:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788891047.333025:0:8410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52c4f 00000100:00080000:2.0:1788891047.333036:0:8410:0:(import.c:65:import_set_state_nolock()) ffff924f83107800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788891047.333074:0:8410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788891047.333148:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3626:x1875787997389824:12345-0@lo:9:umount.0 Request processed in 458us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891047.333154:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:2.0:1788891047.333178:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891047.333184:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788891047.333216:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250c1537000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788891047.333228:0:3626:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788891047.333230:0:3626:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788891047.333234:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997389696:0@lo:9:umount.0 00000100:00080000:2.0:1788891047.333247:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f83107000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788891047.333255:0:3626:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788891047.333257:0:3626:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788891047.333260:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997389824:0@lo:9:umount.0 00000100:00080000:2.0:1788891047.333601:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788891047.333606:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788891047.345663:0:3630:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.126@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788891047.355340:0:3629:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.126@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788891047.355345:0:3629:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788891047.355354:0:3629:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f8416ed80 x1875787997387776/t0(0) o400->MGC192.168.204.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788891061 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891047.355370:0:3629:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f823e8700 x1875787997389056/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788891063 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891047.355379:0:3629:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f83bac000 x1875787997389568/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788891063 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891047.355388:0:3629:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f83bae300 x1875787997389184/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788891063 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788891047.355420:0:3629:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788891047.355424:0:3629:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788891047.355425:0:3629:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788891047.355488:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:0:1875787997389440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891047.355590:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3628:1875787997387776:0@lo:400:kworker.0 00000100:00100000:2.0:1788891047.355807:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0dc9e9f5-fe04-4428-a993-651ed6fecbec:0:1875787997389312:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788891047.358785:0:3630:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff925083396800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:3.0:1788891047.358786:0:3629:0:(import.c:65:import_set_state_nolock()) ffff925083396800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788891047.358800:0:3629:0:(import.c:510:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 87 00000100:00080000:3.0:1788891047.358812:0:3629:0:(import.c:624:import_select_connection()) MGC192.168.204.126@tcp: import ffff925083396800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891047.358833:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3630:1875787997389056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788891047.358853:0:3629:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f84296300 x1875787997389952/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788891047.358902:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997389568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788891047.358918:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3629:1875787997389184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891047.359326:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3626:1875787997389952:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1788891047.359383:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875787997389952 offset 0 length 520: 4 00000020:00080000:2.0:1788891047.366162:0:15323:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9250c1220000) has no exports 00000020:01000000:3.0:1788891047.418121:0:15323:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff924f82d2c7e0 - data ffff9250b0aaf510/ffff9250c1c18c00 00000020:01000000:3.0:1788891047.418270:0:15323:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9250ba8c8180 - data ffff9250b0a60798/ffff9250baa40400 00000001:00000004:2.0:1788891047.441182:0:15323:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1788891047.474224:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788891047.474236:0:15323:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788891047.474250:0:15323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788891047.475646:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788891047.475762:0:15323:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1788891047.475786:0:15323:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788891047.475788:0:15323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788891047.476010:0:8585:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788891047.476018:0:8585:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1788891047.476027:0:8585:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788891047.476645:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788891047.476651:0:15323:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1788891047.477006:0:15323:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788891047.477010:0:15323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788891047.477316:0:9799:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788891047.477321:0:9799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1788891047.477330:0:9799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788891047.478218:0:15323:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd5292a 00000020:00000080:2.0:1788891047.478228:0:15323:0:(genops.c:885:class_export_put()) final put ffff9250c1533000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788891047.478711:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9250c1533000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788891047.480122:0:15323:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd5293f 00000020:00000080:2.0:1788891047.480132:0:15323:0:(genops.c:885:class_export_put()) final put ffff9250c1534000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788891047.480307:0:15323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788891047.480313:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788891047.480321:0:15323:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788891047.480325:0:15323:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9250c1223370) has no exports 00000004:01000000:2.0:1788891047.480499:0:15323:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788891047.480508:0:15323:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52c48 00000020:00000080:2.0:1788891047.480513:0:15323:0:(genops.c:885:class_export_put()) final put ffff924f82eae800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788891047.480591:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9250c1534000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788891047.481002:0:15323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788891047.481006:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788891047.481015:0:15323:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788891047.481018:0:15323:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff924f81ed0000) has no exports 00000020:00000080:2.0:1788891047.481025:0:15323:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52c41 00000020:00000080:2.0:1788891047.481029:0:15323:0:(genops.c:885:class_export_put()) final put ffff924f83101000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788891047.481277:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f82eae800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788891047.481598:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f83101000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788891047.481860:0:15323:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788891047.481864:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788891047.481868:0:15323:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1788891047.481874:0:15323:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788891047.481876:0:15323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788891047.481916:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788891047.481925:0:15323:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788891047.481931:0:15323:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52b06 00000020:00000080:1.0:1788891047.481937:0:15323:0:(genops.c:885:class_export_put()) final put ffff924f81775800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788891047.481941:0:15323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788891047.481945:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891047.481949:0:15323:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788891047.481962:0:15323:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9250ba8899b8) has no exports 00000020:00000080:1.0:1788891047.481967:0:15323:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52aff 00000020:00000080:1.0:1788891047.481971:0:15323:0:(genops.c:885:class_export_put()) final put ffff92508f425000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788891047.482299:0:15323:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788891047.482303:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788891047.482305:0:15323:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1788891047.482310:0:15323:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788891047.482311:0:15323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788891047.482335:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788891047.482341:0:15323:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788891047.482353:0:15323:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788891047.482358:0:15323:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52962 00000020:00000080:1.0:1788891047.482364:0:15323:0:(genops.c:885:class_export_put()) final put ffff9250b6775800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788891047.482368:0:15323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788891047.482371:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891047.482375:0:15323:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788891047.482377:0:15323:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff925091acb370) has no exports 00000020:00000080:1.0:1788891047.482381:0:15323:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd5295b 00000020:00000080:1.0:1788891047.482384:0:15323:0:(genops.c:885:class_export_put()) final put ffff9250c1530800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788891047.483258:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f83107000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788891047.483270:0:36:0:(genops.c:885:class_export_put()) final put ffff924f83104000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788891047.483273:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f83104000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788891047.483279:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788891047.483354:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81775800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788891047.483360:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92508f425000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788891047.483364:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9250c1537000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788891047.483369:0:36:0:(genops.c:885:class_export_put()) final put ffff924f81773000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788891047.483380:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81773000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788891047.483383:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788891047.483416:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9250b6775800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788891047.483421:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9250c1530800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788891047.494569:0:15323:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788891047.494579:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788891047.494584:0:15323:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788891047.494592:0:15323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788891047.494646:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891047.494657:0:15323:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788891047.494683:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891047.494687:0:15323:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788891047.494693:0:15323:0:(genops.c:885:class_export_put()) final put ffff9250c10e6000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788891047.494698:0:15323:0:(genops.c:844:class_export_destroy()) destroying export ffff9250c10e6000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788891047.494706:0:15323:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788891047.494833:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9250c1535800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788891047.494841:0:36:0:(genops.c:885:class_export_put()) final put ffff92508f422800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788891047.494843:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92508f422800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1788891047.494861:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788891047.495098:0:15323:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52946 00000020:00000080:0.0:1788891047.495105:0:15323:0:(genops.c:885:class_export_put()) final put ffff9250c1536000/lustre-MDD0001_UUID 00000020:01000000:0.0:1788891047.495118:0:15323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788891047.495130:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788891047.495135:0:15323:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788891047.495139:0:15323:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9250c1224d28) has no exports 00000020:00000080:0.0:1788891047.495159:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891047.495162:0:15323:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788891047.495166:0:15323:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd5294d 00000020:00000080:0.0:1788891047.495170:0:15323:0:(genops.c:885:class_export_put()) final put ffff9250c1533800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788891047.495187:0:15323:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92508475e000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788891047.495190:0:15323:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92508475e000 2 00000020:01000004:0.0:1788891047.495194:0:15323:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff92508475e000 from lustre-MDT0001 00000020:00000080:0.0:1788891047.495209:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891047.495213:0:15323:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788891047.495222:0:15323:0:(genops.c:885:class_export_put()) final put ffff9250c1536800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788891047.495224:0:15323:0:(genops.c:844:class_export_destroy()) destroying export ffff9250c1536800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788891047.495230:0:15323:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788891047.495264:0:15323:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788891047.495268:0:15323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788891047.495271:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788891047.495275:0:15323:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788891047.495281:0:15323:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9250b6772800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788891047.495287:0:15323:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9250ba888000) has exports, disconnecting them 00000020:00080000:0.0:1788891047.495291:0:15323:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9250b6772800), last request at 1788890874 00000020:00000080:0.0:1788891047.495295:0:15323:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd529a1 00000020:00080000:0.0:1788891047.495305:0:15323:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9250b6772800): rc 0 00000020:00000080:0.0:1788891047.495309:0:15323:0:(genops.c:885:class_export_put()) final put ffff9250b6772800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788891047.495914:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9250c1536000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1788891047.495920:0:36:0:(genops.c:885:class_export_put()) final put ffff9250c1532800/lustre-MDD0001_UUID 00000020:00000080:2.0:1788891047.495922:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9250c1532800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1788891047.495926:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1788891047.496125:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9250c1533800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788891047.496129:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9250b6772800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788891047.509054:0:15323:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788891047.509063:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788891047.509067:0:15323:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788891047.509075:0:15323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788891047.509583:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788891047.509594:0:15323:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788891047.509601:0:15323:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92508475e000 1 00000020:00000080:1.0:1788891047.509608:0:15323:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd528dd 00000020:00000080:1.0:1788891047.509617:0:15323:0:(genops.c:885:class_export_put()) final put ffff92509095e000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788891047.509667:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9250c10e4800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788891047.509675:0:36:0:(genops.c:885:class_export_put()) final put ffff9250b6777000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1788891047.509678:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9250b6777000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1788891047.509685:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:1.0:1788891047.509821:0:15323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788891047.509826:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891047.509831:0:15323:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788891047.509835:0:15323:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff925091ac99b8) has no exports 00000020:00000080:2.0:1788891047.512244:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92509095e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788891047.553227:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891047.553245:0:15323:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1788891047.553251:0:15323:0:(genops.c:885:class_export_put()) final put ffff92508475a000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788891047.553257:0:15323:0:(genops.c:844:class_export_destroy()) destroying export ffff92508475a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1788891047.553268:0:15323:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1788891047.553394:0:15323:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff925084758800 00000020:01000000:2.0:1788891047.553415:0:15323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788891047.553420:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788891047.553424:0:15323:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788891047.553429:0:15323:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff925091accd28) has no exports 00000100:00100000:3.0:1788891047.553794:0:6497:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9250905bfc00:6497] 2 exiting: rc = 0 00000100:00100000:3.0:1788891047.553902:0:9362:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff924f81fdb800:9362] 3 exiting: rc = 0 00000100:00100000:3.0:1788891047.553974:0:14295:0:(service.c:3183:ptlrpc_main()) mdt00_005: service thread [ffff9250ba8ebc00:14295] 5 exiting: rc = 0 00000100:00100000:2.0:1788891047.554083:0:6496:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff92508fab1200:6496] 1 exiting: rc = 0 00000100:00100000:0.0:1788891047.554182:0:12407:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9250908dc400:12407] 4 exiting: rc = 0 00000100:00100000:1.0:1788891047.554305:0:6495:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff92508faa8e00:6495] 0 exiting: rc = 1 00000100:00100000:3.0:1788891047.554422:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554431:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554446:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554451:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554456:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554462:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554466:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554473:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554478:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554483:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554488:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554494:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554506:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554751:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554758:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554764:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554769:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554774:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554779:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554785:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554791:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554797:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554803:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554809:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554814:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554818:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554823:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554827:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554833:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554839:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554845:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554851:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554857:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554862:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554868:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554872:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554878:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554884:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554890:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554896:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554900:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554905:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554910:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554916:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554922:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554928:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554934:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554939:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554953:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554958:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554963:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554969:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554974:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554984:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554990:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.554996:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.555002:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.555007:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.555012:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.555016:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.555022:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.555046:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.555053:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.555060:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891047.558134:0:6499:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9250905be600:6499] 1 exiting: rc = 0 00000100:00100000:2.0:1788891047.558272:0:6498:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff92508f8dee00:6498] 0 exiting: rc = 1 00000100:00100000:3.0:1788891047.558361:0:14588:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff924f83a9b400:14588] 2 exiting: rc = 0 00000100:00100000:2.0:1788891047.558727:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558737:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558744:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558750:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558756:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558775:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558781:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558787:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558793:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558800:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558805:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558813:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558820:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558825:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558830:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558835:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558840:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558845:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558851:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558856:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558861:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558866:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558871:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558877:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558882:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558887:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558892:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558897:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558902:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558907:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558912:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558917:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558921:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558927:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558932:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558937:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558942:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558947:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558952:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558957:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558968:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558973:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558978:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558982:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558987:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558992:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.558997:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.559001:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.559005:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.559010:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.559015:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.559025:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.559030:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.559064:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.559070:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.559074:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.559079:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.559084:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.559089:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.559094:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.559098:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.559103:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.559108:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.559114:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.559593:0:7721:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9250c14ad800:7721] 2 exiting: rc = 0 00000100:00100000:0.0:1788891047.559744:0:6501:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff92509894e600:6501] 1 exiting: rc = 0 00000100:00100000:2.0:1788891047.560273:0:6500:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff92508f8dea00:6500] 0 exiting: rc = 1 00000100:00100000:3.0:1788891047.560496:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560505:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560510:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560516:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560819:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560828:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560833:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560839:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560845:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560850:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560857:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560862:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560867:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560886:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560892:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560897:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560902:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560918:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560924:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560929:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560934:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560940:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560945:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560951:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560956:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560973:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560979:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560985:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560992:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.560999:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561005:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561011:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561016:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561022:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561027:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561033:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561038:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561059:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561066:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561072:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561078:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561084:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561089:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561096:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561104:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561110:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561117:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561123:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561129:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561150:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561156:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561162:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561172:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561177:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561184:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561191:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561198:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561203:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561209:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561215:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561220:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561226:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561242:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.561256:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.568477:0:6502:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff92508314aa00:6502] 0 exiting: rc = 1 00000100:00100000:1.0:1788891047.568732:0:6503:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff92509056d000:6503] 1 exiting: rc = 0 00000100:00100000:2.0:1788891047.568933:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.568940:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.568947:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.568952:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.568957:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.568962:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.568968:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.568973:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.568978:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.568998:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569004:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569009:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569014:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569019:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569024:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569029:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569033:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569038:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569043:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569049:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569054:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569059:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569064:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569069:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569074:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569080:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569085:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569089:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569094:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569099:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569103:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569109:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569114:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569118:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569123:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569127:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569132:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569137:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569142:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569148:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569153:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569158:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569163:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569168:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569182:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569188:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569193:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569198:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569203:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569208:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569213:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569217:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569222:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569227:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569232:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569237:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569242:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569248:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569253:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569258:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569262:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569267:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569272:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.569278:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891047.570028:0:6504:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff92508314ae00:6504] 0 exiting: rc = 1 00000100:00100000:0.0:1788891047.570121:0:6505:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff92509056c000:6505] 1 exiting: rc = 0 00000100:00100000:2.0:1788891047.570230:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570237:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570242:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570247:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570252:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570257:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570263:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570268:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570273:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570278:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570284:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570290:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570295:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570300:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570306:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570321:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570326:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570332:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570337:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570342:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570349:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570353:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570358:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570362:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570366:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570372:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570376:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570380:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570385:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570389:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570394:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570399:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570403:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570407:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570412:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570416:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570420:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570426:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570431:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570448:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570453:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570459:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570464:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570470:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570475:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570480:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570485:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570490:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570495:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570500:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570512:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.570517:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.571011:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.571019:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.571025:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.571030:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.571035:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.571039:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.571045:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.571049:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.571054:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.571060:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.571064:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891047.571070:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891047.571705:0:6507:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff925086353a00:6507] 1 exiting: rc = 0 00000100:00100000:3.0:1788891047.571925:0:6506:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9250909c9e00:6506] 0 exiting: rc = 1 00000100:00100000:3.0:1788891047.571978:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.571985:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.571990:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.571995:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572001:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572005:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572011:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572016:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572021:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572026:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572031:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572037:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572042:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572047:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572052:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572058:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572063:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572069:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572074:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572079:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572085:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572091:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572106:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572111:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572116:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572121:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572126:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572131:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572136:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572141:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572147:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572151:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572156:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572162:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572167:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572172:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572177:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572183:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572188:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572193:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572198:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572202:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572208:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572213:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572219:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572224:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572229:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572234:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572239:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572245:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572250:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572255:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572261:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572265:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572270:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572275:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572280:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572291:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572295:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572301:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572306:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572311:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572316:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.572321:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891047.573032:0:6508:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9250909c8c00:6508] 0 exiting: rc = 1 00000100:00100000:1.0:1788891047.573191:0:6510:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff925086353800:6510] 2 exiting: rc = 0 00000100:00100000:1.0:1788891047.573709:0:6509:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff925086352800:6509] 1 exiting: rc = 0 00000100:00100000:3.0:1788891047.574161:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574170:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574175:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574180:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574186:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574191:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574196:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574202:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574208:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574213:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574219:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574224:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574229:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574234:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574240:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574245:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574250:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574256:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574261:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574266:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574271:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574276:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574281:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574286:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574304:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574310:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574314:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574319:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574332:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574338:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574343:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574349:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574354:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574360:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574366:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574371:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574376:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574381:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574387:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574393:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574398:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574403:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574408:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574414:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574419:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574424:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574429:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574449:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574469:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574475:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574480:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574485:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574491:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574497:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574503:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574508:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574514:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574603:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574665:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574670:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574675:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574680:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574685:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891047.574697:0:15323:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788891047.581110:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891047.581121:0:15323:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788891047.581126:0:15323:0:(genops.c:885:class_export_put()) final put ffff925083394800/MDS_uuid 00000020:00000080:3.0:1788891047.581131:0:15323:0:(genops.c:844:class_export_destroy()) destroying export ffff925083394800/MDS_uuid for MDS 00000020:01000000:3.0:1788891047.581140:0:15323:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788891047.581310:0:15323:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788891047.869840:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.891740:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891049.918430:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788891050.399875:0:15523:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788891050.420239:0:15523:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788891050.420288:0:15523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7a00/0xa66601b03fd52d44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d4b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891050.420303:0:15523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7a00/0xa66601b03fd52d44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52d4b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891050.420311:0:15523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7a00/0xa66601b03fd52d44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52d4b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891050.420317:0:15523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9250b69c7a00/0xa66601b03fd52d44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52d4b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891050.420339:0:15523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788891050.420343:0:15523:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788891050.420367:0:15523:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788891050.420395:0:15523:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788891050.420401:0:15523:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788891050.420406:0:15523:0:(import.c:65:import_set_state_nolock()) ffff924f81ede000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788891050.420411:0:15523:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788891050.420413:0:15523:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788891050.420416:0:15523:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788891050.420731:0:10316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891050.420740:0:10316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250b69c7a00/0xa66601b03fd52d44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52d4b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891050.420748:0:10316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7a00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788891050.420752:0:10316:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c7a00/0xa66601b03fd52d44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52d4b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891050.420828:0:10316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250b69c7a00/0xa66601b03fd52d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd52d4b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891050.420838:0:10316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c7a00/0xa66601b03fd52d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd52d4b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891050.420845:0:10316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788891050.420848:0:10316:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788891050.420851:0:10316:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788891050.420867:0:10316:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff925083396800 00010000:00010000:1.0:1788891050.420871:0:10316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250b69c7a00/0xa66601b03fd52d44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd52d4b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891050.420878:0:10316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250b69c7a00/0xa66601b03fd52d44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd52d4b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891050.420901:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891050.420903:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891050.420905:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788891050.421420:0:15523:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788891050.421425:0:15523:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788891050.421429:0:15523:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788891050.421447:0:15523:0:(import.c:65:import_set_state_nolock()) ffff924f81c24800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788891050.421618:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3626:1875787997390080:0@lo:39:umount.0 00000400:00000100:0.0:1788891050.421724:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875787997390080 offset 0 length 224: 4 00000100:00080000:1.0:1788891050.619789:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0dc9e9f5-fe04-4428-a993-651ed6fecbec->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788891050.619799:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0dc9e9f5-fe04-4428-a993-651ed6fecbec->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788891050.619802:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788891050.619805:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788891050.619810:0:36:0:(import.c:65:import_set_state_nolock()) ffff924f82210800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788891050.619817:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 267 00000100:00080000:1.0:1788891050.619822:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788891050.619830:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff924f82210800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891050.619869:0:36:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83bad880 x1875787997390208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788891050.619999:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788891050.620020:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997390336:0@lo:400:kworker.0 00000100:00100000:0.0:1788891050.620020:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1875787997390208:0@lo:38:kworker.0 00000400:00000100:1.0:1788891050.626331:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875787997390336 offset 0 length 224: 4 00000400:00000100:0.0:1788891050.626404:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875787997390208 offset 0 length 520: 4 00010000:00010000:2.0:1788891050.942715:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891051.965310:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788891052.667664:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0dc9e9f5-fe04-4428-a993-651ed6fecbec->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788891052.667674:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0dc9e9f5-fe04-4428-a993-651ed6fecbec->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788891052.667677:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788891052.667681:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788891052.667780:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788891052.667808:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1875787997390464:0@lo:400:kworker.0 00000400:00000100:0.0:1788891052.667893:0:3628:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875787997390464 offset 0 length 224: 4 00000001:00100000:1.0:1788891052.671212:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788891052.671221:0:8404:0:(genops.c:885:class_export_put()) final put ffff924f81edc800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788891052.672974:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81edc800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788891052.673041:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f81ede800 for lustre-OST0000 00000001:00100000:1.0:1788891052.677403:0:9489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788891052.677414:0:9489:0:(genops.c:885:class_export_put()) final put ffff924f83105000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788891052.677497:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f83105000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788891052.677594:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f83107800 for lustre-OST0001 00010000:00010000:2.0:1788891052.987806:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891054.012973:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891055.036730:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788891055.675828:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0dc9e9f5-fe04-4428-a993-651ed6fecbec->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788891055.675865:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0dc9e9f5-fe04-4428-a993-651ed6fecbec->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788891055.675869:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788891055.675873:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788891055.676040:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1875787997390592:0@lo:400:kworker.0 00000400:00000100:1.0:1788891055.676117:0:3628:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875787997390592 offset 0 length 224: 4 00010000:00010000:1.0:1788891056.059936:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891057.083908:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891057.789353:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891047/real 1788891047] req@ffff924f84296300 x1875787997389952/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788891057 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891057.789389:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff924f84296300 x1875787997389952/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788891057 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788891057.789408:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925083396800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788891057.789425:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788891057.789430:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3626:1875787997389952:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1788891057.789726:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0dc9e9f5-fe04-4428-a993-651ed6fecbec->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788891057.789731:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788891057.789743:0:36:0:(import.c:65:import_set_state_nolock()) ffff925083396800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788891057.789748:0:36:0:(import.c:510:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 269 00000100:00080000:1.0:1788891057.789753:0:36:0:(import.c:589:import_select_connection()) MGC192.168.204.126@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788891057.789760:0:36:0:(import.c:624:import_select_connection()) MGC192.168.204.126@tcp: import ffff925083396800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891057.789794:0:36:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83baf480 x1875787997390720/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788891057.789811:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788891057.789815:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788891057.790036:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997390848:0@lo:400:kworker.0 00000400:00000100:1.0:1788891057.790088:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875787997390848 offset 0 length 224: 4 00000100:00100000:2.0:1788891057.790181:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3626:1875787997390720:0@lo:250:kworker.0 00000400:00000100:2.0:1788891057.790206:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875787997390720 offset 0 length 520: 4 00010000:00010000:2.0:1788891058.109128:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891059.133423:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891060.157923:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891060.859777:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891050/real 1788891050] req@ffff924f823ea300 x1875787997390080/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788891060 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891060.859810:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff924f823ea300 x1875787997390080/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788891060 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788891060.859829:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f81c24800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788891060.859848:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3626:1875787997390080:0@lo:39:umount.0 00000100:00080000:2.0:1788891060.859915:0:15523:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788891060.859921:0:15523:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788891060.859925:0:15523:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788891060.860918:0:15523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52d52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d59 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891060.860933:0:15523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52d52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52d59 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891060.860941:0:15523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52d52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52d59 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891060.860965:0:15523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52d52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52d59 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891060.861053:0:15523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891060.861063:0:15523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52fa5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52fac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891060.861070:0:15523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52fa5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52fac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891060.861076:0:15523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52fa5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52fac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891060.861083:0:15523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52fa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52fac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891060.861292:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788891060.861299:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52d52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52d59 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891060.861308:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ec200 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788891060.861312:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52d52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52d59 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891060.861332:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd52d59 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891060.861341:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd52d59 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891060.861347:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788891060.861349:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1788891060.861360:0:6484:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff925083396800 00010000:00010000:1.0:1788891060.861365:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52d52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd52d59 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891060.861372:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd52d52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd52d59 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891060.861389:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891060.861393:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52fa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52fac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891060.861399:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4800 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788891060.861402:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52fa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52fac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891060.861408:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52fa5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd52fac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891060.861414:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52fa5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd52fac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891060.861888:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788891060.861891:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788891060.861897:0:6484:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff925083396800 00010000:00010000:1.0:1788891060.861901:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52fa5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd52fac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891060.861908:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891060.861911:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891060.861914:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891060.863561:0:15523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788891060.863573:0:15523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd52fa5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd52fac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891060.863589:0:15523:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788891060.863597:0:15523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1788891060.863599:0:15523:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788891060.863634:0:15523:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788891060.863639:0:15523:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788891060.863647:0:15523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788891060.863653:0:15523:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788891060.863657:0:15523:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff925090b219b8) has no exports 00000020:00080000:2.0:1788891060.863681:0:15523:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff925090b219b8) has no exports 00000020:01000000:2.0:1788891060.865516:0:15523:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff924f81ef2a20 - data ffff9250b0b3a6c0/ffff924f8312b000 00000020:01000000:2.0:1788891060.865707:0:15523:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff924f81ef21e0 - data ffff92509203d948/ffff924f81ec0400 00010000:00010000:1.0:1788891060.866354:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788891060.876248:0:15523:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788891060.881493:0:15523:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52a7a 00000020:00000080:3.0:1788891060.881507:0:15523:0:(genops.c:885:class_export_put()) final put ffff924f81c26800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788891060.881550:0:15523:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9250ba9ab800 from lustre-OST0000, refs=2 00000020:00000080:1.0:1788891060.881554:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81c26800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:3.0:1788891060.881556:0:15523:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9250ba9ab800 2 00000020:01000004:3.0:1788891060.881562:0:15523:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9250ba9ab800 from lustre-OST0000 00000020:00000080:3.0:1788891060.881594:0:15523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891060.881603:0:15523:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788891060.881607:0:15523:0:(genops.c:885:class_export_put()) final put ffff924f81c24000/lustre-OST0000_UUID 00000020:00000080:3.0:1788891060.881610:0:15523:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81c24000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788891060.881617:0:15523:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788891060.881674:0:15523:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788891060.881679:0:15523:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788891060.881684:0:15523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891060.881689:0:15523:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788891060.881695:0:15523:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff924f81c22000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788891060.881702:0:15523:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff924f81ed3370) has exports, disconnecting them 00000020:00080000:3.0:1788891060.881707:0:15523:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff924f81c22000), last request at 1788890890 00000020:00000080:3.0:1788891060.881711:0:15523:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52aa4 00000020:00080000:3.0:1788891060.881720:0:15523:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff924f81c22000): rc 0 00000020:00000080:3.0:1788891060.881725:0:15523:0:(genops.c:885:class_export_put()) final put ffff924f81c22000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788891060.885231:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81c22000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788891060.885391:0:15523:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788891060.885396:0:15523:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788891060.885405:0:15523:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788891060.885600:0:15523:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788891060.886553:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f81ede000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788891060.888177:0:15523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891060.888188:0:15523:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788891060.888194:0:15523:0:(genops.c:885:class_export_put()) final put ffff9250ba968800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788891060.888215:0:15523:0:(genops.c:844:class_export_destroy()) destroying export ffff9250ba968800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788891060.888229:0:15523:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788891060.888299:0:15523:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788891060.888302:0:15523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788891060.888307:0:15523:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788891060.888315:0:15523:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff924f81c21800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788891060.888321:0:15523:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff925090b23370) has exports, disconnecting them 00000020:00080000:0.0:1788891060.888328:0:15523:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff924f81c21800), last request at 1788890890 00000020:00000080:0.0:1788891060.888332:0:15523:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52ab9 00000020:00080000:0.0:1788891060.888348:0:15523:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff924f81c21800): rc 0 00000020:00000080:0.0:1788891060.888360:0:15523:0:(genops.c:885:class_export_put()) final put ffff924f81c21800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788891060.888396:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81c21800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788891060.891630:0:15523:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788891060.891639:0:15523:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788891060.891644:0:15523:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788891060.891651:0:15523:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788891060.891683:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f81c24800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788891060.891916:0:15523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788891060.891929:0:15523:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788891060.891934:0:15523:0:(genops.c:885:class_export_put()) final put ffff924f81c21000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788891060.891939:0:15523:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81c21000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788891060.891945:0:15523:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788891060.892024:0:15523:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9250ba9ab800 1 00000020:00000080:1.0:1788891060.892031:0:15523:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52a42 00000020:00000080:1.0:1788891060.892037:0:15523:0:(genops.c:885:class_export_put()) final put ffff9250ba8e4000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788891060.892046:0:15523:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788891060.892062:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff9250ba8e4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788891060.892072:0:15523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891060.892077:0:15523:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788891060.892081:0:15523:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9250baa6cd28) has no exports 00000020:00000080:1.0:1788891060.915939:0:15523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788891060.915955:0:15523:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788891060.915960:0:15523:0:(genops.c:885:class_export_put()) final put ffff9250ba9ae000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788891060.915965:0:15523:0:(genops.c:844:class_export_destroy()) destroying export ffff9250ba9ae000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788891060.915977:0:15523:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788891060.916098:0:15523:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9250ba9ad800 00000020:02000400:1.0:1788891060.916146:0:15523:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788891061.181519:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891062.204847:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788891062.907649:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0dc9e9f5-fe04-4428-a993-651ed6fecbec->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788891062.907657:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0dc9e9f5-fe04-4428-a993-651ed6fecbec->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788891062.907660:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788891062.907662:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788891062.907822:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997390976:0@lo:400:kworker.0 00000400:00000100:0.0:1788891062.907879:0:3630:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875787997390976 offset 0 length 224: 4 00010000:00010000:1.0:1788891063.228694:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788891063.280179:0:15725:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788891063.292690:0:15725:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788891063.292778:0:15725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52d1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891063.292793:0:15725:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52d1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891063.292800:0:15725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52d1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891063.292807:0:15725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52d1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891063.292830:0:15725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788891063.292835:0:15725:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788891063.292866:0:15725:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788891063.292879:0:15725:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f83bad880 x1875787997390208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788891070 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891063.292893:0:15725:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788891063.292899:0:15725:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788891063.292904:0:15725:0:(import.c:65:import_set_state_nolock()) ffff924f82210800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788891063.292910:0:15725:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788891063.292915:0:15725:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f83bad880 x1875787997390208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788891070 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891063.292922:0:15725:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788891063.292925:0:15725:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00010000:00010000:1.0:1788891063.292969:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891063.292976:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52d1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891063.292985:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed600 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788891063.292988:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52d1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891063.292996:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52d1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd52d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891063.293003:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52d1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd52d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891063.293008:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788891063.293011:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788891063.293013:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788891063.293026:0:6484:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff925083396800 00010000:00010000:1.0:1788891063.293037:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52d1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd52d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891063.293043:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd52d1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd52d21 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891063.293055:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891063.293056:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891063.293058:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891063.296644:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1875787997390208:0@lo:38:kworker.0 00000100:00080000:3.0:1788891063.298120:0:15725:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788891063.298152:0:15725:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f83bad180 x1875787997390336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891066 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891063.298193:0:15725:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f83bae680 x1875787997390464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891068 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891063.298213:0:15725:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f83a5f480 x1875787997390592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891071 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891063.298221:0:15725:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f83baed80 x1875787997390848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891073 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891063.298229:0:15725:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f823e8000 x1875787997390976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891078 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891063.298247:0:15725:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788891063.298253:0:15725:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788891063.298278:0:15725:0:(import.c:65:import_set_state_nolock()) ffff924f82eaa000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788891063.298386:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1875787997390592:0@lo:400:kworker.0 00000100:00100000:1.0:1788891063.298395:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1875787997390464:0@lo:400:kworker.0 00000100:00100000:2.0:1788891063.298548:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997390976:0@lo:400:kworker.0 00000100:00100000:0.0:1788891063.299271:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997390848:0@lo:400:kworker.0 00000100:00100000:0.0:1788891063.299281:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997390336:0@lo:400:kworker.0 00000100:00100000:0.0:1788891063.299306:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3626:1875787997391104:0@lo:39:umount.0 00000400:00000100:0.0:1788891063.299350:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875787997391104 offset 0 length 224: 4 00010000:00010000:1.0:1788891064.251748:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891065.275893:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891066.301875:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891067.323819:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788891068.028604:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0dc9e9f5-fe04-4428-a993-651ed6fecbec->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788891068.028613:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0dc9e9f5-fe04-4428-a993-651ed6fecbec->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788891068.348083:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891069.372745:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891070.396360:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891071.419745:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891072.443731:0:10316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891072.507618:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891057/real 1788891057] req@ffff924f83baf480 x1875787997390720/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788891072 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891072.507650:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff924f83baf480 x1875787997390720/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788891072 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788891072.507670:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925083396800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788891072.507716:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788891072.507720:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3626:1875787997390720:0@lo:250:kworker.0 00000100:00080000:1.0:1788891072.507812:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0dc9e9f5-fe04-4428-a993-651ed6fecbec->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788891072.507818:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788891072.507831:0:36:0:(import.c:65:import_set_state_nolock()) ffff925083396800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788891072.507837:0:36:0:(import.c:510:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 280 00000100:00080000:1.0:1788891072.507841:0:36:0:(import.c:589:import_select_connection()) MGC192.168.204.126@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788891072.507847:0:36:0:(import.c:624:import_select_connection()) MGC192.168.204.126@tcp: import ffff925083396800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891072.507877:0:36:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83bae680 x1875787997391232/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788891072.508060:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3626:1875787997391232:0@lo:250:kworker.0 00000400:00000100:0.0:1788891072.508107:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875787997391232 offset 0 length 520: 4 00010000:00010000:1.0:1788891073.467749:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891073.531674:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891063/real 1788891063] req@ffff924f84297100 x1875787997391104/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788891073 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891073.531721:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff924f84297100 x1875787997391104/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788891073 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788891073.531749:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f82eaa000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788891073.531769:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3626:1875787997391104:0@lo:39:umount.0 00000100:00080000:3.0:1788891073.531863:0:15725:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788891073.531868:0:15725:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788891073.531872:0:15725:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788891073.533033:0:15725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd52d28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891073.533048:0:15725:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd52d28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891073.533056:0:15725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd52d28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891073.533063:0:15725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd52d28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891073.533090:0:15725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891073.533111:0:15725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd52f97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd52f9e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891073.533118:0:15725:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd52f97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd52f9e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891073.533124:0:15725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd52f97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52f9e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891073.533131:0:15725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd52f97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd52f9e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891073.533150:0:15725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788891073.533155:0:15725:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788891073.533187:0:15725:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788891073.533192:0:15725:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788891073.533197:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891073.533203:0:15725:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788891073.533208:0:15725:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9250bf6799b8) has no exports 00000020:00080000:3.0:1788891073.533230:0:15725:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9250bf6799b8) has no exports 00010000:00010000:2.0:1788891073.533260:0:10315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788891073.533270:0:10315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd52d28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891073.533278:0:10315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813eda00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891073.533283:0:10315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd52d28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891073.533292:0:10315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd52d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd52d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891073.533300:0:10315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd52d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd52d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891073.533306:0:10315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788891073.533309:0:10315:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788891073.533318:0:10315:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788891073.533333:0:10315:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff925083396800 00010000:00010000:2.0:1788891073.533337:0:10315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd52d28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd52d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891073.533344:0:10315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd52d28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd52d2f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891073.533358:0:10315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891073.533361:0:10315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd52f97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52f9e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891073.533367:0:10315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a800 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891073.533370:0:10315:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd52f97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd52f9e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891073.533376:0:10315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd52f97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd52f9e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891073.533382:0:10315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd52f97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd52f9e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891073.533386:0:10315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788891073.533389:0:10315:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788891073.533390:0:10315:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788891073.533394:0:10315:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff925083396800 00010000:00010000:2.0:1788891073.533397:0:10315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd52f97 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd52f9e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891073.533403:0:10315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd52f97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd52f9e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891073.533425:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891073.533426:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891073.533428:0:10315:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891073.533889:0:10314:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788891073.535913:0:15725:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff924f82d2c4e0 - data ffff92509203a438/ffff9250c1c18000 00000020:01000000:3.0:1788891073.536269:0:15725:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff924f81ef29c0 - data ffff9250b0aae5e8/ffff9250b6bd6400 00100000:10000000:3.0:1788891073.545879:0:15725:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788891073.553566:0:15725:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52ba0 00000020:00000080:2.0:1788891073.553703:0:15725:0:(genops.c:885:class_export_put()) final put ffff924f82c1c000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788891073.553725:0:15725:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9250c12de800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788891073.553729:0:15725:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9250c12de800 2 00000020:01000004:2.0:1788891073.553732:0:15725:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9250c12de800 from lustre-OST0001 00000020:00000080:1.0:1788891073.553810:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f82c1c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788891073.553868:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891073.553878:0:15725:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788891073.553882:0:15725:0:(genops.c:885:class_export_put()) final put ffff9250ba8f2800/lustre-OST0001_UUID 00000020:00000080:2.0:1788891073.553885:0:15725:0:(genops.c:844:class_export_destroy()) destroying export ffff9250ba8f2800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788891073.553892:0:15725:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788891073.554014:0:15725:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 0dc9e9f5-fe04-4428-a993-651ed6fecbec->MGS 00010000:00010000:2.0:1788891073.554031:0:15725:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd528f9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd52900 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891073.554042:0:15725:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd528f9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd52900 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891073.554049:0:15725:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788891073.554051:0:15725:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788891073.554055:0:15725:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788891073.554068:0:15725:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff925083396800 00010000:00010000:2.0:1788891073.554071:0:15725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd528f9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd52900 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891073.554087:0:15725:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff924f82311a00/0xa66601b03fd52dc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd52dc9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891073.554117:0:15725:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff924f82311a00/0xa66601b03fd52dc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd52dc9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891073.554122:0:15725:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788891073.554125:0:15725:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788891073.554127:0:15725:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788891073.554137:0:15725:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff925083396800 00010000:00010000:2.0:1788891073.554140:0:15725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff924f82311a00/0xa66601b03fd52dc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd52dc9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788891073.554155:0:15725:0:(import.c:65:import_set_state_nolock()) ffff925083396800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788891073.554159:0:15725:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788891073.554161:0:15725:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788891073.554163:0:15725:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788891073.554167:0:15725:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788891073.554178:0:15725:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f83bae680 x1875787997391232/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788891092 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788891073.554240:0:15725:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788891073.554242:0:15725:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:1.0:1788891073.554773:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0dc9e9f5-fe04-4428-a993-651ed6fecbec:3626:1875787997391232:0@lo:250:kworker.0 10000000:01000000:2.0:1788891073.554960:0:15725:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788891073.554969:0:15725:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd527f6 00000020:00000080:2.0:1788891073.554975:0:15725:0:(genops.c:885:class_export_put()) final put ffff925083393000/0dc9e9f5-fe04-4428-a993-651ed6fecbec 00000020:01000000:2.0:1788891073.554993:0:15725:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.126@tcp (flags='') 00000020:00000080:2.0:1788891073.554998:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788891073.555003:0:15725:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.126@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788891073.555007:0:15725:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff925091ac8000) has no exports 00000020:00000080:0.0:1788891073.555053:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925083393000/0dc9e9f5-fe04-4428-a993-651ed6fecbec for MGC192.168.204.126@tcp 10000000:01000000:0.0:1788891073.555081:0:6493:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788891073.555242:0:15725:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.126@tcp: client import never connected 00000100:00080000:2.0:1788891073.555246:0:15725:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788891073.555248:0:15725:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788891073.555251:0:15725:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788891073.555260:0:15725:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788891073.555289:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891073.555294:0:15725:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.126@tcp (uuid 0dc9e9f5-fe04-4428-a993-651ed6fecbec) 00000020:01000000:2.0:1788891073.555300:0:15725:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788891073.555303:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788891073.555306:0:15725:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788891073.555311:0:15725:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff924f82211800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788891073.555316:0:15725:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9250baa6b370) has exports, disconnecting them 00000020:00080000:2.0:1788891073.555321:0:15725:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff924f82211800), last request at 1788890911 00000020:00000080:2.0:1788891073.555325:0:15725:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52bca 00000020:00080000:2.0:1788891073.555335:0:15725:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff924f82211800): rc 0 00000020:00000080:2.0:1788891073.555339:0:15725:0:(genops.c:885:class_export_put()) final put ffff924f82211800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788891073.556199:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f82211800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788891073.556395:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff925083396800 for MGC192.168.204.126@tcp 00000020:00000080:0.0:1788891073.556404:0:36:0:(genops.c:885:class_export_put()) final put ffff925083392000/0dc9e9f5-fe04-4428-a993-651ed6fecbec 00000020:00000080:0.0:1788891073.556407:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925083392000/0dc9e9f5-fe04-4428-a993-651ed6fecbec for MGC192.168.204.126@tcp 00000020:01000000:0.0:1788891073.556412:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.126@tcp (0dc9e9f5-fe04-4428-a993-651ed6fecbec) 00010000:01000000:1.0:1788891073.556791:0:15725:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788891073.556795:0:15725:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788891073.556799:0:15725:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788891073.556804:0:15725:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788891073.557727:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891073.557841:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f82210800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788891073.557871:0:15725:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788891073.557876:0:15725:0:(genops.c:885:class_export_put()) final put ffff924f82213000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788891073.557879:0:15725:0:(genops.c:844:class_export_destroy()) destroying export ffff924f82213000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788891073.557894:0:15725:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788891073.557959:0:15725:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788891073.557963:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891073.557969:0:15725:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788891073.557976:0:15725:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff924f82eab800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788891073.557981:0:15725:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9250ba88b370) has exports, disconnecting them 00000020:00080000:1.0:1788891073.557986:0:15725:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff924f82eab800), last request at 1788890911 00000020:00000080:1.0:1788891073.557990:0:15725:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52bdf 00000020:00080000:1.0:1788891073.558005:0:15725:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff924f82eab800): rc 0 00000020:00000080:1.0:1788891073.558009:0:15725:0:(genops.c:885:class_export_put()) final put ffff924f82eab800/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1788891073.558172:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f82eab800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1788891073.559346:0:15725:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788891073.559352:0:15725:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788891073.559356:0:15725:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788891073.559362:0:15725:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788891073.559386:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f82eaa000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788891073.559447:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788891073.559617:0:10316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788891073.559710:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1788891073.559788:0:10315:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00010000:00010000:0.0:1788891073.559853:0:10314:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-5 blwis in pool) 00000100:00100000:0.0:1788891073.559953:0:6480:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff925091b9be00:6480] 1 exiting: rc = 0 00000100:00100000:0.0:1788891073.560019:0:10313:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff924f822dfe00:10313] 2 exiting: rc = 0 00000100:00100000:0.0:1788891073.560090:0:6479:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9250909b5200:6479] 0 exiting: rc = 1 00000100:00100000:0.0:1788891073.560146:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.560489:0:6482:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9250905bcc00:6482] 1 exiting: rc = 0 00000100:00100000:0.0:1788891073.560582:0:7436:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9250c1280c00:7436] 3 exiting: rc = 0 00000100:00100000:0.0:1788891073.560653:0:10317:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff924f823d4e00:10317] 4 exiting: rc = 0 00000100:00100000:0.0:1788891073.560809:0:6483:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9250905bca00:6483] 2 exiting: rc = 0 00000100:00100000:0.0:1788891073.560885:0:6481:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff925091b9bc00:6481] 0 exiting: rc = 1 00000100:00100000:0.0:1788891073.560945:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.560952:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.560960:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.560969:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.560975:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.560985:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.560996:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561002:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561007:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561019:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561026:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561032:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561038:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561043:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561050:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561056:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561061:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561067:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561082:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561088:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561093:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561098:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561103:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561109:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561114:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561119:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561124:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561130:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561136:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561141:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561147:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561154:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561159:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561165:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561170:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561175:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561179:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561184:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561190:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561196:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561201:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561206:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561211:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561216:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561221:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561227:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561232:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561237:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561242:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561247:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561252:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561257:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561262:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561275:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561281:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561286:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561291:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561296:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561301:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561306:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561312:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561317:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561322:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.561328:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788891073.563264:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891073.563277:0:15725:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1788891073.563286:0:15725:0:(genops.c:885:class_export_put()) final put ffff924f82ead000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1788891073.563291:0:15725:0:(genops.c:844:class_export_destroy()) destroying export ffff924f82ead000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1788891073.563296:0:15725:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1788891073.563439:0:15725:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9250c12de800 1 00000020:00000080:0.0:1788891073.563445:0:15725:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd52b6f 00000020:00000080:0.0:1788891073.563450:0:15725:0:(genops.c:885:class_export_put()) final put ffff924f82212800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788891073.563461:0:15725:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788891073.563470:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f82212800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788891073.563479:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788891073.563484:0:15725:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788891073.563488:0:15725:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9250baa699b8) has no exports 00000020:00000080:1.0:1788891073.605179:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788891073.605191:0:15725:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788891073.605198:0:15725:0:(genops.c:885:class_export_put()) final put ffff9250c122a000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788891073.605202:0:15725:0:(genops.c:844:class_export_destroy()) destroying export ffff9250c122a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788891073.605208:0:15725:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788891073.605503:0:15725:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff92508477a000 00000020:01000000:1.0:1788891073.605765:0:15725:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788891073.605771:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891073.605776:0:15725:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788891073.605780:0:15725:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9250ba88cd28) has no exports 00000020:00000080:1.0:1788891073.605801:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788891073.605806:0:15725:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788891073.605809:0:15725:0:(genops.c:885:class_export_put()) final put ffff9250ba8e3000/OSS_uuid 00000020:00000080:1.0:1788891073.605812:0:15725:0:(genops.c:844:class_export_destroy()) destroying export ffff9250ba8e3000/OSS_uuid for OSS 00000020:01000000:1.0:1788891073.605816:0:15725:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788891073.606042:0:8410:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9250c0a1a000:8410] 1 exiting: rc = 0 00000100:00100000:3.0:1788891073.606142:0:8596:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9250b66df800:8596] 3 exiting: rc = 0 00000100:00080000:2.0:1788891073.607513:0:6492:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788891073.607626:0:8408:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9250b66e3200:8408] 0 exiting: rc = 1 00000100:00100000:2.0:1788891073.607678:0:8411:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9250904a4800:8411] 2 exiting: rc = 0 00000100:00100000:3.0:1788891073.607734:0:11803:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff924f82324a00:11803] 4 exiting: rc = 0 00000100:00100000:1.0:1788891073.607902:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.607910:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.607935:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.607943:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.607951:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608104:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608110:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608115:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608120:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608125:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608130:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608135:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608141:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608146:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608151:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608156:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608179:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608185:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608190:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608195:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608200:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608205:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608209:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608215:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608219:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608238:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608243:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608248:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608254:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608259:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608266:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608271:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608277:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608282:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608288:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608294:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608299:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608304:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608309:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608314:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608319:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608324:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608329:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608335:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608340:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608346:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608350:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608355:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608365:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608376:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608383:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608388:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608393:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608397:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608403:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608408:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608413:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608419:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608424:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608429:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608442:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608447:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608452:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.608462:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891073.610483:0:8413:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9250ba861600:8413] 1 exiting: rc = 0 00000100:00100000:3.0:1788891073.610607:0:8412:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9250ba860c00:8412] 0 exiting: rc = 1 00000100:00100000:0.0:1788891073.610726:0:9105:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9250baa06e00:9105] 2 exiting: rc = 0 00000100:00100000:1.0:1788891073.611451:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611459:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611465:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611470:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611475:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611481:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611487:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611492:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611497:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611502:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611508:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611513:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611518:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611537:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611544:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611553:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611560:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611564:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611570:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611574:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611579:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611585:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611592:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611599:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611605:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611610:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611616:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611621:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611626:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611632:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611637:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611659:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611667:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611675:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611682:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611687:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611694:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611699:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611703:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611708:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611714:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611726:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611734:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611742:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611748:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611753:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611757:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611763:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611768:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611773:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611782:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611787:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611792:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611797:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611812:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611817:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611823:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611828:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611833:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611838:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611843:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611848:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611854:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.611859:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891073.613154:0:8415:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9250b669d200:8415] 1 exiting: rc = 0 00000100:00100000:3.0:1788891073.613212:0:8414:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9250b66e2200:8414] 0 exiting: rc = 1 00000100:00100000:0.0:1788891073.613230:0:8416:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9250b66c2200:8416] 2 exiting: rc = 0 00000100:00100000:1.0:1788891073.615818:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.615828:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.615854:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.615859:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.615865:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616014:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616035:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616043:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616049:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616055:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616061:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616067:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616073:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616079:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616084:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616089:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616095:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616100:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616106:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616111:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616116:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616123:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616129:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616198:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616208:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616213:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616219:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616224:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616229:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616235:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616241:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616262:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616274:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616280:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616286:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616292:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616297:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616311:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616318:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616323:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616330:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616335:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616340:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616346:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616354:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616361:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616369:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616374:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616379:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616385:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616391:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616397:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616403:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616415:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616422:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616428:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616433:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616439:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616444:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616449:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616455:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616461:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616466:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.616479:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891073.630304:0:8417:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9250ba93fe00:8417] 0 exiting: rc = 1 00000100:00100000:1.0:1788891073.630495:0:8418:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9250c0a97c00:8418] 1 exiting: rc = 0 00000100:00100000:0.0:1788891073.630745:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630753:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630759:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630764:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630769:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630775:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630780:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630801:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630806:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630811:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630816:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630821:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630826:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630832:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630837:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630841:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630846:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630851:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630855:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630860:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630864:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630869:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630874:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630879:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630884:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630889:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630893:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630899:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630904:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630909:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630914:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630930:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630937:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630942:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.630948:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631093:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631099:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631104:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631109:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631114:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631119:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631124:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631135:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631140:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631146:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631151:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631156:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631160:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631166:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631171:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631176:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631181:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631187:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631192:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631197:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631202:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631208:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631213:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631218:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631223:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631229:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631234:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631240:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891073.631253:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891073.633335:0:8420:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9250baa21c00:8420] 1 exiting: rc = 0 00000100:00100000:0.0:1788891073.636833:0:8419:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9250c0a96600:8419] 0 exiting: rc = 1 00000100:00100000:1.0:1788891073.636994:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637004:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637010:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637016:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637023:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637029:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637604:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637631:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637665:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637672:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637677:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637685:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637691:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637697:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637703:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637709:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637716:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637723:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637730:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637736:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637756:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637763:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637769:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637775:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637782:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637788:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637794:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637800:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637806:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637824:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637832:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637839:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637861:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637867:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637874:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637881:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637887:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637894:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637900:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637907:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637914:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637934:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637953:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.637960:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638478:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638489:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638495:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638501:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638507:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638513:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638519:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638548:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638556:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638563:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638571:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638577:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638599:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638606:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638612:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638617:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638634:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638645:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638651:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891073.638662:0:15725:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788891073.651315:0:15725:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788891085.801495:0:16489:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788891092.459839:0:17088:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788891092.459845:0:17088:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788891092.459847:0:17088:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788891092.459950:0:17088:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff924f839d2800 00000020:01000004:2.0:1788891092.459966:0:17088:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788891092.459973:0:17088:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788891092.459986:0:17088:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9250bf6799b8) 00000020:00000080:2.0:1788891092.460001:0:17088:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788891092.505472:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788891092.509716:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788891092.513542:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788891092.514595:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788891092.515117:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788891092.515332:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788891092.515578:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788891092.516015:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788891092.516221:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788891092.516459:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788891092.517022:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788891092.517941:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788891092.518455:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788891092.518779:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788891092.519331:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788891092.519645:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788891092.519965:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788891092.520567:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788891092.520905:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788891092.521091:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788891092.521394:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788891092.521622:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788891092.521920:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788891092.522111:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788891092.522358:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788891092.522581:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788891092.523011:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788891092.523199:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788891092.523443:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788891092.523672:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788891092.523970:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788891092.524216:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788891092.524417:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788891092.524653:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788891092.524928:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788891092.526445:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788891092.526841:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788891092.527309:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788891092.527563:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788891092.527805:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788891092.528069:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788891092.528429:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788891092.528691:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788891092.529052:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788891092.529311:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788891092.529560:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788891092.529883:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788891092.532013:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788891092.532568:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788891092.532885:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788891092.533360:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788891092.533589:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788891092.533901:0:17088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:3.0:1788891092.534336:0:17088:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788891092.534601:0:17088:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788891092.534609:0:17088:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788891092.534621:0:17088:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd53db3 00000020:01000004:3.0:1788891092.534628:0:17088:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788891092.534632:0:17088:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788891092.534637:0:17088:0:(tgt_mount.c:101:server_register_mount()) register mount ffff924f839d2800 from MGS 00000020:01000004:3.0:1788891092.534641:0:17088:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788891092.534651:0:17088:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff924f81ed4d28) 00000020:00000080:3.0:1788891092.534662:0:17088:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788891092.534721:0:17088:0:(tgt_mount.c:153:server_get_mount()) get mount ffff924f839d2800 from MGS, refs=2 00080000:01000000:3.0:1788891092.534747:0:17088:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788891092.534753:0:17088:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd53dc1 00000100:00100000:3.0:1788891092.534846:0:17088:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788891092.534971:0:17088:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788891092.534977:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788891092.535815:0:17088:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788891092.535822:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788891092.536383:0:17088:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788891092.536869:0:17088:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788891092.536876:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788891092.537318:0:17088:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788891092.537325:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788891092.537908:0:17088:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788891092.537914:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788891092.538537:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891092.538540:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891092.538542:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891092.538976:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891092.538979:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891092.538981:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891092.539421:0:17088:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788891092.540933:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788891092.545241:0:17088:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788891092.547271:0:17100:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788891092.547329:0:17088:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788891092.547760:0:17088:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788891092.548855:0:17088:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788891092.549879:0:17088:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788891092.550232:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788891092.550240:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788891092.551289:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788891092.551299:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788891092.552148:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788891092.552157:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788891092.553784:0:17088:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788891092.553813:0:17088:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.126@tcp' 00000020:01000004:3.0:1788891092.553815:0:17088:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788891092.553854:0:17088:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.126@tcp (typ=mgc) 00000020:00000080:3.0:1788891092.553870:0:17088:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.126@tcp (ffff924f81ed19b8) 00000020:00000080:3.0:1788891092.553890:0:17088:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788891092.553998:0:17088:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f83997800@MGC192.168.204.126@tcp: add connection 192.168.204.126@tcp at head 00010000:00010000:3.0:1788891092.554194:0:17088:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.126@tcp-0 is initialized 00000040:01000000:3.0:1788891092.554201:0:17088:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788891092.556659:0:17105:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788891092.557810:0:17106:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788891092.557920:0:17088:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.126@tcp (uuid 189d2e4e-bf9f-4645-ba04-f80564b97077) 00000020:00000080:3.0:1788891092.557963:0:17088:0:(genops.c:1385:class_connect()) connect: client 189d2e4e-bf9f-4645-ba04-f80564b97077, cookie 0xa66601b03fd53dcf 00000100:00080000:3.0:1788891092.558133:0:17088:0:(import.c:510:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788891092.558141:0:17088:0:(import.c:624:import_select_connection()) MGC192.168.204.126@tcp: import ffff924f83997800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1788891092.558189:0:17088:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f84294700 x1875787997391360/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788891092.558226:0:17088:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 189d2e4e-bf9f-4645-ba04-f80564b97077->MGS 00000020:01000004:3.0:1788891092.558253:0:17088:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788891092.558259:0:17088:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788891092.558277:0:17088:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff924f81ed3370) 00000020:00000080:3.0:1788891092.558291:0:17088:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788891092.559027:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:189d2e4e-bf9f-4645-ba04-f80564b97077:3626:1875787997391360:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788891092.559279:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891092.560097:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997391360 00000100:00100000:2.0:1788891092.560115:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997391360 00000100:00100000:2.0:1788891092.560163:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788891092.560171:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3626:x1875787997391360:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788891092.560201:0:17102:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 189d2e4e-bf9f-4645-ba04-f80564b97077@0@lo t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:2.0:1788891092.560235:0:17102:0:(genops.c:1385:class_connect()) connect: client 189d2e4e-bf9f-4645-ba04-f80564b97077, cookie 0xa66601b03fd53ddd 00000100:00080000:2.0:1788891092.561015:0:17102:0:(import.c:65:import_set_state_nolock()) ffff925090905800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788891092.561118:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+5:3626:x1875787997391360:12345-0@lo:250:mount.lustre.0 Request processed in 945us (1839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891092.561130:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788891092.561224:0:3626:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788891092.561234:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) MGC192.168.204.126@tcp: connect to target with instance 0 00000100:00080000:2.0:1788891092.561243:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) MGC192.168.204.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788891092.561247:0:3626:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788891092.561250:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f83997800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788891092.561252:0:3626:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788891092.561264:0:3626:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788891092.561270:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:189d2e4e-bf9f-4645-ba04-f80564b97077:3626:1875787997391360:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788891092.571933:0:17088:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788891092.572199:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788891092.572207:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788891092.573195:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788891092.573204:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788891092.573836:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788891092.573845:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788891092.575039:0:17088:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788891092.575293:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788891092.575300:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788891092.576429:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788891092.576441:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788891092.608101:0:17088:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788891092.608398:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788891092.608404:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788891092.609265:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788891092.609273:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788891092.611347:0:17088:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788891092.611574:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788891092.611580:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788891092.612711:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788891092.612721:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788891092.613171:0:17088:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788891092.613438:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788891092.613443:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788891092.614468:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788891092.614477:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788891092.615037:0:17088:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788891092.615177:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788891092.615182:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788891092.616502:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788891092.616512:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788891092.631513:0:17088:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788891092.631918:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788891092.631924:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788891092.633030:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788891092.633051:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788891092.634261:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788891092.634270:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788891092.636401:0:17088:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788891092.636431:0:17088:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788891092.636437:0:17088:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788891092.636597:0:17088:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788891092.636643:0:17088:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.126@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788891092.636647:0:17088:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788891092.636649:0:17088:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788891092.636650:0:17088:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891092.636651:0:17088:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891092.636653:0:17088:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891092.636654:0:17088:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891092.636655:0:17088:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788891092.636657:0:17088:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788891092.636659:0:17088:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891092.636660:0:17088:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788891092.636663:0:17088:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788891092.636665:0:17088:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788891092.636666:0:17088:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788891092.636667:0:17088:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891092.636668:0:17088:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891092.636669:0:17088:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891092.636670:0:17088:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891092.636671:0:17088:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788891092.636672:0:17088:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788891092.636673:0:17088:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891092.636679:0:17088:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788891092.636705:0:17088:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788891092.636725:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997391488:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788891092.636809:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891092.636897:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509276d000 going to sleep for 11 seconds 00000100:00100000:1.0:1788891092.637108:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997391488 00000100:00100000:1.0:1788891092.637116:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997391488 00000100:00100000:1.0:1788891092.637161:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788891092.637170:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+5:17088:x1875787997391488:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788891092.637291:0:17104:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788891092.637295:0:17104:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788891092.637298:0:17104:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788891092.638330:0:17125:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788891092.639726:0:17104:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1788891092.643364:0:17126:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788891092.643427:0:17126:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788891092.643430:0:17126:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788891092.643433:0:17126:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788891092.643644:0:17126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788891092.643869:0:17104:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788891092.643884:0:17104:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788891092.647981:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+5:17088:x1875787997391488:12345-0@lo:253:mount.lustre.0 Request processed in 10799us (11159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891092.648007:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788891092.648490:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997391488:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788891092.648512:0:17088:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788891092.648516:0:17088:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788891092.648688:0:17088:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788891092.648690:0:17088:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891092.648691:0:17088:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891092.648692:0:17088:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891092.648694:0:17088:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891092.648695:0:17088:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788891092.648697:0:17088:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788891092.648699:0:17088:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891092.648701:0:17088:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788891092.648825:0:17088:0:(tgt_mount.c:101:server_register_mount()) register mount ffff924f839d2800 from lustre-MDT0000 10000000:01000000:0.0:1788891092.648874:0:17088:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788891092.648877:0:17088:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788891092.648883:0:17088:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff924f81ed19b8 10000000:01000000:0.0:1788891092.648888:0:17088:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788891092.648898:0:17088:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff924f81ed19b8 from 1 10000000:01000000:0.0:1788891092.648903:0:17088:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788891092.648959:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd53de4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.648973:0:17088:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd53de4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.648984:0:17088:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd53de4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891092.649012:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997391616:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891092.649069:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891092.649122:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82259d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788891092.649394:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997391616 00000100:00100000:2.0:1788891092.649402:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997391616 00000100:00100000:2.0:1788891092.649462:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788891092.649474:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+5:17088:x1875787997391616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891092.649491:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891092.649601:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924f82311000/0xa66601b03fd53deb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd53de4 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891092.649631:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924f82311000/0xa66601b03fd53deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd53de4 expref: 6 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891092.649645:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924f82311000/0xa66601b03fd53deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53de4 expref: 6 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891092.649655:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311000, rc 0) 00000100:00100000:0.0:1788891092.649827:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997391616:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891092.649844:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd53de4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53deb expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.649855:0:17088:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd53de4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53deb expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891092.649933:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997391744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891092.649959:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+6:17088:x1875787997391616:12345-0@lo:101:mount.lustre.0 Request processed in 487us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891092.649965:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891092.649976:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788891092.649997:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82259d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788891092.650001:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997391744 00000100:00100000:2.0:1788891092.650005:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997391744 00000100:00100000:2.0:1788891092.650033:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788891092.650039:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+6:17088:x1875787997391744:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891092.650132:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+6:17088:x1875787997391744:12345-0@lo:501:mount.lustre.0 Request processed in 92us (165us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788891092.650139:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788891092.650504:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997391744:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788891092.650817:0:17088:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788891092.650838:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd53de4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53deb expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.650848:0:17088:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd53de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53deb expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891092.650859:0:17088:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff924f839d2800 10000000:01000000:0.0:1788891092.650868:0:17088:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788891092.650873:0:17088:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff924f839d2800 10000000:01000000:0.0:1788891092.650876:0:17088:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788891092.650879:0:17088:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff924f839d2800 from 1 10000000:01000000:0.0:1788891092.650882:0:17088:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788891092.650909:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523200/0xa66601b03fd53df2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.650917:0:17088:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925081523200/0xa66601b03fd53df2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.650927:0:17088:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925081523200/0xa66601b03fd53df2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891092.650945:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997391872:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891092.650994:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891092.651027:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82259d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788891092.651326:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997391872 00000100:00100000:1.0:1788891092.651333:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997391872 00000100:00100000:1.0:1788891092.651407:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788891092.651416:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+6:17088:x1875787997391872:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891092.651426:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891092.651444:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250857dec00/0xa66601b03fd53df9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd53df2 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891092.651467:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250857dec00/0xa66601b03fd53df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd53df2 expref: 7 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891092.651478:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250857dec00/0xa66601b03fd53df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53df2 expref: 7 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891092.651488:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857dec00, rc 0) 00000100:00100000:1.0:1788891092.651580:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+7:17088:x1875787997391872:12345-0@lo:101:mount.lustre.0 Request processed in 166us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891092.651587:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788891092.651637:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997391872:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891092.651651:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925081523200/0xa66601b03fd53df2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53df9 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.651660:0:17088:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925081523200/0xa66601b03fd53df2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53df9 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891092.651677:0:17088:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788891092.651751:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523200/0xa66601b03fd53df2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53df9 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.651760:0:17088:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925081523200/0xa66601b03fd53df2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53df9 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891092.651769:0:17088:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788891092.651773:0:17088:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788891092.651779:0:17088:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff924f839d2800 10000000:01000000:0.0:1788891092.651781:0:17088:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788891092.651785:0:17088:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788891092.651787:0:17088:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788891092.651803:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081522e00/0xa66601b03fd53e00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.651810:0:17088:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925081522e00/0xa66601b03fd53e00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.651817:0:17088:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925081522e00/0xa66601b03fd53e00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891092.651840:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997392000:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891092.651877:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891092.651911:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82259d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788891092.652023:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997392000 00000100:00100000:1.0:1788891092.652027:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997392000 00000100:00100000:1.0:1788891092.652063:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788891092.652071:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+7:17088:x1875787997392000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891092.652080:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891092.652090:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250857dee00/0xa66601b03fd53e07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd53e00 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891092.652117:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250857dee00/0xa66601b03fd53e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd53e00 expref: 8 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891092.652126:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250857dee00/0xa66601b03fd53e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53e00 expref: 8 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891092.652134:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857dee00, rc 0) 00000100:00100000:1.0:1788891092.652170:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+8:17088:x1875787997392000:12345-0@lo:101:mount.lustre.0 Request processed in 100us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891092.652177:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788891092.652246:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997392000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891092.652258:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925081522e00/0xa66601b03fd53e00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53e07 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.652266:0:17088:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925081522e00/0xa66601b03fd53e00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53e07 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891092.652322:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997392128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891092.652360:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891092.652379:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82259d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788891092.652482:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997392128 00000100:00100000:1.0:1788891092.652487:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997392128 00000100:00100000:1.0:1788891092.652516:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788891092.652564:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+8:17088:x1875787997392128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891092.652956:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+9:17088:x1875787997392128:12345-0@lo:501:mount.lustre.0 Request processed in 391us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891092.652964:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788891092.653081:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997392128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891092.653114:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997392256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891092.653163:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891092.653223:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82259d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788891092.653262:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997392256 00000100:00100000:1.0:1788891092.653266:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997392256 00000100:00100000:1.0:1788891092.653336:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788891092.653344:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+9:17088:x1875787997392256:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788891092.654253:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+9:17088:x1875787997392256:12345-0@lo:503:mount.lustre.0 Request processed in 905us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891092.654263:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788891092.654370:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997392256:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788891092.655091:0:17127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83baea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:189d2e4e-bf9f-4645-ba04-f80564b97077:17127:1875787997392384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788891092.655153:0:17127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891092.655199:0:17127:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788891092.655432:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997392384 00000100:00100000:2.0:1788891092.655439:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997392384 00000100:00100000:2.0:1788891092.655487:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788891092.655496:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+9:17127:x1875787997392384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788891092.656559:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+9:17127:x1875787997392384:12345-0@lo:502:llog_process_th.0 Request processed in 1020us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891092.656571:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788891092.656803:0:17127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83baea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:189d2e4e-bf9f-4645-ba04-f80564b97077:17127:1875787997392384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788891092.656843:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788891092.656861:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891092.656865:0:17127:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788891092.656871:0:17127:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788891092.656874:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788891092.656894:0:17127:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9250ba88cd28) 00000020:00000080:1.0:1788891092.656978:0:17127:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788891092.656986:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788891092.657100:0:17127:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788891092.657108:0:17127:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd53e15 00000020:00000080:1.0:1788891092.657423:0:17127:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788891092.657428:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788891092.657433:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891092.657435:0:17127:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788891092.657438:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788891092.657442:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891092.657443:0:17127:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788891092.657446:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788891092.657456:0:17127:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9250ba88b370) 00000020:00000080:1.0:1788891092.657466:0:17127:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788891092.657469:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788891092.657472:0:17127:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788891092.657475:0:17127:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788891092.657481:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788891092.657867:0:17127:0:(tgt_mount.c:153:server_get_mount()) get mount ffff924f839d2800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788891092.657883:0:17127:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9250ba888000) 00000020:00000080:1.0:1788891092.657892:0:17127:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788891092.658026:0:17127:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788891092.658033:0:17127:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd53e2a 00000020:00000080:1.0:1788891092.658141:0:17127:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788891092.658155:0:17127:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788891092.658159:0:17127:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa66601b03fd53e31 00080000:01000000:1.0:1788891092.658165:0:17127:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788891092.658169:0:17127:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd53e38 00010000:00010000:2.0:1788891092.734641:0:17127:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788891092.735400:0:17127:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:2.0:1788891092.735957:0:17127:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788891092.736677:0:17127:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9250bf67cd28) 00000020:00000080:2.0:1788891092.736704:0:17127:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788891092.736815:0:17127:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788891092.736824:0:17127:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd53e46 00000020:00000080:2.0:1788891092.737864:0:17127:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788891092.742770:0:17127:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa66601b03fd53e4d 00000020:00000080:1.0:1788891092.743189:0:17127:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788891092.743205:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788891092.743212:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891092.743215:0:17127:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788891092.743218:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788891092.743222:0:17127:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788891092.743223:0:17127:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788891092.743225:0:17127:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788891092.743227:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788891092.743230:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891092.743231:0:17127:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788891092.743234:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788891092.743239:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891092.743241:0:17127:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788891092.743246:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788891092.743301:0:17127:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788891092.743317:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788891092.743321:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891092.743322:0:17127:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788891092.743325:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788891092.743328:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891092.743330:0:17127:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788891092.743333:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788891092.743340:0:17127:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:00000080:1.0:1788891092.743375:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788891092.743396:0:17127:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9250ba8899b8) 00000020:00000080:1.0:1788891092.743411:0:17127:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788891092.743415:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788891092.743474:0:17127:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788891092.743482:0:17127:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788891092.743497:0:17127:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd53e5b 00010000:00080000:1.0:1788891092.743696:0:17127:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9250ba9aa000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1788891092.748891:0:17127:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788891092.750069:0:17127:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788891092.750083:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788891092.750116:0:17127:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788891092.750139:0:17127:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd53e62 00000100:00080000:2.0:1788891092.750150:0:17127:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788891092.750156:0:17127:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9250ba9aa000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788891092.750202:0:17127:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f823e8000 x1875787997392512/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788891092.750235:0:17127:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788891092.750332:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891092.750335:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891092.750337:0:17127:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788891092.750340:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788891092.750343:0:17127:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788891092.750344:0:17127:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788891092.750346:0:17127:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788891092.750347:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788891092.750349:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891092.750351:0:17127:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788891092.750353:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788891092.750357:0:17127:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788891092.750360:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891092.750361:0:17127:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788891092.750364:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788891092.750368:0:17127:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:2.0:1788891092.750391:0:17127:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788891092.750394:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788891092.750405:0:17127:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9250bf67b370) 00000020:00000080:2.0:1788891092.750415:0:17127:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788891092.750419:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788891092.750476:0:17127:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788891092.750482:0:17127:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788891092.750488:0:17127:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd53e70 00010000:00080000:2.0:1788891092.750515:0:17127:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f81773800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.126@tcp at head 00000100:00100000:0.0:1788891092.750703:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997392512:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788891092.750775:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788891092.750857:0:17127:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1788891092.750943:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997392512 00000100:00100000:0.0:1788891092.750950:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997392512 00000100:00100000:0.0:1788891092.750986:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788891092.750995:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1875787997392512:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1788891092.751020:0:17114:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:2.0:1788891092.753437:0:17127:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788891092.754079:0:17127:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788891092.756867:0:17127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788891092.757667:0:17127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788891092.766603:0:17127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788891092.767275:0:17133:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788891092.767281:0:17133:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788891092.768011:0:17127:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788891092.768023:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788891092.768062:0:17127:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788891092.768083:0:17127:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd53e77 00000100:00080000:1.0:1788891092.768093:0:17127:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788891092.768100:0:17127:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff924f81773800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891092.768134:0:17127:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83baea00 x1875787997392640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788891092.768167:0:17127:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788891092.768196:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997392640:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788891092.768257:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875787997392640 offset 0 length 520: 4 00000020:01000000:1.0:1788891092.768272:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788891092.768277:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891092.768279:0:17127:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788891092.768282:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788891092.768284:0:17127:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1788891092.768286:0:17127:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788891092.768287:0:17127:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788891092.768288:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788891092.768290:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891092.768292:0:17127:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788891092.768294:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788891092.768298:0:17127:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788891092.768300:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891092.768302:0:17127:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788891092.768314:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788891092.768319:0:17127:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:1.0:1788891092.768340:0:17127:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788891092.768343:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788891092.768365:0:17127:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9250b7178000) 00000020:00000080:1.0:1788891092.768383:0:17127:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788891092.768389:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788891092.768467:0:17127:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788891092.768474:0:17127:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788891092.768480:0:17127:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd53e85 00010000:00080000:1.0:1788891092.768507:0:17127:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9250ba96f000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1788891092.768776:0:17127:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788891092.768839:0:17127:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788891092.768853:0:17127:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:3.0:1788891092.769346:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788891092.769351:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788891092.769453:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997392768:0@lo:400:kworker.0 00000100:00100000:2.0:1788891092.769508:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891092.769674:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997392768 00000100:00100000:3.0:1788891092.769682:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997392768 00000100:00100000:3.0:1788891092.769729:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788891092.769738:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+9:3627:x1875787997392768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891092.769792:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+9:3627:x1875787997392768:12345-0@lo:400:kworker.0 Request processed in 56us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891092.769799:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788891092.769848:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997392768:0@lo:400:kworker.0 00000100:00100000:0.0:1788891092.774441:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1875787997392512:12345-0@lo:38:llog_process_th.0 Request processed in 23440us (23660us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788891092.774456:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788891092.774619:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250ba9aa000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788891092.774625:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788891092.774630:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997392512:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788891092.774711:0:17127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788891092.775189:0:17127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788891092.775343:0:17127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788891092.776083:0:17135:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788891092.776088:0:17135:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788891092.776745:0:17127:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788891092.776882:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788891092.776938:0:17127:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788891092.776959:0:17127:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd53e8c 00000100:00080000:3.0:1788891092.776969:0:17127:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788891092.776975:0:17127:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9250ba96f000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1788891092.777008:0:17127:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f84294e00 x1875787997392896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788891092.777078:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997392896:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788891092.777141:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875787997392896 offset 0 length 520: 4 00000100:00080000:3.0:1788891092.777193:0:17127:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788891092.777258:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891092.777262:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891092.777265:0:17127:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788891092.777268:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891092.777272:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891092.777274:0:17127:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788891092.777277:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788891092.777279:0:17127:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788891092.777281:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891092.777283:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891092.777285:0:17127:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788891092.777287:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891092.777289:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891092.777290:0:17127:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788891092.777293:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788891092.777318:0:17127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84296a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:189d2e4e-bf9f-4645-ba04-f80564b97077:17127:1875787997393024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788891092.777368:0:17127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891092.777394:0:17127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2d80 going to sleep for 11 seconds 00000100:00080000:0.0:1788891092.777460:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788891092.777466:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788891092.777469:0:36:0:(import.c:65:import_set_state_nolock()) ffff9250ba9aa000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891092.777474:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 314 00000100:00080000:0.0:1788891092.777478:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788891092.777483:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9250ba9aa000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891092.777500:0:36:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83a5fb80 x1875787997393152/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788891092.777568:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997393152:0@lo:38:kworker.0 00000100:00100000:2.0:1788891092.777572:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997393024 00000100:00100000:2.0:1788891092.777579:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997393024 00000100:00100000:1.0:1788891092.777596:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891092.777619:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788891092.777629:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+9:17127:x1875787997393024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788891092.777634:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997393152 00000100:00100000:1.0:1788891092.777637:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997393152 00000100:00100000:1.0:1788891092.777657:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788891092.777662:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3626:x1875787997393152:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788891092.777674:0:17115:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788891092.777709:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3626:x1875787997393152:12345-0@lo:38:kworker.0 Request processed in 45us (112us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788891092.777715:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788891092.777732:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+9:17127:x1875787997393024:12345-0@lo:502:llog_process_th.0 Request processed in 106us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891092.777739:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788891092.777744:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250ba9aa000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788891092.777748:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788891092.777752:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997393152:0@lo:38:kworker.0 00000100:00100000:3.0:1788891092.777849:0:17127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84296a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:189d2e4e-bf9f-4645-ba04-f80564b97077:17127:1875787997393024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788891092.777869:0:17127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891092.777873:0:17127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891092.777875:0:17127:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788891092.777878:0:17127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788891092.778099:0:17088:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788891092.778121:0:17088:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788891092.778140:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081522e00/0xa66601b03fd53e00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53e07 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891092.778150:0:17088:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925081522e00/0xa66601b03fd53e00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53e07 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891092.778158:0:17088:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff924f839d2800 from 1 10000000:01000000:1.0:1788891092.778161:0:17088:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788891092.778186:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250857df600/0xa66601b03fd53e93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891092.778193:0:17088:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250857df600/0xa66601b03fd53e93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891092.778202:0:17088:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250857df600/0xa66601b03fd53e93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891092.778215:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997393280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788891092.778244:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891092.778273:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250988a93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788891092.778319:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997393280 00000100:00100000:2.0:1788891092.778323:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997393280 00000100:00100000:2.0:1788891092.778356:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788891092.778363:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+9:17088:x1875787997393280:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891092.778371:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891092.778385:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924f82311c00/0xa66601b03fd53e9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd53e93 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891092.778404:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924f82311c00/0xa66601b03fd53e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd53e93 expref: 10 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891092.778422:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924f82311c00/0xa66601b03fd53e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53e93 expref: 10 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891092.778431:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311c00, rc 0) 00000100:00100000:2.0:1788891092.778466:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+10:17088:x1875787997393280:12345-0@lo:101:mount.lustre.0 Request processed in 104us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891092.778473:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788891092.778487:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997393280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891092.778499:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250857df600/0xa66601b03fd53e93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53e9a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891092.778508:0:17088:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250857df600/0xa66601b03fd53e93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53e9a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891092.779155:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997393408:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788891092.779193:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891092.779262:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997393408 00000100:00100000:3.0:1788891092.779267:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997393408 00000100:00100000:3.0:1788891092.779301:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788891092.779308:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+10:17088:x1875787997393408:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788891092.779322:0:17104:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788891092.779328:0:17104:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788891092.779389:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+10:17088:x1875787997393408:12345-0@lo:256:mount.lustre.0 Request processed in 81us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891092.780971:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250988a93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891092.781007:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997393408:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788891092.781892:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 10000000:01000000:1.0:1788891092.782878:0:17088:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788891092.782984:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250857df600/0xa66601b03fd53e93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53e9a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891092.783069:0:17088:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250857df600/0xa66601b03fd53e93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53e9a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891092.783080:0:17088:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff924f839d2800 from 1 10000000:01000000:1.0:1788891092.783082:0:17088:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788891092.783118:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250857dfe00/0xa66601b03fd53ea1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891092.783124:0:17088:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250857dfe00/0xa66601b03fd53ea1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891092.783134:0:17088:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250857dfe00/0xa66601b03fd53ea1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891092.783154:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997393536:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788891092.783208:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891092.783245:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250988a93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788891092.783427:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997393536 00000100:00100000:2.0:1788891092.783435:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997393536 00000100:00100000:2.0:1788891092.783487:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788891092.783497:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+10:17088:x1875787997393536:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891092.783509:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891092.783604:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924f82311a00/0xa66601b03fd53ea8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd53ea1 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891092.783632:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924f82311a00/0xa66601b03fd53ea8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd53ea1 expref: 11 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891092.783644:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924f82311a00/0xa66601b03fd53ea8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53ea1 expref: 11 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891092.783653:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311a00, rc 0) 00000100:00100000:2.0:1788891092.783699:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+11:17088:x1875787997393536:12345-0@lo:101:mount.lustre.0 Request processed in 204us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891092.783706:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788891092.783744:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997393536:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891092.783832:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250857dfe00/0xa66601b03fd53ea1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53ea8 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891092.783840:0:17088:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250857dfe00/0xa66601b03fd53ea1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53ea8 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891092.783901:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997393664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891092.783933:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891092.783994:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250988a93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891092.784030:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997393664 00000100:00100000:3.0:1788891092.784034:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997393664 00000100:00100000:3.0:1788891092.784096:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788891092.784103:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+11:17088:x1875787997393664:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891092.784291:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+11:17088:x1875787997393664:12345-0@lo:501:mount.lustre.0 Request processed in 189us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891092.784296:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788891092.784491:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997393664:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891092.784553:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997393792:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891092.784600:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891092.784716:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f822593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891092.784885:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997393792 00000100:00100000:1.0:1788891092.784891:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997393792 00000100:00100000:1.0:1788891092.784919:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788891092.784926:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+11:17088:x1875787997393792:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788891092.785059:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+11:17088:x1875787997393792:12345-0@lo:503:mount.lustre.0 Request processed in 133us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891092.785066:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788891092.785133:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997393792:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788891092.785756:0:17137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84296a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:189d2e4e-bf9f-4645-ba04-f80564b97077:17137:1875787997393920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788891092.785880:0:17137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891092.785954:0:17137:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788891092.785988:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997393920 00000100:00100000:1.0:1788891092.785993:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997393920 00000100:00100000:1.0:1788891092.786051:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788891092.786059:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+11:17137:x1875787997393920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788891092.786568:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+11:17137:x1875787997393920:12345-0@lo:502:llog_process_th.0 Request processed in 508us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891092.786576:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788891092.786660:0:17137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84296a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:189d2e4e-bf9f-4645-ba04-f80564b97077:17137:1875787997393920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788891092.786689:0:17137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891092.786698:0:17137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891092.786701:0:17137:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788891092.786708:0:17137:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff924f839d2800 00000020:00000080:0.0:1788891092.786717:0:17137:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788891092.786725:0:17137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891092.786728:0:17137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891092.786729:0:17137:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788891092.786732:0:17137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891092.786735:0:17137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891092.786736:0:17137:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788891092.786739:0:17137:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff924f839d2800 00000020:00000080:0.0:1788891092.786742:0:17137:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788891092.786807:0:17137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891092.786810:0:17137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891092.786812:0:17137:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788891092.786814:0:17137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891092.786817:0:17137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891092.786818:0:17137:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788891092.786821:0:17137:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff924f839d2800 00000020:00000080:0.0:1788891092.786823:0:17137:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788891092.786840:0:17137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891092.786842:0:17137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891092.786843:0:17137:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788891092.786845:0:17137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891092.786848:0:17137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891092.786849:0:17137:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788891092.786852:0:17137:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff924f839d2800 00000020:00000080:0.0:1788891092.786854:0:17137:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788891092.786885:0:17137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:189d2e4e-bf9f-4645-ba04-f80564b97077:17137:1875787997394048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788891092.786919:0:17137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891092.787128:0:17137:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f822593c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891092.787165:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997394048 00000100:00100000:3.0:1788891092.787170:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997394048 00000100:00100000:3.0:1788891092.787195:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788891092.787201:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+11:17137:x1875787997394048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788891092.787288:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+11:17137:x1875787997394048:12345-0@lo:502:llog_process_th.0 Request processed in 86us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891092.787294:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788891092.787370:0:17137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:189d2e4e-bf9f-4645-ba04-f80564b97077:17137:1875787997394048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788891092.787389:0:17137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891092.787393:0:17137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891092.787400:0:17137:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788891092.787404:0:17137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788891092.787465:0:17088:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788891092.787484:0:17088:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788891092.787505:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250857dfe00/0xa66601b03fd53ea1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53ea8 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.787515:0:17088:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250857dfe00/0xa66601b03fd53ea1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53ea8 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891092.787606:0:17088:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788891092.787610:0:17088:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff924f839d2800 10000000:01000000:0.0:1788891092.787612:0:17088:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff924f839d2800 10000000:01000000:0.0:1788891092.787616:0:17088:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788891092.787622:0:17088:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff924f839d2800 from 1 10000000:01000000:0.0:1788891092.787625:0:17088:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788891092.787652:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd53eaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.787660:0:17088:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd53eaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.787668:0:17088:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd53eaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891092.787680:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997394176:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891092.787706:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891092.787731:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f822593c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891092.788018:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997394176 00000100:00100000:3.0:1788891092.788023:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997394176 00000100:00100000:3.0:1788891092.788043:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788891092.788049:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+11:17088:x1875787997394176:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891092.788059:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891092.788073:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925080031800/0xa66601b03fd53eb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd53eaf expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891092.788109:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925080031800/0xa66601b03fd53eb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd53eaf expref: 12 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891092.788119:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925080031800/0xa66601b03fd53eb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53eaf expref: 12 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891092.788129:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080031800, rc 0) 00000100:00100000:3.0:1788891092.788172:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17088:x1875787997394176:12345-0@lo:101:mount.lustre.0 Request processed in 123us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891092.788178:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788891092.788245:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997394176:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891092.788257:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd53eaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53eb6 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.788272:0:17088:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd53eaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53eb6 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891092.788325:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997394304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891092.788351:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891092.788372:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f822593c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891092.788408:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997394304 00000100:00100000:3.0:1788891092.788412:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997394304 00000100:00100000:3.0:1788891092.788430:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788891092.788436:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17088:x1875787997394304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891092.788579:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17088:x1875787997394304:12345-0@lo:501:mount.lustre.0 Request processed in 142us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891092.788586:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788891092.788659:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997394304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891092.788689:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997394432:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891092.788739:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891092.788895:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997394432 00000100:00100000:3.0:1788891092.788900:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997394432 00000100:00100000:3.0:1788891092.788919:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788891092.788925:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17088:x1875787997394432:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788891092.788994:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17088:x1875787997394432:12345-0@lo:503:mount.lustre.0 Request processed in 68us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891092.789002:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788891092.789048:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f822593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891092.789061:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997394432:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788891092.789307:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:189d2e4e-bf9f-4645-ba04-f80564b97077:17138:1875787997394560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788891092.789346:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891092.789367:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788891092.789408:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997394560 00000100:00100000:0.0:1788891092.789412:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997394560 00000100:00100000:0.0:1788891092.789429:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788891092.789433:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17138:x1875787997394560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788891092.789510:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17138:x1875787997394560:12345-0@lo:502:llog_process_th.0 Request processed in 75us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891092.789516:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788891092.789617:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:189d2e4e-bf9f-4645-ba04-f80564b97077:17138:1875787997394560:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788891092.789666:0:17138:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788891092.789682:0:17138:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff924f81ed0000) 00000020:00000080:3.0:1788891092.789702:0:17138:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788891092.789907:0:17138:0:(tgt_mount.c:153:server_get_mount()) get mount ffff924f839d2800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788891092.789912:0:17138:0:(tgt_mount.c:187:server_put_mount()) put mount ffff924f839d2800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788891092.789914:0:17138:0:(obd_mount.c:710:lustre_put_lsi()) put ffff924f839d2800 4 00010000:00080000:3.0:1788891092.789941:0:17138:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9250ba96d800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:3.0:1788891092.792117:0:17138:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788891092.792318:0:17138:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788891092.792360:0:17138:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788891092.792371:0:17138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa66601b03fd53ec4 00000100:00080000:3.0:1788891092.792382:0:17138:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788891092.792388:0:17138:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9250ba96d800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1788891092.792425:0:17138:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f84297480 x1875787997394688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788891092.792503:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875787997394688:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788891092.792622:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891092.792964:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997394688 00000100:00100000:3.0:1788891092.792972:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997394688 00000100:00100000:3.0:1788891092.793013:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788891092.793023:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1875787997394688:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788891092.793168:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1875787997394688:12345-0@lo:38:llog_process_th.0 Request processed in 145us (545us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788891092.793175:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788891092.793192:0:17138:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788891092.793390:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:189d2e4e-bf9f-4645-ba04-f80564b97077:17138:1875787997394816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788891092.793438:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891092.793453:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788891092.793619:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997394816 00000100:00100000:0.0:1788891092.793625:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997394816 00000100:00100000:0.0:1788891092.793671:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788891092.793679:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925093b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17138:x1875787997394816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788891092.793980:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925093b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17138:x1875787997394816:12345-0@lo:502:llog_process_th.0 Request processed in 302us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891092.793996:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788891092.794071:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:189d2e4e-bf9f-4645-ba04-f80564b97077:17138:1875787997394816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788891092.794111:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:189d2e4e-bf9f-4645-ba04-f80564b97077:17138:1875787997394944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788891092.794144:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891092.794170:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788891092.794208:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997394944 00000100:00100000:0.0:1788891092.794212:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997394944 00000100:00100000:0.0:1788891092.794242:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788891092.794249:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17138:x1875787997394944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788891092.794309:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17138:x1875787997394944:12345-0@lo:502:llog_process_th.0 Request processed in 60us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891092.794316:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788891092.794381:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:189d2e4e-bf9f-4645-ba04-f80564b97077:17138:1875787997394944:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788891092.794399:0:17138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788891092.794517:0:17088:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788891092.794581:0:17088:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788891092.794596:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd53eaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53eb6 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.794608:0:17088:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd53eaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53eb6 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788891092.794664:0:17088:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788891092.794666:0:17088:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788891092.794667:0:17088:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891092.794669:0:17088:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891092.794670:0:17088:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891092.794672:0:17088:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891092.794673:0:17088:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788891092.794675:0:17088:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788891092.794677:0:17088:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891092.794678:0:17088:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788891092.794682:0:17088:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788891092.794685:0:17088:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788891092.794686:0:17088:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788891092.794687:0:17088:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891092.794689:0:17088:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891092.794693:0:17088:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891092.794694:0:17088:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891092.794695:0:17088:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788891092.794696:0:17088:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788891092.794697:0:17088:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891092.794698:0:17088:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788891092.794712:0:17088:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788891092.794891:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997395072:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788891092.794925:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891092.794947:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82259cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891092.794960:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997395072 00000100:00100000:0.0:1788891092.794963:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997395072 00000100:00100000:0.0:1788891092.794983:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788891092.794989:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17088:x1875787997395072:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788891092.795010:0:17102:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788891092.795022:0:17102:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788891092.795754:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788891092.795778:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250ba96d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788891092.795783:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788891092.795787:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875787997394688:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1788891092.799229:0:17102:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788891092.799248:0:17102:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788891092.799282:0:17125:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788891092.799292:0:17125:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788891092.799326:0:17125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff925081522200/0xa66601b03fd53ecb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.799348:0:17125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff924f82311c00/0xa66601b03fd53e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53e93 expref: 12 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.799357:0:17125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff925081522200/0xa66601b03fd53ecb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.799409:0:17125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff924f82311c00/0xa66601b03fd53e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd53e93 expref: 12 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.799426:0:17125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff924f82311c00/0xa66601b03fd53e9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd53e93 expref: 12 pid: 17103 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891092.799462:0:17125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17125:1875787997395200:0@lo:104: 00000100:00100000:0.0:1788891092.799599:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891092.799661:0:17125:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f822596c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891092.799767:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997395200 00000100:00100000:0.0:1788891092.799776:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997395200 00000100:00100000:0.0:1788891092.799817:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788891092.799825:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:189d2e4e-bf9f-4645-ba04-f80564b97077+3:17125:x1875787997395200:12345-0@lo:104: 00010000:00010000:0.0:1788891092.799838:0:17092:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250857df600/0xa66601b03fd53e93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd53e9a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891092.800141:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17088:x1875787997395072:12345-0@lo:253:mount.lustre.0 Request processed in 5143us (5207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891092.800155:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788891092.800210:0:17092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788891092.800221:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:189d2e4e-bf9f-4645-ba04-f80564b97077+3:17125:x1875787997395200:12345-0@lo:104: Request processed in 393us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891092.800228:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788891092.800257:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891092.800264:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250857df600/0xa66601b03fd53e93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd53e9a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.800273:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df600 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:0.0:1788891092.800276:0:17098:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250857df600/0xa66601b03fd53e93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd53e9a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.800286:0:17098:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250857df600/0xa66601b03fd53e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd53e9a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788891092.800293:0:17098:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250857df600/0xa66601b03fd53e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd53e9a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891092.800312:0:17098:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788891092.800434:0:17098:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250857df600/0xa66601b03fd53e93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53e9a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.800442:0:17098:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788891092.800479:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250857df600/0xa66601b03fd53e93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53e9a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.800486:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250857df600/0xa66601b03fd53e93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53e9a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.800505:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891092.800507:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891092.800509:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891092.800556:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:189d2e4e-bf9f-4645-ba04-f80564b97077:3628:1875787997395328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788891092.800598:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891092.800675:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997395328 00000100:00100000:0.0:1788891092.800681:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997395328 00010000:00010000:0.0:1788891092.800707:0:17094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff924f82311c00/0xa66601b03fd53e9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd53e93 expref: 12 pid: 17103 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891092.801003:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788891092.801013:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:3628:x1875787997395328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788891092.801029:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891092.801035:0:17094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff924f82311c00/0xa66601b03fd53e9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd53e93 expref: 12 pid: 17103 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.801049:0:17094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff924f82311c00/0xa66601b03fd53e9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd53e93 expref: 12 pid: 17103 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.801080:0:17094:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff925081522200/0xa66601b03fd53ecb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.801088:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925081522200/0xa66601b03fd53ecb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788891092.801106:0:17094:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001814514s 00010000:00010000:0.0:1788891092.801111:0:17094:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925081522200/0xa66601b03fd53ecb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.801119:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925081522200/0xa66601b03fd53ecb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.801128:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff925081522200/0xa66601b03fd53ecb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.801134:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff925081522200/0xa66601b03fd53ecb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.801141:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891092.801145:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff925081522200/0xa66601b03fd53ecb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.801153:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff925081522200/0xa66601b03fd53ecb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.801165:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff925081522200/0xa66601b03fd53ecb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.801176:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891092.801235:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:3628:x1875787997395328:12345-0@lo:103:ldlm_bl.0 Request processed in 224us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891092.801252:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788891092.801308:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924f82311c00/0xa66601b03fd53e9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd53e93 expref: 11 pid: 17103 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891092.801323:0:17125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17125:1875787997395200:0@lo:104: 00010000:00010000:0.0:1788891092.801345:0:17125:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff925081522200/0xa66601b03fd53ecb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.801355:0:17125:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff925081522200/0xa66601b03fd53ecb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.801362:0:17125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff925081522200/0xa66601b03fd53ecb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891092.801368:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925081522200/0xa66601b03fd53ecb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891092.801410:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17088:1875787997395072:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788891092.801421:0:17088:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788891092.801425:0:17088:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788891092.801427:0:17088:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788891092.801429:0:17088:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891092.801430:0:17088:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891092.801431:0:17088:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891092.801433:0:17088:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891092.801435:0:17088:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788891092.801437:0:17088:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788891092.801439:0:17088:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891092.801440:0:17088:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788891092.801453:0:17088:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788891092.801854:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:189d2e4e-bf9f-4645-ba04-f80564b97077:3628:1875787997395328:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788891092.820361:0:17088:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788891092.823136:0:17088:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788891092.823320:0:17148:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788891092.823333:0:17148:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788891092.824438:0:17149:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788891092.824517:0:17088:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1788891092.826046:0:17150:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff924f84294a80 x1875787997395456/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891092.826119:0:17150:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2f00 going to sleep for 0 seconds 00000040:00080000:2.0:1788891092.826410:0:17149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788891092.830287:0:17149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788891092.830363:0:17149:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1788891092.830491:0:17088:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788891092.830599:0:17088:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788891092.831030:0:17088:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788891092.831037:0:17088:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788891092.831090:0:17088:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788891092.832009:0:17088:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788891092.832587:0:17088:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788891092.832622:0:17088:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788891092.833907:0:17088:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1788891092.834872:0:17088:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1788891092.839463:0:17088:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788891092.844502:0:17088:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788891092.844669:0:17088:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbbfc41cdb988 00100000:10000000:0.0:1788891092.844679:0:17088:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788891092.850709:0:17088:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788891092.850736:0:17088:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788891092.850760:0:17088:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788891092.850794:0:17088:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788891092.852427:0:17088:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788891092.852787:0:17088:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788891093.563755:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891093.888075:0:17150:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2f00 going to sleep for 0 seconds 00000040:00080000:0.0:1788891093.889836:0:17147:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788891093.889844:0:17147:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788891093.891890:0:17147:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788891093.891899:0:17147:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:1.0:1788891094.075604:0:17106:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788891094.075613:0:17106:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff924f839d2800 from 7 10000000:01000000:1.0:1788891094.075618:0:17106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788891094.075663:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250857df200/0xa66601b03fd53ed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891094.075674:0:17106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250857df200/0xa66601b03fd53ed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891094.075762:0:17106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250857df200/0xa66601b03fd53ed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891094.075793:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997395584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788891094.075863:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891094.075907:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff925087938000 going to sleep for 11 seconds 00000100:00100000:3.0:1788891094.075993:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997395584 00000100:00100000:3.0:1788891094.076001:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997395584 00000100:00100000:3.0:1788891094.076046:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788891094.076055:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+11:17106:x1875787997395584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788891094.076067:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891094.076080:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925080031200/0xa66601b03fd53ed9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd53ed2 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891094.076100:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925080031200/0xa66601b03fd53ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd53ed2 expref: 12 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891094.076109:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925080031200/0xa66601b03fd53ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53ed2 expref: 12 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891094.076124:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080031200, rc 0) 00000100:00100000:3.0:1788891094.076161:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17106:x1875787997395584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891094.076167:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788891094.076243:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997395584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891094.076256:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250857df200/0xa66601b03fd53ed2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53ed9 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891094.076264:0:17106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250857df200/0xa66601b03fd53ed2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53ed9 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891094.076307:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997395712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788891094.076333:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891094.076359:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff925087938000 going to sleep for 11 seconds 00000100:00100000:3.0:1788891094.076408:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997395712 00000100:00100000:3.0:1788891094.076412:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997395712 00000100:00100000:3.0:1788891094.076444:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788891094.076451:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250933d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17106:x1875787997395712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788891094.076464:0:17102:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788891094.076479:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788891094.076482:0:17102:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788891094.076585:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250933d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17106:x1875787997395712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891094.076593:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788891094.076663:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997395712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788891094.076771:0:17106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788891094.076778:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250857df200/0xa66601b03fd53ed2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53ed9 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891094.076786:0:17106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250857df200/0xa66601b03fd53ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53ed9 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891094.588770:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891094.907632:0:17150:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2f00 going to sleep for 0 seconds 00000040:00080000:1.0:1788891094.913726:0:17147:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788891094.913736:0:17147:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788891094.913895:0:17147:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788891094.913941:0:17147:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788891094.914092:0:17147:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000001:02000400:3.0:1788891095.589823:0:17393:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788891095.612249:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891095.934032:0:17150:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2f00 going to sleep for 0 seconds 00000020:00000004:0.0:1788891096.173281:0:17445:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788891096.173692:0:17445:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788891096.635959:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788891096.759926:0:17496:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788891096.760096:0:17496:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788891096.955880:0:17150:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2f00 going to sleep for 0 seconds 00010000:00010000:1.0:1788891097.660362:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891097.979686:0:17150:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2f00 going to sleep for 0 seconds 00000100:00100000:0.0:1788891098.237382:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997395840:0@lo:400:kworker.0 00000100:00100000:0.0:1788891098.237475:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788891098.237598:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788891098.237603:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788891098.237607:0:37:0:(import.c:65:import_set_state_nolock()) ffff9250ba9aa000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788891098.237612:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 315 00000100:00080000:1.0:1788891098.237617:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788891098.237623:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9250ba9aa000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891098.237647:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83baca80 x1875787997395968/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788891098.237662:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891098.237665:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788891098.237667:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891098.237670:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788891098.237672:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788891098.237674:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788891098.237676:0:37:0:(import.c:65:import_set_state_nolock()) ffff9250ba96d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788891098.237680:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9250ba96d800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891098.237691:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83badc00 x1875787997396096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788891098.237730:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997395968:0@lo:38:kworker.0 00000100:00100000:1.0:1788891098.237827:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891098.237847:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875787997396096:0@lo:38:kworker.0 00000100:00100000:1.0:1788891098.237870:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891098.237900:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997395968 00000100:00100000:1.0:1788891098.237907:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997395968 00000100:00100000:1.0:1788891098.237937:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788891098.237945:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3626:x1875787997395968:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788891098.237960:0:17115:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788891098.238700:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997395840 00000100:00100000:2.0:1788891098.238706:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997395840 00000100:00100000:2.0:1788891098.238743:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788891098.238750:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250933d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:3629:x1875787997395840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891098.239600:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997396096 00000100:00100000:3.0:1788891098.239608:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997396096 00000100:00100000:3.0:1788891098.239634:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788891098.239640:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875787997396096:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788891098.239661:0:17111:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:3.0:1788891098.239696:0:17111:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa66601b03fd53ee0 00000004:00100000:3.0:1788891098.239710:0:17111:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788891098.239834:0:17111:0:(import.c:65:import_set_state_nolock()) ffff924f832de000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788891098.239894:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875787997396096:12345-0@lo:38:kworker.0 Request processed in 253us (2022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891098.239912:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788891098.240701:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250933d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:3629:x1875787997395840:12345-0@lo:400:kworker.0 Request processed in 1948us (3223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891098.240710:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788891098.244770:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997395840:0@lo:400:kworker.0 00010000:00080000:0.0:1788891098.247647:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff924f83badc00 x1875787997396096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788891108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788891098.247668:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788891098.247678:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788891098.247683:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788891098.247687:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250ba96d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788891098.247694:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875787997396096:0@lo:38:kworker.0 00000100:00100000:1.0:1788891098.263403:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3626:x1875787997395968:12345-0@lo:38:kworker.0 Request processed in 25452us (25569us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788891098.263417:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788891098.263748:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250ba9aa000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788891098.263762:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788891098.263768:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997395968:0@lo:38:kworker.0 00010000:00010000:1.0:1788891098.684799:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891099.007853:0:17150:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2f00 going to sleep for 0 seconds 00010000:00010000:1.0:1788891099.709916:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891100.027599:0:17150:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2f00 going to sleep for 0 seconds 00010000:00010000:1.0:1788891100.733733:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788891100.962393:0:17840:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788891100.962398:0:17840:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788891100.962400:0:17840:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788891100.962514:0:17840:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9250c12df800 00000020:01000004:1.0:1788891100.962726:0:17840:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1788891100.962739:0:17840:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788891100.962754:0:17840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9250b717cd28) 00000020:00000080:1.0:1788891100.962772:0:17840:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788891101.008412:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788891101.009006:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1788891101.011310:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788891101.011485:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1788891101.011890:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788891101.012193:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788891101.012393:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1788891101.012747:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1788891101.012942:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788891101.013134:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788891101.013552:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788891101.014024:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788891101.014285:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788891101.014591:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788891101.015459:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788891101.015888:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1788891101.016160:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1788891101.016419:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788891101.016856:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788891101.017087:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788891101.017361:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1788891101.017629:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788891101.018031:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788891101.018774:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788891101.019151:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1788891101.019629:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1788891101.020023:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788891101.020490:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788891101.021112:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1788891101.021315:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788891101.021787:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788891101.022364:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788891101.022848:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788891101.023104:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788891101.023353:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788891101.023625:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1788891101.023959:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1788891101.024212:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788891101.024421:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788891101.024744:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788891101.025021:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1788891101.025222:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788891101.025427:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788891101.025981:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1788891101.026191:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788891101.026406:0:17840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00080000:01000000:0.0:1788891101.031235:0:17840:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788891101.031460:0:17840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788891101.031473:0:17840:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788891101.031487:0:17840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa66601b03fd53eee 00000020:01000004:0.0:1788891101.031494:0:17840:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788891101.031864:0:17840:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788891101.031868:0:17840:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788891101.031878:0:17840:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788891101.031923:0:17840:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788891101.031927:0:17840:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788891101.038326:0:17840:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788891101.038371:0:17840:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.126@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788891101.038376:0:17840:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788891101.038377:0:17840:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788891101.038379:0:17840:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891101.038380:0:17840:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891101.038390:0:17840:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891101.038392:0:17840:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891101.038393:0:17840:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788891101.038395:0:17840:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891101.038396:0:17840:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788891101.038400:0:17840:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788891101.038403:0:17840:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788891101.038404:0:17840:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788891101.038405:0:17840:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891101.038406:0:17840:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891101.038407:0:17840:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891101.038408:0:17840:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891101.038409:0:17840:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788891101.038410:0:17840:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891101.038411:0:17840:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788891101.038440:0:17840:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788891101.038462:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997396224:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788891101.038736:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891101.038845:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f822196c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788891101.038893:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997396224 00000100:00100000:2.0:1788891101.038901:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997396224 00000100:00100000:2.0:1788891101.039021:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788891101.039033:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250933d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17840:x1875787997396224:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788891101.039064:0:17104:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788891101.039067:0:17104:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788891101.039073:0:17104:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788891101.039422:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250933d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17840:x1875787997396224:12345-0@lo:253:mount.lustre.0 Request processed in 390us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891101.039430:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788891101.039502:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997396224:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788891101.039512:0:17840:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788891101.039514:0:17840:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788891101.039516:0:17840:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788891101.039517:0:17840:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891101.039518:0:17840:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891101.039520:0:17840:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891101.039542:0:17840:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891101.039543:0:17840:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788891101.039545:0:17840:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891101.039546:0:17840:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788891101.039574:0:17840:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9250c12df800 from lustre-MDT0001 10000000:01000000:0.0:1788891101.039599:0:17840:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788891101.039601:0:17840:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788891101.039607:0:17840:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff924f81ed19b8 local copy 00010000:00010000:0.0:1788891101.039616:0:17840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd53de4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53deb expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891101.039726:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997396352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891101.039754:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891101.039989:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82219840 going to sleep for 11 seconds 00000100:00100000:3.0:1788891101.040068:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997396352 00000100:00100000:3.0:1788891101.040073:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997396352 00000100:00100000:3.0:1788891101.040098:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788891101.040105:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17840:x1875787997396352:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891101.040178:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17840:x1875787997396352:12345-0@lo:501:mount.lustre.0 Request processed in 72us (422us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788891101.040185:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788891101.040256:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997396352:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788891101.040269:0:17840:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788891101.040289:0:17840:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788891101.040295:0:17840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd53de4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53deb expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.040303:0:17840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd53de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53deb expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891101.040333:0:17840:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9250c12df800 10000000:01000000:0.0:1788891101.040337:0:17840:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788891101.040342:0:17840:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff924f81ed19b8 10000000:01000000:0.0:1788891101.040344:0:17840:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788891101.040347:0:17840:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff924f81ed19b8 from 1 10000000:01000000:0.0:1788891101.040350:0:17840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788891101.040374:0:17840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081522c00/0xa66601b03fd53ef5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.040393:0:17840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925081522c00/0xa66601b03fd53ef5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.040403:0:17840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925081522c00/0xa66601b03fd53ef5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891101.040416:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997396480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891101.040440:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891101.040462:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82219840 going to sleep for 11 seconds 00000100:00100000:3.0:1788891101.040510:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997396480 00000100:00100000:3.0:1788891101.040514:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997396480 00000100:00100000:3.0:1788891101.040556:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788891101.040563:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+12:17840:x1875787997396480:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891101.040571:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891101.040584:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925080030800/0xa66601b03fd53efc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd53ef5 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891101.040603:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925080030800/0xa66601b03fd53efc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd53ef5 expref: 13 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891101.040613:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925080030800/0xa66601b03fd53efc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53ef5 expref: 13 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891101.040621:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080030800, rc 0) 00000100:00100000:3.0:1788891101.040661:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+13:17840:x1875787997396480:12345-0@lo:101:mount.lustre.0 Request processed in 98us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891101.040666:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788891101.040760:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997396480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891101.040773:0:17840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925081522c00/0xa66601b03fd53ef5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53efc expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.040781:0:17840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925081522c00/0xa66601b03fd53ef5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53efc expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891101.040794:0:17840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788891101.040804:0:17840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081522c00/0xa66601b03fd53ef5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53efc expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.040822:0:17840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925081522c00/0xa66601b03fd53ef5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53efc expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891101.040830:0:17840:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9250c12df800 10000000:01000000:0.0:1788891101.040833:0:17840:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788891101.040836:0:17840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9250c12df800 from 1 10000000:01000000:0.0:1788891101.040838:0:17840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788891101.040851:0:17840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081522800/0xa66601b03fd53f03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.040858:0:17840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925081522800/0xa66601b03fd53f03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.040864:0:17840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925081522800/0xa66601b03fd53f03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891101.040876:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997396608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891101.040900:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891101.040917:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82219840 going to sleep for 11 seconds 00000100:00100000:3.0:1788891101.041035:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997396608 00000100:00100000:3.0:1788891101.041040:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997396608 00000100:00100000:3.0:1788891101.041059:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788891101.041065:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+13:17840:x1875787997396608:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891101.041072:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891101.041080:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925080030000/0xa66601b03fd53f0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd53f03 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891101.041093:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925080030000/0xa66601b03fd53f0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd53f03 expref: 14 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891101.041101:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925080030000/0xa66601b03fd53f0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53f03 expref: 14 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891101.041108:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080030000, rc 0) 00000100:00100000:3.0:1788891101.041146:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+14:17840:x1875787997396608:12345-0@lo:101:mount.lustre.0 Request processed in 82us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891101.041152:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788891101.041237:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997396608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891101.041249:0:17840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925081522800/0xa66601b03fd53f03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53f0a expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.041256:0:17840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925081522800/0xa66601b03fd53f03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53f0a expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891101.041268:0:17840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788891101.041283:0:17840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081522800/0xa66601b03fd53f03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53f0a expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.041297:0:17840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925081522800/0xa66601b03fd53f03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53f0a expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891101.041303:0:17840:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788891101.041307:0:17840:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788891101.041311:0:17840:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9250c12df800 10000000:01000000:0.0:1788891101.041313:0:17840:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788891101.041316:0:17840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788891101.041318:0:17840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788891101.041332:0:17840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd53f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.041339:0:17840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd53f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.041346:0:17840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd53f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891101.041359:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997396736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891101.041396:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891101.041409:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82219840 going to sleep for 11 seconds 00000100:00100000:3.0:1788891101.041460:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997396736 00000100:00100000:3.0:1788891101.041465:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997396736 00000100:00100000:3.0:1788891101.041484:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788891101.041490:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+14:17840:x1875787997396736:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891101.041496:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891101.041504:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925080030a00/0xa66601b03fd53f18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd53f11 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891101.041516:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925080030a00/0xa66601b03fd53f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd53f11 expref: 15 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891101.041550:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925080030a00/0xa66601b03fd53f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53f11 expref: 15 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891101.041564:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080030a00, rc 0) 00000100:00100000:3.0:1788891101.041592:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+15:17840:x1875787997396736:12345-0@lo:101:mount.lustre.0 Request processed in 103us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891101.041598:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788891101.041728:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997396736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891101.041739:0:17840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd53f11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53f18 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.041747:0:17840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd53f11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53f18 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788891101.043068:0:17840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1788891101.043719:0:17840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788891101.047804:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788891101.047861:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788891101.047877:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788891101.047891:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788891101.047907:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1788891101.047923:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1788891101.047938:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1788891101.047952:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788891101.047983:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788891101.048001:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1788891101.048014:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1788891101.048028:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1788891101.048041:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1788891101.048054:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788891101.048068:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788891101.048083:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1788891101.048096:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788891101.048108:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788891101.048121:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1788891101.048135:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788891101.048149:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788891101.048163:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788891101.048176:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788891101.048204:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1788891101.048211:0:17840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1788891101.048311:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997396864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891101.048377:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891101.048488:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82219900 going to sleep for 11 seconds 00000100:00100000:3.0:1788891101.048702:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997396864 00000100:00100000:3.0:1788891101.048709:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997396864 00000100:00100000:3.0:1788891101.048800:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788891101.048807:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+15:17840:x1875787997396864:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891101.048929:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+15:17840:x1875787997396864:12345-0@lo:501:mount.lustre.0 Request processed in 123us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891101.048934:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788891101.049010:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997396864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891101.049051:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997396992:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788891101.049091:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891101.049122:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250903c19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891101.049183:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997396992 00000100:00100000:1.0:1788891101.049188:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997396992 00000100:00100000:1.0:1788891101.049215:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788891101.049222:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+15:17840:x1875787997396992:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788891101.049843:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+15:17840:x1875787997396992:12345-0@lo:503:mount.lustre.0 Request processed in 620us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891101.049848:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997396992:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788891101.049851:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000040:00080000:2.0:1788891101.050226:0:17840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788891101.050289:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997397120:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891101.050321:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891101.050346:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250903c19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891101.050369:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997397120 00000100:00100000:0.0:1788891101.050374:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997397120 00000100:00100000:0.0:1788891101.050420:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788891101.050427:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+15:17840:x1875787997397120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891101.051330:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+15:17840:x1875787997397120:12345-0@lo:502:mount.lustre.0 Request processed in 899us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891101.051338:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788891101.051774:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997397120:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891101.051933:0:17150:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2f00 going to sleep for 0 seconds 00000040:00080000:2.0:1788891101.052006:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788891101.052036:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1788891101.052055:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1788891101.052071:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1788891101.052087:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1788891101.052102:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1788891101.052116:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1788891101.052128:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1788891101.052140:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1788891101.052151:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1788891101.052161:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1788891101.052172:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1788891101.052185:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1788891101.052197:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1788891101.052208:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1788891101.052218:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1788891101.052228:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1788891101.052239:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1788891101.052255:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1788891101.052266:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1788891101.052277:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1788891101.052289:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1788891101.052302:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1788891101.052313:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1788891101.052326:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1788891101.052346:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1788891101.052357:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1788891101.052368:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1788891101.052408:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1788891101.052423:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1788891101.052436:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1788891101.052455:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1788891101.052473:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1788891101.052489:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1788891101.052504:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1788891101.052517:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1788891101.052551:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1788891101.052567:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1788891101.052579:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1788891101.052589:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1788891101.052600:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1788891101.052611:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1788891101.052622:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1788891101.053795:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1788891101.053878:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997397248:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891101.053949:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891101.053996:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250903c19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891101.054060:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997397248 00000100:00100000:1.0:1788891101.054068:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997397248 00000100:00100000:1.0:1788891101.054154:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788891101.054165:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+15:17840:x1875787997397248:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891101.054291:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+15:17840:x1875787997397248:12345-0@lo:502:mount.lustre.0 Request processed in 128us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891101.054305:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788891101.054399:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997397248:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788891101.054463:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1788891101.054472:0:17840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788891101.060003:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891101.060021:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891101.060023:0:17844:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788891101.060035:0:17844:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788891101.060039:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788891101.060400:0:17844:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9250bf678000) 00000020:00000080:2.0:1788891101.060450:0:17844:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788891101.060458:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788891101.060569:0:17844:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788891101.060577:0:17844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa66601b03fd53f26 00000020:00000080:2.0:1788891101.060806:0:17844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788891101.060811:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891101.060815:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891101.060816:0:17844:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788891101.060820:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891101.060823:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891101.060825:0:17844:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788891101.060828:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788891101.060837:0:17844:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff925091ac8000) 00000020:00000080:2.0:1788891101.060847:0:17844:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788891101.060850:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788891101.060852:0:17844:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788891101.060855:0:17844:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788891101.060861:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788891101.060934:0:17844:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9250c12df800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788891101.060946:0:17844:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff925091accd28) 00000020:00000080:2.0:1788891101.060954:0:17844:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788891101.061027:0:17844:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788891101.061032:0:17844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd53f3b 00000020:00000080:2.0:1788891101.061767:0:17844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788891101.061776:0:17844:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788891101.061783:0:17844:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xa66601b03fd53f42 00080000:01000000:2.0:1788891101.061790:0:17844:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788891101.061793:0:17844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa66601b03fd53f49 00010000:00010000:2.0:1788891101.137168:0:17844:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788891101.137756:0:17844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1788891101.138549:0:17844:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788891101.139575:0:17844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788891101.139587:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891101.139593:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891101.139596:0:17844:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788891101.139599:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891101.139605:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891101.139607:0:17844:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788891101.139611:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788891101.139618:0:17844:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:00000080:0.0:1788891101.139648:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788891101.139664:0:17844:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9250baa68000) 00000020:00000080:0.0:1788891101.139684:0:17844:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1788891101.139690:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788891101.139753:0:17844:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788891101.139759:0:17844:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788891101.139766:0:17844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa66601b03fd53f57 00010000:00080000:0.0:1788891101.139794:0:17844:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f81edd000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.126@tcp at head 00010000:00010000:0.0:1788891101.141675:0:17844:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788891101.151437:0:17844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788891101.151453:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788891101.151498:0:17844:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788891101.151623:0:17844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd53f5e 00000100:00080000:0.0:1788891101.151636:0:17844:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788891101.151654:0:17844:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff924f81edd000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891101.151690:0:17844:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83a5f480 x1875787997397376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788891101.151712:0:17844:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788891101.151743:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788891101.151747:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788891101.151750:0:36:0:(import.c:65:import_set_state_nolock()) ffff9250ba9aa000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891101.151754:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 320 00000100:00080000:0.0:1788891101.151757:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788891101.151760:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9250ba9aa000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891101.151773:0:36:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83a5d880 x1875787997397504/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788891101.151783:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891101.151786:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788891101.151789:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891101.151791:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788891101.151831:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788891101.151844:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997397632:0@lo:400:kworker.0 00000100:00100000:0.0:1788891101.151909:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891101.151999:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997397632 00000100:00100000:0.0:1788891101.152007:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997397632 00000100:00100000:0.0:1788891101.152048:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788891101.152057:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997397632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891101.152108:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997397632:12345-0@lo:400:kworker.0 Request processed in 53us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891101.152121:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788891101.152162:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff924f83a5dc00 x1875787997397632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891101.152176:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997397632:0@lo:400:kworker.0 00000020:01000000:0.0:1788891101.152227:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891101.152232:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891101.152234:0:17844:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788891101.152237:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788891101.152240:0:17844:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788891101.152242:0:17844:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788891101.152243:0:17844:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788891101.152245:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788891101.152247:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891101.152248:0:17844:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788891101.152251:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891101.152255:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891101.152256:0:17844:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788891101.152260:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788891101.152294:0:17844:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788891101.152307:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891101.152309:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891101.152310:0:17844:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788891101.152312:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788891101.152314:0:17844:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1788891101.152315:0:17844:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788891101.152316:0:17844:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788891101.152318:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788891101.152320:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891101.152322:0:17844:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788891101.152324:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788891101.152327:0:17844:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788891101.152335:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891101.152337:0:17844:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788891101.152340:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788891101.152344:0:17844:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:0.0:1788891101.152362:0:17844:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788891101.152365:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788891101.152394:0:17844:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9250baa699b8) 00000020:00000080:0.0:1788891101.152409:0:17844:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788891101.152414:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788891101.152468:0:17844:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788891101.152475:0:17844:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788891101.152480:0:17844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa66601b03fd53f6c 00010000:00080000:0.0:1788891101.152539:0:17844:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f82eae800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.126@tcp at head 00000100:00100000:2.0:1788891101.152670:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997397376:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788891101.152715:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891101.152743:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997397504:0@lo:38:kworker.0 00000100:00100000:2.0:1788891101.152766:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891101.152800:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997397376 00000100:00100000:2.0:1788891101.152804:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997397376 00000100:00100000:2.0:1788891101.152827:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997397504 00000100:00100000:2.0:1788891101.152830:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997397504 00000100:00100000:2.0:1788891101.152839:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788891101.152844:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1875787997397376:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788891101.152862:0:17114:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:2.0:1788891101.152887:0:17114:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd53f73 00000004:00100000:2.0:1788891101.152901:0:17114:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788891101.152907:0:17114:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1788891101.153453:0:17844:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1788891101.154311:0:17844:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788891101.154546:0:17844:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1788891101.156957:0:17114:0:(import.c:65:import_set_state_nolock()) ffff925086ea2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788891101.157053:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3626:x1875787997397376:12345-0@lo:38:llog_process_th.0 Request processed in 4205us (4334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891101.157064:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788891101.157091:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788891101.157097:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1875787997397504:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788891101.157140:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1875787997397504:12345-0@lo:38:kworker.0 Request processed in 42us (4373us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788891101.157146:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788891101.157183:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788891101.157193:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788891101.157202:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788891101.157207:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788891101.157217:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f81edd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788891101.157230:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997397376:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788891101.157247:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788891101.157252:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250ba9aa000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788891101.157256:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788891101.157259:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997397504:0@lo:38:kworker.0 00000100:00100000:2.0:1788891101.157341:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997397760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788891101.157377:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891101.157755:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997397760 00000100:00100000:1.0:1788891101.157761:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997397760 00000100:00100000:1.0:1788891101.157793:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788891101.157799:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3627:x1875787997397760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788891101.157823:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788891101.157866:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3627:x1875787997397760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891101.157873:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788891101.157912:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997397760:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788891101.158760:0:17844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788891101.159015:0:17844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788891101.159129:0:17844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1788891101.160046:0:17849:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788891101.160052:0:17849:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788891101.162118:0:17844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788891101.162136:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788891101.162174:0:17844:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788891101.162195:0:17844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd53f7a 00000100:00080000:2.0:1788891101.162204:0:17844:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788891101.162210:0:17844:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff924f82eae800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788891101.162242:0:17844:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f823e8a80 x1875787997397888/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788891101.162271:0:17844:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788891101.162346:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997397888:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788891101.162417:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875787997397888 offset 0 length 520: 4 00000020:01000000:2.0:1788891101.162431:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891101.162434:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891101.162436:0:17844:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788891101.162439:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788891101.162441:0:17844:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788891101.162443:0:17844:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788891101.162444:0:17844:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788891101.162446:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788891101.162448:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891101.162450:0:17844:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788891101.162452:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788891101.162461:0:17844:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788891101.162465:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891101.162467:0:17844:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788891101.162470:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788891101.162474:0:17844:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:2.0:1788891101.162494:0:17844:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788891101.162497:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788891101.162509:0:17844:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff925091ac99b8) 00000020:00000080:2.0:1788891101.162540:0:17844:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788891101.162547:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788891101.162699:0:17844:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788891101.162707:0:17844:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788891101.162713:0:17844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa66601b03fd53f88 00010000:00080000:0.0:1788891101.162741:0:17844:0:(ldlm_lib.c:102:import_set_conn()) imp ffff925086eaf800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.126@tcp at head 00000100:00080000:1.0:1788891101.162848:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891101.162853:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788891101.162856:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891101.162859:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788891101.162939:0:17844:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788891101.163003:0:17844:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788891101.163019:0:17844:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788891101.164490:0:17844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788891101.164759:0:17844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788891101.165740:0:17844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788891101.167988:0:17851:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788891101.167994:0:17851:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788891101.169656:0:17844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788891101.169671:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788891101.169712:0:17844:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788891101.169736:0:17844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd53f8f 00000100:00080000:0.0:1788891101.169747:0:17844:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788891101.169759:0:17844:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff925086eaf800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891101.169805:0:17844:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83a5dc00 x1875787997398016/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788891101.169829:0:17844:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788891101.169856:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997398016:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788891101.169869:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891101.169875:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788891101.169878:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:1.0:1788891101.169879:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:0.0:1788891101.169884:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:1.0:1788891101.169885:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:0.0:1788891101.169888:0:17844:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788891101.169893:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891101.169897:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891101.169898:0:17844:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788891101.169902:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788891101.169903:0:17844:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788891101.169906:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891101.169908:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891101.169910:0:17844:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788891101.169913:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000400:00000100:2.0:1788891101.169914:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875787997398016 offset 0 length 520: 4 00000020:00000080:0.0:1788891101.169915:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891101.169917:0:17844:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788891101.169921:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788891101.169948:0:17844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891101.169951:0:17844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891101.169953:0:17844:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788891101.169956:0:17844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1788891101.170023:0:17840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788891101.170053:0:17840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788891101.170075:0:17840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd53f11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53f18 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891101.170085:0:17840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd53f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53f18 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891101.170093:0:17840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9250c12df800 from 1 10000000:01000000:2.0:1788891101.170096:0:17840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788891101.170123:0:17840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd53f96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891101.170132:0:17840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd53f96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891101.170142:0:17840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd53f96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891101.170168:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997398144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788891101.170205:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891101.170230:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250903c1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788891101.170263:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997398144 00000100:00100000:0.0:1788891101.170269:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997398144 00000100:00100000:0.0:1788891101.170317:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788891101.170333:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+15:17840:x1875787997398144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891101.170348:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891101.170361:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250813eda00/0xa66601b03fd53f9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd53f96 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.170396:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813eda00/0xa66601b03fd53f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd53f96 expref: 16 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.170407:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250813eda00/0xa66601b03fd53f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53f96 expref: 16 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.170417:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813eda00, rc 0) 00000100:00100000:0.0:1788891101.170463:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+16:17840:x1875787997398144:12345-0@lo:101:mount.lustre.0 Request processed in 132us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891101.170470:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788891101.170574:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997398144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891101.170588:0:17840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd53f96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53f9d expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891101.170597:0:17840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd53f96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53f9d expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891101.171168:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997398272:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788891101.171209:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891101.171243:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250903c1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788891101.171410:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997398272 00000100:00100000:1.0:1788891101.171417:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997398272 00000100:00100000:1.0:1788891101.171456:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788891101.171474:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+16:17840:x1875787997398272:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788891101.171491:0:17103:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788891101.171508:0:17103:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788891101.171511:0:17103:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788891101.171629:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+16:17840:x1875787997398272:12345-0@lo:256:mount.lustre.0 Request processed in 158us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891101.171637:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788891101.171754:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997398272:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788891101.172386:0:17840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788891101.172420:0:17840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd53f96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53f9d expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891101.172430:0:17840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd53f96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53f9d expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891101.172438:0:17840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9250c12df800 from 1 10000000:01000000:2.0:1788891101.172441:0:17840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788891101.172467:0:17840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82310800/0xa66601b03fd53fa4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891101.172546:0:17840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff924f82310800/0xa66601b03fd53fa4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891101.172558:0:17840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff924f82310800/0xa66601b03fd53fa4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891101.172577:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997398400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788891101.172707:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891101.172748:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250903c1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788891101.172803:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997398400 00000100:00100000:0.0:1788891101.172809:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997398400 00000100:00100000:0.0:1788891101.172851:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788891101.172860:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+16:17840:x1875787997398400:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891101.172870:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891101.172883:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250813ed600/0xa66601b03fd53fab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd53fa4 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.172905:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813ed600/0xa66601b03fd53fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd53fa4 expref: 17 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.172916:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250813ed600/0xa66601b03fd53fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53fa4 expref: 17 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.172934:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ed600, rc 0) 00000100:00100000:0.0:1788891101.172978:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17840:x1875787997398400:12345-0@lo:101:mount.lustre.0 Request processed in 119us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891101.172985:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788891101.173053:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997398400:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891101.173066:0:17840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff924f82310800/0xa66601b03fd53fa4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53fab expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891101.173076:0:17840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff924f82310800/0xa66601b03fd53fa4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53fab expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788891101.173218:0:17840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788891101.173248:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997398528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891101.173274:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891101.173438:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508630d000 going to sleep for 11 seconds 00000100:00100000:1.0:1788891101.173488:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997398528 00000100:00100000:1.0:1788891101.173493:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997398528 00000100:00100000:1.0:1788891101.173557:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788891101.173566:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17840:x1875787997398528:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891101.173645:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17840:x1875787997398528:12345-0@lo:501:mount.lustre.0 Request processed in 81us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891101.173651:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788891101.173732:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997398528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891101.173757:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997398656:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788891101.173794:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891101.173817:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508630d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788891101.173892:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997398656 00000100:00100000:0.0:1788891101.173897:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997398656 00000100:00100000:0.0:1788891101.173926:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788891101.173933:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17840:x1875787997398656:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891101.174048:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17840:x1875787997398656:12345-0@lo:503:mount.lustre.0 Request processed in 114us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891101.174056:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788891101.174137:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997398656:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788891101.174657:0:17840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788891101.174723:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997398784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891101.174762:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891101.174849:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508630d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788891101.176685:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997398784 00000100:00100000:1.0:1788891101.176698:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997398784 00000100:00100000:0.0:1788891101.182105:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788891101.182120:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17840:x1875787997398784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891101.182433:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17840:x1875787997398784:12345-0@lo:502:mount.lustre.0 Request processed in 316us (7669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891101.182442:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788891101.182593:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997398784:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788891101.182982:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788891101.183013:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1788891101.183028:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1788891101.183044:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1788891101.183059:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1788891101.183074:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1788891101.183088:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1788891101.183103:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1788891101.183118:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788891101.183131:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1788891101.183157:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1788891101.183191:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997398912:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891101.183238:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891101.183310:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788891101.183347:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997398912 00000100:00100000:3.0:1788891101.183355:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997398912 00000100:00100000:3.0:1788891101.183439:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788891101.183448:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17840:x1875787997398912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891101.183760:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17840:x1875787997398912:12345-0@lo:502:mount.lustre.0 Request processed in 313us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891101.183767:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788891101.183830:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997398912:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788891101.183872:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1788891101.183880:0:17840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788891101.184358:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891101.184366:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891101.184369:0:17853:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788891101.184376:0:17853:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9250c12df800 00000020:00000080:3.0:1788891101.184390:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788891101.184398:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891101.184400:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891101.184402:0:17853:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788891101.184404:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891101.184407:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891101.184408:0:17853:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788891101.184418:0:17853:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9250c12df800 00000020:00000080:3.0:1788891101.184420:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788891101.184514:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891101.184518:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891101.184548:0:17853:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788891101.184552:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891101.184556:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891101.184558:0:17853:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788891101.184562:0:17853:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9250c12df800 00000020:00000080:3.0:1788891101.184564:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788891101.187624:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891101.187636:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891101.187638:0:17853:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788891101.187643:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891101.187646:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891101.187648:0:17853:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788891101.187653:0:17853:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9250c12df800 00000020:00000080:3.0:1788891101.187655:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788891101.187712:0:17853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891101.187715:0:17853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891101.187717:0:17853:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788891101.187720:0:17853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1788891101.194662:0:17840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788891101.194709:0:17840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788891101.194775:0:17840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82310800/0xa66601b03fd53fa4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53fab expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.194788:0:17840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff924f82310800/0xa66601b03fd53fa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53fab expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891101.194845:0:17840:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788891101.194849:0:17840:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9250c12df800 10000000:01000000:0.0:1788891101.194852:0:17840:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9250c12df800 10000000:01000000:0.0:1788891101.194857:0:17840:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788891101.194863:0:17840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9250c12df800 from 1 10000000:01000000:0.0:1788891101.194866:0:17840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788891101.194900:0:17840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd53fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.194908:0:17840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd53fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.194920:0:17840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd53fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891101.194954:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997399040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891101.195026:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891101.195066:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f822193c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891101.195115:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997399040 00000100:00100000:0.0:1788891101.195122:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997399040 00000100:00100000:0.0:1788891101.195169:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788891101.195178:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17840:x1875787997399040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891101.195192:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891101.195203:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250813ec400/0xa66601b03fd53fb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd53fb2 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.195226:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813ec400/0xa66601b03fd53fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd53fb2 expref: 18 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.195237:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250813ec400/0xa66601b03fd53fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53fb2 expref: 18 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.195245:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ec400, rc 0) 00000100:00100000:0.0:1788891101.195283:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17840:x1875787997399040:12345-0@lo:101:mount.lustre.0 Request processed in 105us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891101.195291:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788891101.195337:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997399040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891101.195352:0:17840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd53fb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53fb9 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.195360:0:17840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd53fb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53fb9 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788891101.197121:0:17840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788891101.197387:0:17840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788891101.197624:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788891101.197649:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1788891101.197662:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1788891101.197674:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1788891101.197688:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1788891101.197717:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1788891101.197732:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1788891101.197744:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1788891101.197756:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1788891101.197768:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1788891101.197781:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1788891101.197795:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1788891101.197807:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1788891101.197820:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1788891101.197836:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1788891101.197850:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1788891101.197866:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1788891101.197881:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1788891101.197897:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1788891101.197913:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1788891101.197936:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1788891101.197972:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1788891101.197989:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1788891101.198003:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1788891101.198022:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1788891101.198041:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1788891101.198057:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1788891101.198077:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1788891101.198101:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1788891101.198115:0:17840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788891101.198193:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997399168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891101.198273:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891101.198323:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250854b8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788891101.198419:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997399168 00000100:00100000:1.0:1788891101.198426:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997399168 00000100:00100000:1.0:1788891101.198480:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788891101.198491:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17840:x1875787997399168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891101.198645:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17840:x1875787997399168:12345-0@lo:501:mount.lustre.0 Request processed in 155us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891101.198653:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788891101.198709:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997399168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891101.198748:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83baca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997399296:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788891101.198793:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891101.198821:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891101.198950:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997399296 00000100:00100000:0.0:1788891101.198955:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997399296 00000100:00100000:0.0:1788891101.198985:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788891101.198993:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17840:x1875787997399296:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891101.199073:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17840:x1875787997399296:12345-0@lo:503:mount.lustre.0 Request processed in 81us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891101.199080:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788891101.199171:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83baca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997399296:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788891101.199745:0:17840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788891101.199806:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83baca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997399424:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891101.199847:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891101.199882:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab189c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788891101.199974:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997399424 00000100:00100000:2.0:1788891101.199979:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997399424 00000100:00100000:2.0:1788891101.200012:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788891101.200019:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17840:x1875787997399424:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891101.200107:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17840:x1875787997399424:12345-0@lo:502:mount.lustre.0 Request processed in 88us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891101.200114:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788891101.200689:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83baca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997399424:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788891101.200919:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788891101.200951:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1788891101.200969:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1788891101.201003:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1788891101.201023:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1788891101.201041:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1788891101.201055:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1788891101.201069:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1788891101.201082:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1788891101.201096:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1788891101.201110:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1788891101.201124:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1788891101.201138:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1788891101.201152:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1788891101.201165:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1788891101.201179:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1788891101.201193:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1788891101.201207:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1788891101.201220:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1788891101.201247:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1788891101.201262:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1788891101.201285:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1788891101.201299:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1788891101.201313:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1788891101.201327:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1788891101.201340:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1788891101.201356:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1788891101.201373:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1788891101.201403:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1788891101.201420:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1788891101.201438:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1788891101.201454:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1788891101.201469:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1788891101.201485:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1788891101.201504:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1788891101.202430:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1788891101.202456:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1788891101.202467:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1788891101.202478:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1788891101.202489:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1788891101.202504:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1788891101.202518:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1788891101.202682:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1788891101.202700:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1788891101.202717:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1788891101.202734:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1788891101.202748:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1788891101.202764:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1788891101.202819:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83baca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997399552:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891101.202896:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891101.202946:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891101.203430:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997399552 00000100:00100000:0.0:1788891101.203439:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997399552 00000100:00100000:0.0:1788891101.203492:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788891101.203502:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17840:x1875787997399552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891101.203723:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17840:x1875787997399552:12345-0@lo:502:mount.lustre.0 Request processed in 221us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891101.203732:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788891101.203978:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83baca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997399552:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788891101.204279:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1788891101.204392:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1788891101.204433:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83baca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997399680:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891101.204472:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891101.204508:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891101.204731:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997399680 00000100:00100000:0.0:1788891101.204737:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997399680 00000100:00100000:0.0:1788891101.204999:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788891101.205008:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17840:x1875787997399680:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891101.205275:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17840:x1875787997399680:12345-0@lo:502:mount.lustre.0 Request processed in 267us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891101.205282:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788891101.205394:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83baca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997399680:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788891101.205446:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1788891101.205458:0:17840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788891101.206794:0:17858:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788891101.206810:0:17858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9250b71799b8) 00000020:00000080:1.0:1788891101.206835:0:17858:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788891101.206925:0:17858:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9250c12df800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788891101.206929:0:17858:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9250c12df800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788891101.206932:0:17858:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9250c12df800 3 00010000:00080000:1.0:1788891101.206966:0:17858:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92508744d000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1788891101.208701:0:17858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788891101.209035:0:17858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788891101.209418:0:17858:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788891101.209430:0:17858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xa66601b03fd53fc7 00000100:00080000:2.0:1788891101.209441:0:17858:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788891101.209446:0:17858:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92508744d000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788891101.209482:0:17858:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f823eb480 x1875787997399808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788891101.209514:0:17858:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788891101.209661:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875787997399808:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788891101.209730:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788891101.209786:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891101.209790:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788891101.209794:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891101.209797:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788891101.209826:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997399808 00000100:00100000:1.0:1788891101.209833:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997399808 00000100:00100000:1.0:1788891101.209861:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788891101.209868:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3626:x1875787997399808:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788891101.209898:0:17110:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:1.0:1788891101.209933:0:17110:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa66601b03fd53fce 00000004:00100000:1.0:1788891101.209947:0:17110:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788891101.209974:0:17110:0:(import.c:65:import_set_state_nolock()) ffff925087449000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788891101.210019:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875787997399808:12345-0@lo:38:llog_process_th.0 Request processed in 150us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891101.210027:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788891101.210064:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff924f823eb480 x1875787997399808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788891111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891101.210073:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788891101.210081:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788891101.210087:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788891101.210090:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788891101.210093:0:3626:0:(import.c:65:import_set_state_nolock()) ffff92508744d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788891101.210112:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875787997399808:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788891101.210431:0:17858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1788891101.210631:0:17840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788891101.210663:0:17840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788891101.210683:0:17840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd53fb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53fb9 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.210694:0:17840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd53fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53fb9 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788891101.210742:0:17840:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788891101.210744:0:17840:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788891101.210746:0:17840:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788891101.210747:0:17840:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788891101.210752:0:17840:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788891101.210753:0:17840:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788891101.210754:0:17840:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788891101.210756:0:17840:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788891101.210758:0:17840:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788891101.210762:0:17840:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788891101.210764:0:17840:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788891101.210765:0:17840:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788891101.210766:0:17840:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788891101.210767:0:17840:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788891101.210768:0:17840:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788891101.210769:0:17840:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788891101.210770:0:17840:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788891101.210771:0:17840:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788891101.210772:0:17840:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788891101.210786:0:17840:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788891101.210799:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83badc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997399936:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788891101.210837:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891101.211479:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab18d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788891101.212002:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997399936 00000100:00100000:2.0:1788891101.212009:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997399936 00000100:00100000:2.0:1788891101.212068:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788891101.212083:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17840:x1875787997399936:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788891101.212113:0:17102:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788891101.212126:0:17102:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788891101.217553:0:17089:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788891101.217636:0:17102:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788891101.217651:0:17102:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788891101.217714:0:17125:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788891101.217719:0:17125:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788891101.217749:0:17125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9250813ed800/0xa66601b03fd53fd5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.217767:0:17125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925080031200/0xa66601b03fd53ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53ed2 expref: 18 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.217775:0:17125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250813eda00/0xa66601b03fd53f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53f96 expref: 18 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.217783:0:17125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9250813ed800/0xa66601b03fd53fd5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.217822:0:17125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250813eda00/0xa66601b03fd53f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd53f96 expref: 18 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.217837:0:17125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250813eda00/0xa66601b03fd53f9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd53f96 expref: 18 pid: 17104 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891101.217850:0:17125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17125:1875787997400064:0@lo:104: 00000100:00100000:0.0:1788891101.217891:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891101.217951:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83badc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:17840:1875787997399936:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788891101.217963:0:17840:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788891101.217966:0:17840:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788891101.217968:0:17840:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788891101.217969:0:17840:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788891101.217970:0:17840:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788891101.217972:0:17840:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788891101.217973:0:17840:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788891101.217974:0:17840:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788891101.217976:0:17840:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788891101.217977:0:17840:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788891101.217993:0:17840:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788891101.223709:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17840:x1875787997399936:12345-0@lo:253:mount.lustre.0 Request processed in 11617us (12860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891101.223724:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:0.0:1788891101.223999:0:17125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925080031200/0xa66601b03fd53ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd53ed2 expref: 17 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891101.224013:0:17125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff925080031200/0xa66601b03fd53ed9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd53ed2 expref: 17 pid: 17103 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891101.224027:0:17125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17125:1875787997400192:0@lo:104: 00000100:00100000:0.0:1788891101.224193:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891101.224754:0:17125:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8221ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788891101.226169:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997400064 00000100:00100000:3.0:1788891101.226179:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997400064 00000100:00100000:3.0:1788891101.226215:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997400192 00000100:00100000:3.0:1788891101.226218:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997400192 00000100:00100000:3.0:1788891101.226234:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788891101.226243:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:189d2e4e-bf9f-4645-ba04-f80564b97077+4:17125:x1875787997400064:12345-0@lo:104: 00010000:00010000:3.0:1788891101.226905:0:17092:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd53f96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd53f9d expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891101.227044:0:17092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788891101.227052:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:189d2e4e-bf9f-4645-ba04-f80564b97077+4:17125:x1875787997400064:12345-0@lo:104: Request processed in 810us (9160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891101.227060:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788891101.227078:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788891101.227085:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:189d2e4e-bf9f-4645-ba04-f80564b97077+3:17125:x1875787997400192:12345-0@lo:104: 00010000:00010000:3.0:1788891101.227093:0:17092:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250857df200/0xa66601b03fd53ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd53ed9 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891101.227125:0:17092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788891101.227130:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:189d2e4e-bf9f-4645-ba04-f80564b97077+3:17125:x1875787997400192:12345-0@lo:104: Request processed in 47us (2938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891101.227135:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788891101.227210:0:17125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17125:1875787997400064:0@lo:104: 00000100:00100000:1.0:1788891101.227219:0:17125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17125:1875787997400192:0@lo:104: 00010000:00010000:1.0:1788891101.227241:0:17125:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9250813ed800/0xa66601b03fd53fd5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.227263:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788891101.227269:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd53f96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd53f9d expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.227277:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310400 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788891101.227281:0:17097:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd53f96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd53f9d expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.227289:0:17097:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd53f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd53f9d expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891101.227296:0:17097:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd53f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd53f9d expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891101.227302:0:17097:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788891101.227394:0:17097:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd53f96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53f9d expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.227401:0:17097:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788891101.227422:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd53f96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53f9d expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.227429:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff924f82310400/0xa66601b03fd53f96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53f9d expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.227439:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891101.227443:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250857df200/0xa66601b03fd53ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd53ed9 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.227457:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df200 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788891101.227460:0:17097:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250857df200/0xa66601b03fd53ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd53ed9 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.227467:0:17097:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250857df200/0xa66601b03fd53ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd53ed9 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891101.227472:0:17097:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250857df200/0xa66601b03fd53ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd53ed9 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891101.227477:0:17097:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788891101.227793:0:17097:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250857df200/0xa66601b03fd53ed2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53ed9 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.227800:0:17097:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788891101.227814:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250857df200/0xa66601b03fd53ed2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53ed9 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.227820:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250857df200/0xa66601b03fd53ed2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53ed9 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.227833:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891101.227835:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891101.227837:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891101.227843:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891101.227855:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:189d2e4e-bf9f-4645-ba04-f80564b97077:3628:1875787997400320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891101.227897:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891101.227941:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997400448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891101.227969:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891101.228011:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997400320 00000100:00100000:1.0:1788891101.228016:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997400320 00010000:00010000:1.0:1788891101.228037:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250813eda00/0xa66601b03fd53f9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd53f96 expref: 18 pid: 17104 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891101.228058:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997400448 00000100:00100000:1.0:1788891101.228061:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997400448 00010000:00010000:1.0:1788891101.228072:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925080031200/0xa66601b03fd53ed9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd53ed2 expref: 19 pid: 17103 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891101.228091:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788891101.228097:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+19:3628:x1875787997400320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891101.228109:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891101.228114:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250813eda00/0xa66601b03fd53f9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd53f96 expref: 19 pid: 17104 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.228124:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250813eda00/0xa66601b03fd53f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd53f96 expref: 19 pid: 17104 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.228137:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813eda00/0xa66601b03fd53f9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd53f96 expref: 19 pid: 17104 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.228150:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891101.228177:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+18:3628:x1875787997400320:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891101.228182:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788891101.228196:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788891101.228202:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83baf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+17:3629:x1875787997400448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891101.228215:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891101.228220:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925080031200/0xa66601b03fd53ed9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd53ed2 expref: 17 pid: 17103 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.228228:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925080031200/0xa66601b03fd53ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd53ed2 expref: 17 pid: 17103 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.228238:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925080031200/0xa66601b03fd53ed9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd53ed2 expref: 17 pid: 17103 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.228248:0:17095:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9250813ed800/0xa66601b03fd53fd5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.228256:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813ed800/0xa66601b03fd53fd5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788891101.228269:0:17095:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010550113s 00010000:00010000:1.0:1788891101.228273:0:17095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250813ed800/0xa66601b03fd53fd5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.228280:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250813ed800/0xa66601b03fd53fd5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.228286:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9250813ed800/0xa66601b03fd53fd5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.228292:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9250813ed800/0xa66601b03fd53fd5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.228298:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891101.228302:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9250813ed800/0xa66601b03fd53fd5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.228314:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9250813ed800/0xa66601b03fd53fd5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.228328:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9250813ed800/0xa66601b03fd53fd5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.228337:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891101.228364:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83baf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+16:3629:x1875787997400448:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891101.228370:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788891101.228423:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:189d2e4e-bf9f-4645-ba04-f80564b97077:3628:1875787997400320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891101.228444:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997400448:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891101.228457:0:17125:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9250813ed800/0xa66601b03fd53fd5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.228464:0:17125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9250813ed800/0xa66601b03fd53fd5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891101.228470:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813ed800/0xa66601b03fd53fd5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1788891101.228519:0:17840:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788891101.228684:0:17864:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788891101.228688:0:17864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788891101.230739:0:17865:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788891101.230793:0:17840:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788891101.231615:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e9500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17866:1875787997400576:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788891101.231692:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891101.231718:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788891101.231892:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997400576 00000100:00100000:1.0:1788891101.231899:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997400576 00000100:00100000:1.0:1788891101.231949:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788891101.231967:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17866:x1875787997400576:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788891101.232077:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17866:x1875787997400576:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 111us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891101.232084:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:1.0:1788891101.232135:0:17865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788891101.232841:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e9500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17866:1875787997400576:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788891101.232875:0:17866:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788891101.232907:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17866:1875787997400704:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788891101.232946:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891101.232972:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508630d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788891101.233421:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997400704 00000100:00100000:2.0:1788891101.233428:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997400704 00000100:00100000:2.0:1788891101.233457:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788891101.233465:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17866:x1875787997400704:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788891101.234166:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17866:x1875787997400704:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 698us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891101.234174:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788891101.234208:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17866:1875787997400704:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788891101.234274:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823eaa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17866:1875787997400832:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788891101.234371:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891101.234403:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891101.234466:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997400832 00000100:00100000:3.0:1788891101.234471:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997400832 00000100:00100000:3.0:1788891101.234506:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788891101.234513:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17866:x1875787997400832:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788891101.235155:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17866:x1875787997400832:12345-0@lo:900:lod0001_rec0000.0 Request processed in 640us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891101.235171:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788891101.235411:0:17866:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff924f823eaa00 x1875787997400832/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788891117 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891101.235425:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823eaa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17866:1875787997400832:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788891101.235477:0:17866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823eaa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17866:1875787997400960:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788891101.235505:0:17866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891101.235535:0:17866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788891101.235706:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997400960 00000100:00100000:3.0:1788891101.235711:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997400960 00000100:00100000:3.0:1788891101.235735:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788891101.235741:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17866:x1875787997400960:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788891101.235819:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17866:x1875787997400960:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 78us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891101.235826:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:01000000:3.0:1788891101.236266:0:17840:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:2.0:1788891101.236733:0:17866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823eaa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17866:1875787997400960:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788891101.236785:0:17866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788891101.237849:0:17840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788891101.238926:0:17840:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788891101.238967:0:17840:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788891101.240213:0:17840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788891101.242772:0:17840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788891101.243396:0:17865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788891101.243449:0:17865:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1788891101.246019:0:17866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788891101.246095:0:17866:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788891101.246100:0:17866:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:3.0:1788891101.247003:0:17840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788891101.247073:0:17840:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788891101.247263:0:17840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788891101.248792:0:17840:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:3.0:1788891101.253005:0:17840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788891101.260762:0:17840:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788891101.260801:0:17840:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbbfc41ddf988 00100000:10000000:3.0:1788891101.260810:0:17840:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788891101.261394:0:17840:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788891101.261427:0:17840:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788891101.261445:0:17840:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788891101.261460:0:17840:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788891101.262246:0:17840:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788891101.262488:0:17840:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788891101.757342:0:1022:0:(ldlm_pool.c:1330:ldlm_pools_recalc_task()) Negative interval(0) 00010000:00010000:1.0:1788891101.757796:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891102.076488:0:17150:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2f00 going to sleep for 0 seconds 00000100:00100000:1.0:1788891102.268102:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891092/real 1788891092] req@ffff924f84294e00 x1875787997392896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891102 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891102.268135:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff924f84294e00 x1875787997392896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891102 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891102.268196:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891092/real 1788891092] req@ffff924f83baea00 x1875787997392640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891102 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891102.268210:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff924f83baea00 x1875787997392640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891102 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788891102.268231:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250ba96f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788891102.269066:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788891102.269073:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997392896:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788891102.269081:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f81773800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788891102.269336:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788891102.269341:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788891102.269344:0:36:0:(import.c:65:import_set_state_nolock()) ffff9250ba9aa000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788891102.269353:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9250ba9aa000 using connection 192.168.204.126@tcp/0@lo 00000040:00080000:3.0:1788891102.269377:0:17861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788891102.269388:0:36:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f823ebb80 x1875787997401216/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788891102.269409:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788891102.269412:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788891102.269414:0:36:0:(import.c:65:import_set_state_nolock()) ffff924f81773800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788891102.269419:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 315 00000100:00080000:2.0:1788891102.269425:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788891102.269434:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff924f81773800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788891102.269449:0:36:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f823eb800 x1875787997401344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788891102.269459:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788891102.269462:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788891102.269465:0:36:0:(import.c:65:import_set_state_nolock()) ffff9250ba96f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788891102.269469:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 315 00000100:00080000:2.0:1788891102.269471:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788891102.269476:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9250ba96f000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1788891102.269670:0:36:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f84295880 x1875787997401472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788891102.269765:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997401600:0@lo:400:kworker.0 00000100:00100000:0.0:1788891102.269878:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788891102.269942:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788891102.269949:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997392640:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788891102.269992:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997401216:0@lo:38:kworker.0 00000100:00100000:1.0:1788891102.270118:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788891102.270144:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788891102.270149:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1788891102.270150:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788891102.270159:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997401728:0@lo:400:kworker.0 00000100:00080000:3.0:1788891102.270161:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891102.270164:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788891102.270193:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997401216 00000100:00080000:3.0:1788891102.270199:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891102.270203:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788891102.270205:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891102.270208:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788891102.270220:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997401216 00000100:00100000:3.0:1788891102.270247:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997401856:0@lo:400:kworker.0 00000100:00100000:2.0:1788891102.270303:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788891102.270315:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891102.270320:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1875787997401216:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788891102.270370:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891102.270370:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997401600 00010000:00080000:2.0:1788891102.270371:0:17114:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 324 last 0 00000100:00100000:0.0:1788891102.270378:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997401600 00000100:00100000:3.0:1788891102.270403:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788891102.270411:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997401088:0@lo:400:kworker.0 00000020:00000080:2.0:1788891102.270424:0:17114:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd53fdc 00000100:00100000:0.0:1788891102.270431:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997401856 00000100:00100000:0.0:1788891102.270437:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997401856 00000004:00100000:2.0:1788891102.270443:0:17114:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788891102.270451:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:2.0:1788891102.270453:0:17114:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788891102.270454:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788891102.270470:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997401600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891102.270499:0:17115:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788891102.270507:0:17115:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788891102.270555:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997401600:12345-0@lo:400:kworker.0 Request processed in 87us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891102.270563:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788891102.270586:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788891102.270597:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997401856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891102.270600:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997401088 00000100:00100000:2.0:1788891102.270609:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997401088 00000100:00100000:0.0:1788891102.270645:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997401856:12345-0@lo:400:kworker.0 Request processed in 51us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891102.270653:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788891102.270682:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788891102.270689:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff924f84295500 x1875787997401856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891102.270702:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+16:3629:x1875787997401088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891102.270709:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997401856:0@lo:400:kworker.0 00010000:00080000:0.0:1788891102.270714:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff924f84294000 x1875787997401600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891102.270722:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997401600:0@lo:400:kworker.0 00000100:00100000:2.0:1788891102.270788:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+16:3629:x1875787997401088:12345-0@lo:400:kworker.0 Request processed in 93us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891102.270796:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788891102.270853:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997401088:0@lo:400:kworker.0 00000100:00100000:1.0:1788891102.271127:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997401344:0@lo:8:kworker.0 00000400:00000100:1.0:1788891102.271282:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875787997401344 offset 0 length 520: 4 00000100:00100000:1.0:1788891102.271308:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997401472:0@lo:8:kworker.0 00000400:00000100:1.0:1788891102.271328:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875787997401472 offset 0 length 520: 4 00000100:00100000:3.0:1788891102.271339:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997401728 00000100:00100000:3.0:1788891102.271344:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997401728 00000100:00100000:2.0:1788891102.271467:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788891102.271477:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997401728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891102.273057:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997401728:12345-0@lo:400:kworker.0 Request processed in 1574us (2740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891102.273071:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788891102.273202:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997401728:0@lo:400:kworker.0 00000100:00080000:3.0:1788891102.282957:0:17114:0:(import.c:65:import_set_state_nolock()) ffff9250875b7000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788891102.283666:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788891102.283682:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788891102.283690:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788891102.283693:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250ba9aa000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788891102.283822:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3626:x1875787997401216:12345-0@lo:38:kworker.0 Request processed in 13501us (13695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891102.283836:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788891102.283918:0:3626:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000118d5966): req@ffff924f84294a80 x1875787997395456/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891102.283947:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997401216:0@lo:38:kworker.0 00000100:00100000:3.0:1788891102.284100:0:17150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891102.284139:0:17150:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788891102.284253:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997395456 00000100:00100000:0.0:1788891102.284261:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997395456 00000100:00100000:0.0:1788891102.284313:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788891102.284324:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17150:x1875787997395456:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788891102.284460:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17150:x1875787997395456:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 137us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891102.284468:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788891102.284518:0:17150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17150:1875787997395456:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788891102.284581:0:17150:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788891102.284638:0:17150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17150:1875787997401984:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788891102.284676:0:17150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891102.284714:0:17150:0:(client.c:2715:ptlrpc_set_wait()) set ffff925082d22780 going to sleep for 11 seconds 00000100:00100000:1.0:1788891102.284765:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997402112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788891102.284843:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891102.284940:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997401984 00000100:00100000:0.0:1788891102.284947:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997401984 00000100:00100000:3.0:1788891102.284988:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997402112 00000100:00100000:0.0:1788891102.284993:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788891102.284996:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997402112 00000100:00100000:0.0:1788891102.285004:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17150:x1875787997401984:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788891102.285036:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788891102.285045:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3630:x1875787997402112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788891102.285088:0:17934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788891102.285462:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17150:x1875787997401984:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 157us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891102.285470:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788891102.286084:0:17150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17150:1875787997401984:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788891102.286210:0:17150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e9f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17150:1875787997402240:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788891102.286267:0:17150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891102.286303:0:17150:0:(client.c:2715:ptlrpc_set_wait()) set ffff925082d6acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891102.287344:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997402240 00000100:00100000:0.0:1788891102.287354:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997402240 00000100:00100000:0.0:1788891102.287449:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788891102.287777:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17150:x1875787997402240:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788891102.287952:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17150:x1875787997402240:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 492us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891102.287960:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788891102.288029:0:17150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e9f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17150:1875787997402240:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788891102.288098:0:17150:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788891102.289074:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3630:x1875787997402112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4018us (4220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891102.289090:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788891102.294143:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997402112:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788891102.294632:0:17150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788891102.294815:0:17150:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 10, retries 0 00000004:00080000:2.0:1788891102.294820:0:17150:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788891102.780843:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788891103.100988:0:17106:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788891103.100995:0:17106:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9250c12df800 from 8 10000000:01000000:3.0:1788891103.101000:0:17106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788891103.101047:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd53fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891103.101059:0:17106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd53fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891103.101070:0:17106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd53fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891103.101095:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84296680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997402368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788891103.101160:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891103.101207:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff925088646600 going to sleep for 11 seconds 00000100:00100000:3.0:1788891103.101227:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997402368 00000100:00100000:3.0:1788891103.101234:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997402368 00000100:00100000:3.0:1788891103.101283:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788891103.101292:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+16:17106:x1875787997402368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788891103.101307:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891103.101321:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925080031200/0xa66601b03fd53fea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd53fe3 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891103.101355:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925080031200/0xa66601b03fd53fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd53fe3 expref: 17 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891103.101366:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925080031200/0xa66601b03fd53fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53fe3 expref: 17 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891103.101375:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080031200, rc 0) 00000100:00100000:3.0:1788891103.101416:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17106:x1875787997402368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891103.101422:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788891103.101466:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84296680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997402368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788891103.101481:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd53fe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53fea expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891103.101489:0:17106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd53fe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53fea expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891103.101555:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84296680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997402496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788891103.101587:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891103.101609:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff925088646600 going to sleep for 11 seconds 00000100:00100000:3.0:1788891103.101622:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997402496 00000100:00100000:3.0:1788891103.101626:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997402496 00000100:00100000:3.0:1788891103.101648:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788891103.101654:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17106:x1875787997402496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788891103.101667:0:17103:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788891103.101684:0:17103:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788891103.101687:0:17103:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788891103.101760:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17106:x1875787997402496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891103.101767:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788891103.101795:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84296680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997402496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788891103.101835:0:17106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788891103.101842:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd53fe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53fea expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891103.101849:0:17106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd53fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53fea expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891103.101857:0:17106:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788891103.101859:0:17106:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff924f839d2800 from 8 10000000:01000000:3.0:1788891103.101861:0:17106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788891103.101875:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925080030e00/0xa66601b03fd53ff1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891103.101882:0:17106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925080030e00/0xa66601b03fd53ff1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891103.101889:0:17106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925080030e00/0xa66601b03fd53ff1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891103.101906:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84296680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997402624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788891103.101931:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891103.101945:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff925088646600 going to sleep for 11 seconds 00000100:00100000:3.0:1788891103.101956:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997402624 00000100:00100000:3.0:1788891103.101959:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997402624 00000100:00100000:3.0:1788891103.101980:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788891103.101987:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17106:x1875787997402624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788891103.101994:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891103.102002:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925080031600/0xa66601b03fd53ff8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd53ff1 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891103.102016:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925080031600/0xa66601b03fd53ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd53ff1 expref: 18 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891103.102025:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925080031600/0xa66601b03fd53ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53ff1 expref: 18 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891103.102032:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925080031600, rc 0) 00000100:00100000:3.0:1788891103.102065:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17106:x1875787997402624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891103.102071:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788891103.102103:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84296680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997402624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788891103.102113:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925080030e00/0xa66601b03fd53ff1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53ff8 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891103.102121:0:17106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925080030e00/0xa66601b03fd53ff1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53ff8 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891103.102162:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84296680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997402752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788891103.102187:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891103.102219:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff925088646600 going to sleep for 11 seconds 00000100:00100000:1.0:1788891103.102281:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997402752 00000100:00100000:1.0:1788891103.102286:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997402752 00000100:00100000:1.0:1788891103.102397:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788891103.102407:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17106:x1875787997402752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788891103.102491:0:17102:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788891103.102502:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788891103.102505:0:17102:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788891103.102618:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17106:x1875787997402752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 212us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891103.102626:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788891103.103228:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84296680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997402752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788891103.103270:0:17106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788891103.103278:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925080030e00/0xa66601b03fd53ff1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53ff8 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891103.103286:0:17106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925080030e00/0xa66601b03fd53ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53ff8 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788891103.294815:0:17861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788891103.803991:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788891104.125847:0:17147:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1788891104.348147:0:18110:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788891104.831399:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788891105.097848:0:18162:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788891105.098122:0:18162:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1788891105.729327:0:18212:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788891105.729459:0:18212:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788891105.851815:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891106.428162:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788891106.428313:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997402880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788891106.428429:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891106.428694:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997402880 00000100:00100000:2.0:1788891106.428702:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997402880 00000100:00100000:2.0:1788891106.428763:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788891106.428773:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997402880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788891106.428805:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788891106.428878:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997402880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891106.428885:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788891106.428929:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997402880:0@lo:41:osp-pre-0-1.0 00000020:00000080:2.0:1788891106.485767:0:18260:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe46ef3920 20000000:00000080:2.0:1788891106.485783:0:18260:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff925086ec8c00 uarg=0000000000000000 20000000:01000000:2.0:1788891106.485829:0:18260:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788891106.485836:0:18260:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788891106.485840:0:18260:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788891106.486249:0:18261:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788891106.486513:0:18260:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788891106.493580:0:18260:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788891106.493736:0:18260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff925091a8a800/0xa66601b03fd53fff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891106.493755:0:18260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff924f82311a00/0xa66601b03fd53ea8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53ea1 expref: 17 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891106.493763:0:18260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250813ed600/0xa66601b03fd53fab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53fa4 expref: 17 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891106.493771:0:18260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff925091a8a800/0xa66601b03fd53fff lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891106.493809:0:18260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250813ed600/0xa66601b03fd53fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd53fa4 expref: 17 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891106.493822:0:18260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250813ed600/0xa66601b03fd53fab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd53fa4 expref: 17 pid: 17104 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891106.493835:0:18260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84296d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18260:1875787997403008:0@lo:104: 00000100:00100000:3.0:1788891106.493891:0:18260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788891106.493976:0:18260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff924f82311a00/0xa66601b03fd53ea8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd53ea1 expref: 17 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891106.494000:0:18260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff924f82311a00/0xa66601b03fd53ea8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd53ea1 expref: 17 pid: 17103 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891106.494009:0:18260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84295f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18260:1875787997403136:0@lo:104: 00000100:00100000:3.0:1788891106.494032:0:18260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891106.494114:0:18260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250918683c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891106.494181:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997403008 00000100:00100000:0.0:1788891106.494188:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997403008 00000100:00100000:1.0:1788891106.494236:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997403136 00000100:00100000:1.0:1788891106.494240:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997403136 00000100:00100000:1.0:1788891106.494293:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788891106.494303:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84296680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:189d2e4e-bf9f-4645-ba04-f80564b97077+4:18260:x1875787997403136:12345-0@lo:104: 00010000:00010000:1.0:1788891106.494315:0:17092:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250857dfe00/0xa66601b03fd53ea1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd53ea8 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.494412:0:17092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788891106.494418:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84296680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:189d2e4e-bf9f-4645-ba04-f80564b97077+4:18260:x1875787997403136:12345-0@lo:104: Request processed in 117us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891106.494425:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788891106.494492:0:18260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84295f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18260:1875787997403136:0@lo:104: 00000100:00100000:3.0:1788891106.494718:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788891106.494724:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+3:18260:x1875787997403008:12345-0@lo:104: 00010000:00010000:3.0:1788891106.494732:0:17093:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff924f82310800/0xa66601b03fd53fa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd53fab expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891106.494830:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788891106.494836:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250857dfe00/0xa66601b03fd53ea1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd53ea8 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891106.494844:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857dfe00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:0.0:1788891106.494848:0:17098:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250857dfe00/0xa66601b03fd53ea1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd53ea8 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891106.494863:0:17098:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250857dfe00/0xa66601b03fd53ea1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd53ea8 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788891106.494871:0:17098:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250857dfe00/0xa66601b03fd53ea1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd53ea8 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891106.494877:0:17098:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788891106.494937:0:17098:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250857dfe00/0xa66601b03fd53ea1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53ea8 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.494944:0:17098:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788891106.494969:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250857dfe00/0xa66601b03fd53ea1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53ea8 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.494986:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250857dfe00/0xa66601b03fd53ea1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53ea8 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.494997:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891106.495000:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff924f82310800/0xa66601b03fd53fa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd53fab expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.495005:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310800 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788891106.495008:0:17098:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff924f82310800/0xa66601b03fd53fa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd53fab expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.495015:0:17098:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff924f82310800/0xa66601b03fd53fa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd53fab expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891106.495020:0:17098:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff924f82310800/0xa66601b03fd53fa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd53fab expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891106.495026:0:17098:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788891106.495039:0:17098:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff924f82310800/0xa66601b03fd53fa4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53fab expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.495045:0:17098:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788891106.495060:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff924f82310800/0xa66601b03fd53fa4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53fab expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.495067:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff924f82310800/0xa66601b03fd53fa4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53fab expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.495081:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891106.495088:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891106.495090:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891106.495110:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:189d2e4e-bf9f-4645-ba04-f80564b97077:3628:1875787997403264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891106.495140:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891106.495174:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997403392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891106.495194:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891106.495219:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997403264 00000100:00100000:1.0:1788891106.495222:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997403264 00010000:00010000:1.0:1788891106.495237:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff924f82311a00/0xa66601b03fd53ea8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd53ea1 expref: 18 pid: 17103 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891106.495253:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997403392 00000100:00100000:1.0:1788891106.495255:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997403392 00010000:00010000:1.0:1788891106.495263:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250813ed600/0xa66601b03fd53fab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd53fa4 expref: 19 pid: 17104 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891106.495284:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788891106.495291:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+19:3628:x1875787997403264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891106.495301:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891106.495306:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff924f82311a00/0xa66601b03fd53ea8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd53ea1 expref: 19 pid: 17103 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.495320:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff924f82311a00/0xa66601b03fd53ea8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd53ea1 expref: 19 pid: 17103 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.495332:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924f82311a00/0xa66601b03fd53ea8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd53ea1 expref: 19 pid: 17103 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.495344:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891106.495367:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+18:3628:x1875787997403264:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891106.495379:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788891106.495391:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788891106.495396:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+17:3629:x1875787997403392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891106.495403:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891106.495407:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250813ed600/0xa66601b03fd53fab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd53fa4 expref: 17 pid: 17104 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.495416:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250813ed600/0xa66601b03fd53fab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd53fa4 expref: 17 pid: 17104 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.495428:0:17095:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff925091a8a800/0xa66601b03fd53fff lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.495435:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8a800/0xa66601b03fd53fff lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.495446:0:17095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925091a8a800/0xa66601b03fd53fff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.495453:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925091a8a800/0xa66601b03fd53fff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.495459:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff925091a8a800/0xa66601b03fd53fff lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.495465:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff925091a8a800/0xa66601b03fd53fff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.495470:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891106.495474:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff925091a8a800/0xa66601b03fd53fff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.495487:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff925091a8a800/0xa66601b03fd53fff lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.495496:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff925091a8a800/0xa66601b03fd53fff lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891106.495505:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891106.495554:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+17:3629:x1875787997403392:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891106.495560:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788891106.495588:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997403392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891106.495606:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:189d2e4e-bf9f-4645-ba04-f80564b97077:3628:1875787997403264:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891106.496121:0:18260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813ed600/0xa66601b03fd53fab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd53fa4 expref: 16 pid: 17104 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891106.496134:0:18260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84296d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18260:1875787997403008:0@lo:104: 00010000:00010000:2.0:1788891106.496149:0:18260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff925091a8a800/0xa66601b03fd53fff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891106.496158:0:18260:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff925091a8a800/0xa66601b03fd53fff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891106.496164:0:18260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff925091a8a800/0xa66601b03fd53fff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891106.496171:0:18260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8a800/0xa66601b03fd53fff lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891106.497564:0:17093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788891106.497577:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+3:18260:x1875787997403008:12345-0@lo:104: Request processed in 2849us (3681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891106.497586:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788891106.497669:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891106.875837:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891107.452638:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997403520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788891107.452712:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891107.452852:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997403520 00000100:00100000:2.0:1788891107.452860:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997403520 00000100:00100000:2.0:1788891107.452905:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788891107.452914:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3630:x1875787997403520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788891107.452947:0:17934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00080000:0.0:1788891107.453221:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891107.453225:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788891107.453228:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891107.453231:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788891107.453344:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997403904:0@lo:400:kworker.0 00000100:00100000:1.0:1788891107.453394:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891107.453428:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997403904 00000100:00100000:1.0:1788891107.453432:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997403904 00000100:00100000:1.0:1788891107.453451:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788891107.453457:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997403904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891107.453495:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997403904:12345-0@lo:400:kworker.0 Request processed in 37us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891107.453502:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788891107.453559:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997403904:0@lo:400:kworker.0 00000100:00100000:2.0:1788891107.453814:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3630:x1875787997403520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 901us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891107.453821:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788891107.454103:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997403520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788891107.454216:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997403648:0@lo:400:kworker.0 00000100:00100000:2.0:1788891107.454266:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891107.454297:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788891107.454304:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997403776:0@lo:400:kworker.0 00000100:00100000:2.0:1788891107.454332:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891107.454369:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997403776 00000100:00100000:2.0:1788891107.454374:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997403776 00000100:00100000:2.0:1788891107.454403:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788891107.454410:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997403776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891107.454445:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997403776:12345-0@lo:400:kworker.0 Request processed in 36us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891107.454452:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788891107.454469:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997403648 00000100:00100000:2.0:1788891107.454473:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997403648 00000100:00100000:2.0:1788891107.454502:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788891107.454508:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+16:3627:x1875787997403648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891107.454561:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+16:3627:x1875787997403648:12345-0@lo:400:kworker.0 Request processed in 53us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891107.454568:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1788891107.454602:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff924f83a5ea00 x1875787997403776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891107.454613:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997403776:0@lo:400:kworker.0 00000100:00100000:2.0:1788891107.454621:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997403648:0@lo:400:kworker.0 00000100:00080000:0.0:1788891107.454798:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891107.454803:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788891107.454806:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891107.454809:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788891107.454851:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788891107.454859:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997404032:0@lo:400:kworker.0 00000100:00100000:0.0:1788891107.454920:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891107.455063:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997404032 00000100:00100000:0.0:1788891107.455067:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997404032 00000100:00100000:0.0:1788891107.455092:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788891107.455098:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997404032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891107.455135:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997404032:12345-0@lo:400:kworker.0 Request processed in 37us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891107.455148:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788891107.455174:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff924f83a5c700 x1875787997404032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891107.455184:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997404032:0@lo:400:kworker.0 00000001:00100000:0.0:1788891107.455917:0:17841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788891107.900283:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788891107.965518:0:17106:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788891107.965547:0:17106:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9250c12df800 from 13 10000000:01000000:2.0:1788891107.965552:0:17106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788891107.965611:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82311600/0xa66601b03fd54006 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891107.965624:0:17106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff924f82311600/0xa66601b03fd54006 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891107.965635:0:17106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff924f82311600/0xa66601b03fd54006 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891107.965662:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997404160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788891107.965737:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891107.965780:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff925095be6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788891107.965849:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997404160 00000100:00100000:1.0:1788891107.965857:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997404160 00000100:00100000:1.0:1788891107.965919:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788891107.965929:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+16:17106:x1875787997404160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891107.965942:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891107.965955:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250857df200/0xa66601b03fd5400d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54006 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891107.965977:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250857df200/0xa66601b03fd5400d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54006 expref: 17 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891107.965988:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250857df200/0xa66601b03fd5400d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54006 expref: 17 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891107.965998:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857df200, rc 0) 00000100:00100000:1.0:1788891107.966039:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17106:x1875787997404160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891107.966046:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788891107.966096:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997404160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891107.966110:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff924f82311600/0xa66601b03fd54006 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5400d expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891107.966118:0:17106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff924f82311600/0xa66601b03fd54006 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd5400d expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891107.966179:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83baed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997404288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891107.966204:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891107.966220:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250908c6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788891107.966233:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997404288 00000100:00100000:1.0:1788891107.966237:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997404288 00000100:00100000:1.0:1788891107.966275:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788891107.966280:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17106:x1875787997404288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891107.966387:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17106:x1875787997404288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891107.966394:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788891107.966424:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83baed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997404288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891107.966450:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83baed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997404416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788891107.966488:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891107.966503:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250908c6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788891107.966514:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997404416 00000100:00100000:1.0:1788891107.966517:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997404416 00000100:00100000:1.0:1788891107.966563:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788891107.966569:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17106:x1875787997404416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788891107.966638:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17106:x1875787997404416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891107.966644:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788891107.966678:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83baed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997404416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788891107.976037:0:18365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788891107.976201:0:17106:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788891107.976224:0:17106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788891107.976235:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82311600/0xa66601b03fd54006 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5400d expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891107.976255:0:17106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff924f82311600/0xa66601b03fd54006 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5400d expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891107.976266:0:17106:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788891107.976276:0:17106:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff924f839d2800 from 13 10000000:01000000:1.0:1788891107.976279:0:17106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788891107.976314:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250857df400/0xa66601b03fd54014 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891107.976324:0:17106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250857df400/0xa66601b03fd54014 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891107.976336:0:17106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250857df400/0xa66601b03fd54014 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891107.976363:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83baed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997404544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788891107.976441:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891107.976488:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250908c6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788891107.976559:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997404544 00000100:00100000:2.0:1788891107.976566:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997404544 00000100:00100000:2.0:1788891107.976612:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788891107.976621:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+17:17106:x1875787997404544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891107.976633:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891107.976644:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924f82311a00/0xa66601b03fd5401b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54014 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891107.976666:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924f82311a00/0xa66601b03fd5401b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54014 expref: 18 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891107.976676:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924f82311a00/0xa66601b03fd5401b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54014 expref: 18 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891107.976684:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311a00, rc 0) 00000100:00100000:2.0:1788891107.976728:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17106:x1875787997404544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891107.976736:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788891107.976848:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83baed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997404544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788891107.976861:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250857df400/0xa66601b03fd54014 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5401b expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891107.976869:0:17106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250857df400/0xa66601b03fd54014 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd5401b expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891107.976934:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997404672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788891107.976961:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891107.976984:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff925091868540 going to sleep for 11 seconds 00000100:00100000:3.0:1788891107.976999:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997404672 00000100:00100000:3.0:1788891107.977003:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997404672 00000100:00100000:3.0:1788891107.977028:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788891107.977035:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17106:x1875787997404672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788891107.977141:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17106:x1875787997404672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891107.977148:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788891107.977178:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997404672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788891107.977205:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997404800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788891107.977257:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891107.977273:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff925091868540 going to sleep for 11 seconds 00000100:00100000:3.0:1788891107.977284:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997404800 00000100:00100000:3.0:1788891107.977288:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997404800 00000100:00100000:3.0:1788891107.977310:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788891107.977317:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17106:x1875787997404800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788891107.977395:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+18:17106:x1875787997404800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891107.977401:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788891107.977440:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997404800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788891107.978076:0:18367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788891107.978130:0:17106:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788891107.978145:0:17106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788891107.978152:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250857df400/0xa66601b03fd54014 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5401b expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891107.978161:0:17106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250857df400/0xa66601b03fd54014 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5401b expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891108.923767:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891109.948066:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891110.975606:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788891111.016093:0:18609:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788891111.016097:0:18609:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788891111.016098:0:18609:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788891111.016224:0:18609:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff925086f0e000 00000020:01000004:0.0:1788891111.016238:0:18609:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788891111.016252:0:18609:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788891111.016265:0:18609:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9250baa6b370) 00000020:00000080:0.0:1788891111.016281:0:18609:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788891111.057795:0:18609:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788891111.060703:0:18609:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788891111.061069:0:18609:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788891111.061266:0:18609:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788891111.061493:0:18609:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788891111.061782:0:18609:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788891111.062008:0:18609:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:3.0:1788891111.062746:0:18609:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788891111.062944:0:18609:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788891111.062957:0:18609:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788891111.062967:0:18609:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa66601b03fd54029 00000020:01000004:3.0:1788891111.062973:0:18609:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788891111.062996:0:18609:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788891111.062999:0:18609:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788891111.063005:0:18609:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788891111.063010:0:18609:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788891111.063029:0:18609:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9250bac28000) 00000020:00000080:3.0:1788891111.063042:0:18609:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788891111.064104:0:18609:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788891111.064271:0:18609:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788891111.064277:0:18609:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788891111.066834:0:18609:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788891111.066844:0:18609:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788891111.067142:0:18609:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788891111.067148:0:18609:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788891111.068383:0:18609:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788891111.068608:0:18609:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788891111.068614:0:18609:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788891111.070867:0:18609:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788891111.070879:0:18609:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788891111.094140:0:18609:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788891111.094469:0:18609:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788891111.094476:0:18609:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788891111.095896:0:18609:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788891111.095907:0:18609:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788891111.096794:0:18609:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788891111.096803:0:18609:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788891111.098679:0:18609:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788891111.098887:0:18609:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788891111.098896:0:18609:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788891111.100095:0:18609:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788891111.100105:0:18609:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788891111.127212:0:18609:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788891111.127503:0:18609:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788891111.127510:0:18609:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788891111.128844:0:18609:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788891111.128853:0:18609:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788891111.129241:0:18609:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788891111.129269:0:18609:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788891111.129276:0:18609:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788891111.139330:0:18609:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788891111.139419:0:18609:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.126@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788891111.139424:0:18609:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788891111.139426:0:18609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788891111.139427:0:18609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788891111.139428:0:18609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788891111.139429:0:18609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788891111.139431:0:18609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788891111.139433:0:18609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788891111.139435:0:18609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788891111.139436:0:18609:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788891111.139440:0:18609:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788891111.139442:0:18609:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788891111.139443:0:18609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788891111.139444:0:18609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788891111.139446:0:18609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788891111.139447:0:18609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788891111.139448:0:18609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788891111.139449:0:18609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788891111.139450:0:18609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788891111.139451:0:18609:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788891111.139476:0:18609:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788891111.139494:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997404928:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788891111.139780:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891111.139862:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff925098540300 going to sleep for 11 seconds 00000100:00100000:3.0:1788891111.139904:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997404928 00000100:00100000:3.0:1788891111.139912:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997404928 00000100:00100000:3.0:1788891111.140000:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788891111.140011:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+18:18609:x1875787997404928:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788891111.140054:0:17103:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788891111.140058:0:17103:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788891111.140062:0:17103:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788891111.140443:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+18:18609:x1875787997404928:12345-0@lo:253:mount.lustre.0 Request processed in 432us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891111.140452:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788891111.140556:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997404928:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788891111.140567:0:18609:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788891111.140570:0:18609:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788891111.140571:0:18609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788891111.140573:0:18609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788891111.140574:0:18609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788891111.140575:0:18609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788891111.140576:0:18609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788891111.140578:0:18609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788891111.140587:0:18609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788891111.140588:0:18609:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788891111.140609:0:18609:0:(tgt_mount.c:101:server_register_mount()) register mount ffff925086f0e000 from lustre-OST0000 10000000:01000000:2.0:1788891111.140635:0:18609:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788891111.140638:0:18609:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788891111.140646:0:18609:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff924f81ed19b8 local copy 00010000:00010000:2.0:1788891111.140657:0:18609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd53de4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53deb expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891111.140741:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997405056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891111.140772:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891111.141171:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff925098540d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788891111.141259:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997405056 00000100:00100000:0.0:1788891111.141266:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997405056 00000100:00100000:1.0:1788891111.141312:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788891111.141322:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+18:18609:x1875787997405056:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891111.141406:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+18:18609:x1875787997405056:12345-0@lo:501:mount.lustre.0 Request processed in 86us (634us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788891111.141413:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788891111.141549:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997405056:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788891111.141564:0:18609:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788891111.141580:0:18609:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788891111.141585:0:18609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd53de4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53deb expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.141595:0:18609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd53de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53deb expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891111.141621:0:18609:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff925086f0e000 10000000:01000000:2.0:1788891111.141625:0:18609:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788891111.141629:0:18609:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788891111.141631:0:18609:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788891111.141635:0:18609:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788891111.141638:0:18609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788891111.141658:0:18609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82311800/0xa66601b03fd54037 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.141677:0:18609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff924f82311800/0xa66601b03fd54037 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.141687:0:18609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff924f82311800/0xa66601b03fd54037 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891111.141700:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997405184:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788891111.141724:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891111.141739:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff925098540d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788891111.141783:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997405184 00000100:00100000:1.0:1788891111.141787:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997405184 00000100:00100000:1.0:1788891111.141804:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788891111.141809:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+18:18609:x1875787997405184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891111.141817:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891111.141827:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250857de800/0xa66601b03fd5403e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54037 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891111.141845:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250857de800/0xa66601b03fd5403e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54037 expref: 19 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891111.141860:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250857de800/0xa66601b03fd5403e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54037 expref: 19 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891111.141870:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857de800, rc 0) 00000100:00100000:1.0:1788891111.141901:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+19:18609:x1875787997405184:12345-0@lo:101:mount.lustre.0 Request processed in 91us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891111.141907:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788891111.142019:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997405184:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891111.142029:0:18609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff924f82311800/0xa66601b03fd54037 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5403e expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.142039:0:18609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff924f82311800/0xa66601b03fd54037 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd5403e expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788891111.142957:0:18609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788891111.143614:0:18609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788891111.145446:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788891111.145500:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788891111.145514:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788891111.145543:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788891111.145606:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788891111.145619:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788891111.145639:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788891111.145644:0:18609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788891111.145741:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997405312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891111.145804:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891111.145991:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff925098540900 going to sleep for 11 seconds 00000100:00100000:1.0:1788891111.146068:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997405312 00000100:00100000:1.0:1788891111.146076:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997405312 00000100:00100000:1.0:1788891111.146116:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788891111.146125:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+19:18609:x1875787997405312:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891111.146325:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+19:18609:x1875787997405312:12345-0@lo:501:mount.lustre.0 Request processed in 200us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891111.146334:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788891111.146511:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997405312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891111.146571:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997405440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788891111.146611:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891111.146630:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff925098540900 going to sleep for 11 seconds 00000100:00100000:0.0:1788891111.146677:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997405440 00000100:00100000:0.0:1788891111.146682:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997405440 00000100:00100000:0.0:1788891111.146705:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788891111.146712:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+19:18609:x1875787997405440:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891111.147388:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+19:18609:x1875787997405440:12345-0@lo:503:mount.lustre.0 Request processed in 673us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891111.147396:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788891111.147790:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997405440:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788891111.148260:0:18609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788891111.148332:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997405568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891111.148452:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891111.148489:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250878bd000 going to sleep for 11 seconds 00000100:00100000:0.0:1788891111.148570:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997405568 00000100:00100000:0.0:1788891111.148576:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997405568 00000100:00100000:0.0:1788891111.148617:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788891111.148626:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+19:18609:x1875787997405568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891111.149034:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+19:18609:x1875787997405568:12345-0@lo:502:mount.lustre.0 Request processed in 408us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891111.149041:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788891111.149128:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997405568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788891111.149506:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788891111.149569:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788891111.149587:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788891111.149603:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788891111.149617:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788891111.149633:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788891111.149648:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788891111.149663:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788891111.149677:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788891111.149691:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788891111.149706:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788891111.149737:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788891111.149764:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997405696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891111.149805:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891111.149927:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff925098540d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788891111.149965:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997405696 00000100:00100000:3.0:1788891111.149971:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997405696 00000100:00100000:3.0:1788891111.150041:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788891111.150050:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+19:18609:x1875787997405696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891111.150209:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+19:18609:x1875787997405696:12345-0@lo:502:mount.lustre.0 Request processed in 160us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891111.150216:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788891111.150347:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997405696:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788891111.150461:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788891111.150470:0:18609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788891111.151114:0:18626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788891111.151123:0:18626:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788891111.151130:0:18626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891111.151133:0:18626:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788891111.151140:0:18626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788891111.151230:0:18626:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9250baa6cd28) 00000020:00000080:0.0:1788891111.151256:0:18626:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788891111.151264:0:18626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788891111.151347:0:18626:0:(tgt_mount.c:153:server_get_mount()) get mount ffff925086f0e000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788891111.151516:0:18626:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788891111.151632:0:18626:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa66601b03fd5404c 00010000:00010000:2.0:1788891111.155871:0:18626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788891111.156428:0:18626:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1788891111.157961:0:18626:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788891111.159334:0:18626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788891111.159346:0:18626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891111.159353:0:18626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891111.159369:0:18626:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788891111.159374:0:18626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788891111.159377:0:18626:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1788891111.159379:0:18626:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788891111.159380:0:18626:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788891111.159381:0:18626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788891111.159384:0:18626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891111.159385:0:18626:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788891111.159387:0:18626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891111.159390:0:18626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891111.159391:0:18626:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788891111.159394:0:18626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788891111.159396:0:18626:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788891111.159397:0:18626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891111.159400:0:18626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891111.159401:0:18626:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788891111.159403:0:18626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891111.159406:0:18626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891111.159407:0:18626:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788891111.159409:0:18626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788891111.159433:0:18626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891111.159435:0:18626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891111.159436:0:18626:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788891111.159440:0:18626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788891111.159622:0:18609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788891111.159656:0:18609:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788891111.159683:0:18609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82311800/0xa66601b03fd54037 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5403e expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891111.159696:0:18609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff924f82311800/0xa66601b03fd54037 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5403e expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891111.159703:0:18609:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff925086f0e000 from 1 10000000:01000000:3.0:1788891111.159706:0:18609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788891111.159739:0:18609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54053 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891111.159746:0:18609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54053 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891111.159756:0:18609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54053 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891111.159781:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997405824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788891111.159852:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891111.159888:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509006b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788891111.160051:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997405824 00000100:00100000:1.0:1788891111.160058:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997405824 00000100:00100000:1.0:1788891111.160105:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788891111.160115:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+19:18609:x1875787997405824:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891111.160126:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891111.160138:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250857de400/0xa66601b03fd5405a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54053 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891111.160171:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250857de400/0xa66601b03fd5405a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54053 expref: 20 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891111.160191:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250857de400/0xa66601b03fd5405a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54053 expref: 20 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891111.160212:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857de400, rc 0) 00000100:00100000:1.0:1788891111.160259:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+20:18609:x1875787997405824:12345-0@lo:101:mount.lustre.0 Request processed in 145us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891111.160267:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788891111.160450:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997405824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891111.160463:0:18609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54053 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5405a expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891111.160471:0:18609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54053 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd5405a expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788891111.161449:0:18609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788891111.161709:0:18609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788891111.161908:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788891111.161938:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788891111.161957:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788891111.161961:0:18609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788891111.162016:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997405952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891111.162062:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891111.162097:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509006b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788891111.162265:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997405952 00000100:00100000:2.0:1788891111.162272:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997405952 00000100:00100000:2.0:1788891111.162307:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788891111.162316:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+20:18609:x1875787997405952:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891111.162429:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+20:18609:x1875787997405952:12345-0@lo:501:mount.lustre.0 Request processed in 113us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891111.162436:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788891111.162715:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997405952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891111.162742:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997406080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788891111.162824:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891111.162853:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509006b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788891111.162898:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997406080 00000100:00100000:2.0:1788891111.162903:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997406080 00000100:00100000:2.0:1788891111.162933:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788891111.162940:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+20:18609:x1875787997406080:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788891111.163017:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+20:18609:x1875787997406080:12345-0@lo:503:mount.lustre.0 Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891111.163024:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788891111.163093:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997406080:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788891111.163570:0:18609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788891111.163619:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997406208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891111.163658:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891111.163678:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509006b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788891111.163742:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997406208 00000100:00100000:1.0:1788891111.163746:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997406208 00000100:00100000:1.0:1788891111.163777:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788891111.163784:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+20:18609:x1875787997406208:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891111.163862:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+20:18609:x1875787997406208:12345-0@lo:502:mount.lustre.0 Request processed in 78us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891111.163869:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788891111.164048:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997406208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891111.164353:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788891111.164393:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788891111.164410:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788891111.164425:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788891111.164453:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788891111.164471:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788891111.164485:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788891111.164500:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788891111.164513:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788891111.164548:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788891111.164565:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788891111.164594:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997406336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891111.164638:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891111.164673:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509006b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788891111.168275:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997406336 00000100:00100000:1.0:1788891111.168290:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997406336 00000100:00100000:1.0:1788891111.168364:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788891111.168374:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+20:18609:x1875787997406336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891111.168563:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+20:18609:x1875787997406336:12345-0@lo:502:mount.lustre.0 Request processed in 190us (3924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891111.168571:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788891111.169317:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997406336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788891111.169517:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788891111.169549:0:18609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788891111.170481:0:18630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891111.170490:0:18630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891111.170492:0:18630:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788891111.170499:0:18630:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff925086f0e000 00000020:00000080:0.0:1788891111.170501:0:18630:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788891111.170508:0:18630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891111.170510:0:18630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891111.170511:0:18630:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788891111.170514:0:18630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891111.170516:0:18630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891111.170518:0:18630:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788891111.170585:0:18630:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff925086f0e000 00000020:00000080:0.0:1788891111.170589:0:18630:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788891111.172508:0:18630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891111.172519:0:18630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891111.172537:0:18630:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788891111.172542:0:18630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891111.172545:0:18630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891111.172547:0:18630:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788891111.172551:0:18630:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff925086f0e000 00000020:00000080:0.0:1788891111.172553:0:18630:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788891111.179065:0:18630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891111.179079:0:18630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891111.179081:0:18630:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788891111.179086:0:18630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891111.179091:0:18630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891111.179092:0:18630:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788891111.179098:0:18630:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff925086f0e000 00000020:00000080:0.0:1788891111.179108:0:18630:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788891111.179176:0:18630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891111.179180:0:18630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891111.179195:0:18630:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788891111.179200:0:18630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788891111.179514:0:18609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788891111.179560:0:18609:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788891111.179580:0:18609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54053 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5405a expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891111.179593:0:18609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54053 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5405a expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891111.179646:0:18609:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788891111.179649:0:18609:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff925086f0e000 10000000:01000000:3.0:1788891111.179652:0:18609:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff925086f0e000 10000000:01000000:3.0:1788891111.179656:0:18609:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788891111.179662:0:18609:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff925086f0e000 from 1 10000000:01000000:3.0:1788891111.179665:0:18609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788891111.179700:0:18609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54061 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891111.179709:0:18609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54061 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891111.179720:0:18609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54061 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891111.179744:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997406464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788891111.179816:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891111.179853:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509006b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788891111.179876:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997406464 00000100:00100000:3.0:1788891111.179889:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997406464 00000100:00100000:3.0:1788891111.188874:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788891111.188893:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+20:18609:x1875787997406464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891111.188913:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891111.188931:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8b400/0xa66601b03fd54068 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54061 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891111.189071:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8b400/0xa66601b03fd54068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54061 expref: 21 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891111.189082:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8b400/0xa66601b03fd54068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54061 expref: 21 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891111.189092:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8b400, rc 0) 00000100:00100000:3.0:1788891111.189285:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+21:18609:x1875787997406464:12345-0@lo:101:mount.lustre.0 Request processed in 398us (9468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891111.189293:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788891111.189431:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997406464:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891111.189449:0:18609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54061 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54068 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891111.189459:0:18609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54061 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54068 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788891111.191046:0:18609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788891111.191460:0:18609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788891111.191670:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788891111.191696:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788891111.191711:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788891111.191738:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788891111.191755:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788891111.191768:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788891111.191781:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788891111.191793:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788891111.191806:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788891111.191819:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788891111.191832:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788891111.191847:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788891111.191861:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788891111.191874:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788891111.191888:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788891111.191900:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788891111.191911:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788891111.191922:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788891111.191946:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788891111.191972:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788891111.191988:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788891111.192003:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788891111.192014:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788891111.192025:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788891111.192036:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788891111.192046:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788891111.192056:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788891111.192068:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788891111.192080:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788891111.192091:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788891111.192103:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788891111.192115:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788891111.192128:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788891111.192140:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788891111.192152:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788891111.192258:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788891111.192274:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788891111.192293:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788891111.192298:0:18609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788891111.192446:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997406592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891111.192507:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891111.192653:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788891111.192694:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997406592 00000100:00100000:2.0:1788891111.192701:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997406592 00000100:00100000:2.0:1788891111.192750:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788891111.192759:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+21:18609:x1875787997406592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891111.192905:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+21:18609:x1875787997406592:12345-0@lo:501:mount.lustre.0 Request processed in 146us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891111.192913:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788891111.192981:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997406592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891111.193010:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997406720:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891111.193043:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891111.193054:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788891111.193300:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997406720 00000100:00100000:3.0:1788891111.193364:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997406720 00000100:00100000:3.0:1788891111.193397:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788891111.193405:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+21:18609:x1875787997406720:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788891111.193491:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+21:18609:x1875787997406720:12345-0@lo:503:mount.lustre.0 Request processed in 86us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891111.193497:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788891111.193609:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997406720:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788891111.193886:0:18609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788891111.193930:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997406848:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891111.193957:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891111.194008:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2300 going to sleep for 11 seconds 00000100:00100000:2.0:1788891111.194286:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997406848 00000100:00100000:2.0:1788891111.194291:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997406848 00000100:00100000:2.0:1788891111.194403:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788891111.194411:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+21:18609:x1875787997406848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891111.194511:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+21:18609:x1875787997406848:12345-0@lo:502:mount.lustre.0 Request processed in 99us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891111.194518:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788891111.194808:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997406848:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788891111.194935:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788891111.194952:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788891111.194960:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788891111.194967:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788891111.194974:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788891111.194981:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788891111.194988:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788891111.194994:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788891111.195001:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788891111.195008:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788891111.195014:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788891111.195034:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788891111.195041:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788891111.195048:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788891111.195055:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788891111.195062:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788891111.195068:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788891111.195075:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788891111.195081:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788891111.195088:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788891111.195095:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788891111.195101:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788891111.195108:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788891111.195115:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788891111.195122:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788891111.195135:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788891111.195141:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788891111.195156:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788891111.195164:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788891111.195170:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788891111.195177:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788891111.195201:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788891111.195211:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788891111.195221:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788891111.195234:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788891111.195246:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788891111.195258:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788891111.195270:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788891111.195284:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788891111.195303:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788891111.195318:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788891111.195331:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788891111.195342:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788891111.195368:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788891111.195383:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788891111.195395:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788891111.195407:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788891111.195419:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788891111.195452:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997406976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891111.195495:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891111.195536:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2300 going to sleep for 11 seconds 00000100:00100000:3.0:1788891111.195764:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997406976 00000100:00100000:3.0:1788891111.195769:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997406976 00000100:00100000:3.0:1788891111.195803:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788891111.195810:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+21:18609:x1875787997406976:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891111.195911:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+21:18609:x1875787997406976:12345-0@lo:502:mount.lustre.0 Request processed in 101us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891111.195917:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788891111.195993:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997406976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788891111.196126:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788891111.196146:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788891111.196449:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997407104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891111.196674:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891111.196757:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2300 going to sleep for 11 seconds 00000100:00100000:2.0:1788891111.196789:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997407104 00000100:00100000:2.0:1788891111.196795:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997407104 00000100:00100000:2.0:1788891111.196863:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788891111.196870:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+21:18609:x1875787997407104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891111.196961:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+21:18609:x1875787997407104:12345-0@lo:502:mount.lustre.0 Request processed in 91us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891111.196968:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788891111.197035:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997407104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788891111.197083:0:18609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788891111.197093:0:18609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788891111.197746:0:18635:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788891111.197761:0:18635:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff925090b23370) 00000020:00000080:0.0:1788891111.197782:0:18635:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788891111.197867:0:18635:0:(tgt_mount.c:153:server_get_mount()) get mount ffff925086f0e000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788891111.197872:0:18635:0:(tgt_mount.c:187:server_put_mount()) put mount ffff925086f0e000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788891111.197875:0:18635:0:(obd_mount.c:710:lustre_put_lsi()) put ffff925086f0e000 3 00010000:00080000:0.0:1788891111.197902:0:18635:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f8238b000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.126@tcp at head 00010000:00010000:0.0:1788891111.199863:0:18635:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788891111.200103:0:18635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788891111.200142:0:18635:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788891111.200228:0:18635:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa66601b03fd54076 00000100:00080000:0.0:1788891111.200239:0:18635:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788891111.200245:0:18635:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff924f8238b000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891111.200280:0:18635:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83a5c700 x1875787997407232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788891111.200700:0:18635:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788891111.200834:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1875787997407232:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788891111.200903:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788891111.200998:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891111.201003:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788891111.201005:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891111.201008:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788891111.201030:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891111.201033:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788891111.201036:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891111.201039:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788891111.201109:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997407360:0@lo:400:kworker.0 00000020:01000004:3.0:1788891111.201414:0:18635:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788891111.201429:0:18635:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9250bac2cd28) 00000020:00000080:3.0:1788891111.201448:0:18635:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788891111.201560:0:18635:0:(tgt_mount.c:153:server_get_mount()) get mount ffff925086f0e000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788891111.201565:0:18635:0:(tgt_mount.c:187:server_put_mount()) put mount ffff925086f0e000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788891111.201567:0:18635:0:(obd_mount.c:710:lustre_put_lsi()) put ffff925086f0e000 3 00010000:00080000:3.0:1788891111.201599:0:18635:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f81f1d000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.126@tcp at head 00000100:00100000:0.0:1788891111.202292:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997407232 00000100:00100000:0.0:1788891111.202301:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997407232 00000100:00100000:0.0:1788891111.202333:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788891111.202340:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875787997407232:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788891111.202433:0:17111:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 333 last 0 00000020:00000080:0.0:1788891111.202461:0:17111:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa66601b03fd54084 00000004:00100000:0.0:1788891111.202479:0:17111:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788891111.202504:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788891111.202506:0:17111:0:(import.c:65:import_set_state_nolock()) ffff924f8238e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788891111.202551:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788891111.202559:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997407488:0@lo:400:kworker.0 00000100:00100000:0.0:1788891111.202569:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875787997407232:12345-0@lo:38:llog_process_th.0 Request processed in 229us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891111.202576:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788891111.202584:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891111.202619:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997407744:0@lo:400:kworker.0 00000100:00100000:2.0:1788891111.202641:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788891111.202699:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff924f83a5c700 x1875787997407232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788891121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891111.202715:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788891111.202722:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788891111.202736:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788891111.202740:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788891111.202743:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f8238b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788891111.202749:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1875787997407232:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788891111.202817:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997407488 00000100:00100000:0.0:1788891111.202822:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997407488 00000100:00100000:0.0:1788891111.202847:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788891111.202853:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997407488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891111.202888:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997407488:12345-0@lo:400:kworker.0 Request processed in 35us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891111.202895:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788891111.202919:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997407616:0@lo:400:kworker.0 00000100:00100000:0.0:1788891111.202944:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891111.203125:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997407360 00000100:00100000:2.0:1788891111.203129:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997407360 00000100:00100000:2.0:1788891111.203259:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997407616 00000100:00100000:2.0:1788891111.203263:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997407616 00000100:00100000:0.0:1788891111.203303:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997407744 00000100:00100000:0.0:1788891111.203307:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997407744 00000100:00100000:0.0:1788891111.203329:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788891111.203336:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997407744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891111.203392:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997407744:12345-0@lo:400:kworker.0 Request processed in 57us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891111.203399:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788891111.203499:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788891111.203507:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997407360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891111.203566:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997407360:12345-0@lo:400:kworker.0 Request processed in 60us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891111.203572:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788891111.203586:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788891111.203591:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997407616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891111.203622:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997407616:12345-0@lo:400:kworker.0 Request processed in 31us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891111.203628:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788891111.203696:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997407616:0@lo:400:kworker.0 00010000:00010000:3.0:1788891111.203741:0:18635:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788891111.203950:0:18635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788891111.203990:0:18635:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788891111.204000:0:18635:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xa66601b03fd5408b 00000100:00080000:3.0:1788891111.204006:0:18635:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788891111.204011:0:18635:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff924f81f1d000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1788891111.204035:0:18635:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f84296a00 x1875787997407872/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788891111.204067:0:18635:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788891111.204089:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891111.204093:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788891111.204095:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891111.204098:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788891111.204101:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891111.204104:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788891111.204106:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891111.204108:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788891111.204199:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3626:1875787997407872:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788891111.204233:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891111.204270:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997407872 00000100:00100000:0.0:1788891111.204275:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997407872 00000100:00100000:0.0:1788891111.204315:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788891111.204319:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875787997407872:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788891111.204338:0:17111:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 333 last 0 00000100:00100000:2.0:1788891111.204366:0:17110:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000020:00000080:0.0:1788891111.204373:0:17111:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xa66601b03fd54092 00000100:00100000:2.0:1788891111.204374:0:17110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000004:00100000:0.0:1788891111.204384:0:17111:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:2.0:1788891111.204401:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff924f84297100 x1875787997407488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788891111.204407:0:17111:0:(import.c:65:import_set_state_nolock()) ffff924f82389800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788891111.204411:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997407488:0@lo:400:kworker.0 00000100:00100000:2.0:1788891111.204421:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997407360:0@lo:400:kworker.0 00000100:00100000:0.0:1788891111.204440:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875787997407872:12345-0@lo:38:llog_process_th.0 Request processed in 119us (206us total) trans 0 rc 0/0 00010000:00080000:2.0:1788891111.204447:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff924f84297480 x1875787997407744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891111.204447:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788891111.204456:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997407744:0@lo:400:kworker.0 00010000:00080000:0.0:1788891111.204469:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff924f84296a00 x1875787997407872/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788891121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891111.204476:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788891111.204481:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788891111.204486:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788891111.204490:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788891111.204492:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f81f1d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788891111.204497:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3626:1875787997407872:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788891111.208422:0:18635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788891111.208783:0:18609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788891111.208875:0:18609:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788891111.208930:0:18609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54061 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54068 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891111.208942:0:18609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54061 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54068 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788891111.208999:0:18609:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788891111.209001:0:18609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788891111.209002:0:18609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788891111.209004:0:18609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788891111.209005:0:18609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788891111.209006:0:18609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788891111.209011:0:18609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788891111.209013:0:18609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788891111.209014:0:18609:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788891111.209018:0:18609:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788891111.209021:0:18609:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788891111.209022:0:18609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788891111.209023:0:18609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788891111.209024:0:18609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788891111.209025:0:18609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788891111.209026:0:18609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788891111.209027:0:18609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788891111.209028:0:18609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788891111.209029:0:18609:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788891111.209053:0:18609:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788891111.209071:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997408000:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788891111.209134:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891111.209171:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997408000 00000100:00100000:1.0:1788891111.209175:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509006bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788891111.209178:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997408000 00000100:00100000:2.0:1788891111.209238:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788891111.209253:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+21:18609:x1875787997408000:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788891111.209277:0:17102:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788891111.209290:0:17102:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788891111.212200:0:17102:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788891111.212280:0:17102:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788891111.212280:0:17125:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788891111.212286:0:17125:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788891111.212307:0:17125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9250857df800/0xa66601b03fd54099 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891111.212323:0:17125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925080031200/0xa66601b03fd53fea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53fe3 expref: 21 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891111.212330:0:17125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925080031600/0xa66601b03fd53ff8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd53ff1 expref: 21 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891111.212336:0:17125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9250857df800/0xa66601b03fd54099 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891111.212451:0:17125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925080031600/0xa66601b03fd53ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd53ff1 expref: 21 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891111.212471:0:17125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff925080031600/0xa66601b03fd53ff8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd53ff1 expref: 21 pid: 17104 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891111.212493:0:17125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bafb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17125:1875787997408128:0@lo:104: 00000100:00100000:0.0:1788891111.212638:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788891111.212695:0:17125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925080031200/0xa66601b03fd53fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd53fe3 expref: 21 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891111.212705:0:17125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff925080031200/0xa66601b03fd53fea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd53fe3 expref: 21 pid: 17102 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891111.212711:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+21:18609:x1875787997408000:12345-0@lo:253:mount.lustre.0 Request processed in 3463us (3576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891111.212713:0:17125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17125:1875787997408256:0@lo:104: 00000100:00100000:2.0:1788891111.212722:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788891111.212751:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891111.212771:0:17125:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508630dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788891111.212816:0:17093:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788891111.212833:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997408128 00000100:00100000:3.0:1788891111.212838:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997408128 00000100:00100000:1.0:1788891111.212839:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:18609:1875787997408000:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788891111.212848:0:18609:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788891111.212851:0:18609:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788891111.212853:0:18609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788891111.212854:0:18609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788891111.212855:0:18609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788891111.212856:0:18609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788891111.212857:0:18609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788891111.212859:0:18609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788891111.212861:0:18609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788891111.212862:0:18609:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788891111.212863:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997408256 00000100:00100000:3.0:1788891111.212866:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997408256 00000020:02000000:1.0:1788891111.212874:0:18609:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788891111.212876:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788891111.212882:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+4:17125:x1875787997408128:12345-0@lo:104: 00010000:00010000:3.0:1788891111.212893:0:17093:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925080030e00/0xa66601b03fd53ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd53ff8 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891111.212946:0:17093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788891111.212951:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+4:17125:x1875787997408128:12345-0@lo:104: Request processed in 70us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891111.212957:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788891111.212974:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788891111.212980:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250873ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+3:17125:x1875787997408256:12345-0@lo:104: 00010000:00010000:3.0:1788891111.212987:0:17093:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd53fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd53fea expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891111.213015:0:17093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788891111.213020:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250873ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+3:17125:x1875787997408256:12345-0@lo:104: Request processed in 41us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891111.213026:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788891111.213101:0:17125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bafb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17125:1875787997408128:0@lo:104: 00000100:00100000:0.0:1788891111.213109:0:17125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17125:1875787997408256:0@lo:104: 00010000:00010000:0.0:1788891111.213124:0:17125:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9250857df800/0xa66601b03fd54099 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213200:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788891111.213205:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925080030e00/0xa66601b03fd53ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd53ff8 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213213:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030e00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891111.213216:0:17097:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925080030e00/0xa66601b03fd53ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd53ff8 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213225:0:17097:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925080030e00/0xa66601b03fd53ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd53ff8 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891111.213232:0:17097:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925080030e00/0xa66601b03fd53ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd53ff8 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891111.213237:0:17097:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788891111.213269:0:17097:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925080030e00/0xa66601b03fd53ff1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53ff8 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213276:0:17097:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891111.213309:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925080030e00/0xa66601b03fd53ff1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53ff8 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213315:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925080030e00/0xa66601b03fd53ff1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53ff8 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213326:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891111.213330:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd53fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd53fea expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213335:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925080030200 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891111.213338:0:17097:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd53fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd53fea expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213344:0:17097:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd53fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd53fea expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891111.213350:0:17097:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd53fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd53fea expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891111.213354:0:17097:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788891111.213376:0:17097:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd53fe3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53fea expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213382:0:17097:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891111.213388:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd53fe3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53fea expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213395:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925080030200/0xa66601b03fd53fe3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd53fea expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213417:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891111.213418:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891111.213420:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891111.213426:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891111.213436:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:189d2e4e-bf9f-4645-ba04-f80564b97077:3628:1875787997408512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891111.213462:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891111.213484:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788891111.213490:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:189d2e4e-bf9f-4645-ba04-f80564b97077:3628:1875787997408384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891111.213510:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891111.213688:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997408512 00000100:00100000:2.0:1788891111.213692:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997408512 00010000:00010000:2.0:1788891111.213708:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925080031200/0xa66601b03fd53fea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd53fe3 expref: 21 pid: 17102 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891111.213724:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997408384 00000100:00100000:2.0:1788891111.213726:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997408384 00010000:00010000:2.0:1788891111.213736:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925080031600/0xa66601b03fd53ff8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd53ff1 expref: 22 pid: 17104 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891111.213747:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788891111.213754:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+22:3628:x1875787997408512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891111.213765:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891111.213771:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925080031200/0xa66601b03fd53fea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd53fe3 expref: 22 pid: 17102 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213780:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925080031200/0xa66601b03fd53fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd53fe3 expref: 22 pid: 17102 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213802:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925080031200/0xa66601b03fd53fea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd53fe3 expref: 22 pid: 17102 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213815:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891111.213844:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+21:3628:x1875787997408512:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891111.213849:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788891111.213862:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788891111.213867:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b660c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+20:3628:x1875787997408384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891111.213874:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891111.213878:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925080031600/0xa66601b03fd53ff8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd53ff1 expref: 20 pid: 17104 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213887:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925080031600/0xa66601b03fd53ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd53ff1 expref: 20 pid: 17104 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213896:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925080031600/0xa66601b03fd53ff8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd53ff1 expref: 20 pid: 17104 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213906:0:17095:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9250857df800/0xa66601b03fd54099 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213914:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250857df800/0xa66601b03fd54099 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788891111.213926:0:17095:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010550113s 00010000:00010000:2.0:1788891111.213930:0:17095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250857df800/0xa66601b03fd54099 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213947:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250857df800/0xa66601b03fd54099 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213954:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9250857df800/0xa66601b03fd54099 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213960:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9250857df800/0xa66601b03fd54099 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213965:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891111.213969:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9250857df800/0xa66601b03fd54099 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213976:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9250857df800/0xa66601b03fd54099 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.213991:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9250857df800/0xa66601b03fd54099 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891111.214001:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788891111.214002:0:17125:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9250857df800/0xa66601b03fd54099 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891111.214009:0:17125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9250857df800/0xa66601b03fd54099 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891111.214016:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250857df800/0xa66601b03fd54099 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891111.214022:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b660c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+19:3628:x1875787997408384:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891111.214028:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788891111.214092:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:189d2e4e-bf9f-4645-ba04-f80564b97077:3628:1875787997408384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891111.214101:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:189d2e4e-bf9f-4645-ba04-f80564b97077:3628:1875787997408512:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1788891111.215288:0:18609:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788891111.217482:0:18609:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788891111.217491:0:18609:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788891111.217767:0:18609:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788891111.217814:0:18609:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788891111.217834:0:18609:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788891111.217851:0:18609:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788891111.218697:0:18609:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788891111.218908:0:18609:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788891111.548501:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f823ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997408640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788891111.549093:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891111.549636:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997408640 00000100:00100000:2.0:1788891111.549646:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997408640 00000100:00100000:2.0:1788891111.549991:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788891111.550005:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997408640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788891111.550042:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788891111.550118:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997408640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891111.550127:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788891111.551361:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997408640:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1788891111.834347:0:18690:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788891111.834773:0:18690:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788891111.996639:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891112.253133:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891101/real 1788891101] req@ffff924f83a5dc00 x1875787997398016/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891111 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891112.253177:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff924f83a5dc00 x1875787997398016/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891111 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891112.253201:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891101/real 1788891101] req@ffff924f823e8a80 x1875787997397888/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891111 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891112.253217:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff924f823e8a80 x1875787997397888/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891111 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788891112.253238:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925086eaf800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788891112.253264:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788891112.253268:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997398016:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788891112.253275:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f82eae800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788891112.253279:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788891112.253282:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997397888:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788891112.253757:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1788891112.253798:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891112.253803:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788891112.253805:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891112.253809:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788891112.253871:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788891112.253890:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997409152:0@lo:400:kworker.0 00000100:00100000:2.0:1788891112.253981:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891112.254022:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997409024:0@lo:400:kworker.0 00000100:00100000:2.0:1788891112.254047:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891112.254070:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788891112.254075:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997408896:0@lo:400:kworker.0 00000100:00100000:2.0:1788891112.254098:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891112.254135:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997409152 00000100:00100000:2.0:1788891112.254142:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997409152 00000100:00100000:2.0:1788891112.254201:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997408896 00000100:00100000:2.0:1788891112.254204:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997408896 00000100:00100000:2.0:1788891112.254222:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788891112.254231:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997409152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891112.254285:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997409152:12345-0@lo:400:kworker.0 Request processed in 55us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891112.254292:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788891112.254312:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788891112.254318:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997408896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891112.254347:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997408896:12345-0@lo:400:kworker.0 Request processed in 29us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891112.254353:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788891112.254371:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997409024 00000100:00100000:2.0:1788891112.254374:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997409024 00000100:00100000:2.0:1788891112.254401:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788891112.254407:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997409024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891112.254437:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997409024:12345-0@lo:400:kworker.0 Request processed in 31us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891112.254455:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788891112.254499:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997408896:0@lo:400:kworker.0 00010000:00080000:2.0:1788891112.254511:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83bae680 x1875787997409024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891112.254538:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997409024:0@lo:400:kworker.0 00000100:00100000:2.0:1788891112.254566:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997409152:0@lo:400:kworker.0 00000100:00100000:3.0:1788891112.254881:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997408768:0@lo:400:kworker.0 00000100:00100000:3.0:1788891112.254980:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891112.255063:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997408768 00000100:00100000:2.0:1788891112.255068:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997408768 00000100:00100000:2.0:1788891112.255137:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788891112.255145:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+19:3629:x1875787997408768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891112.255201:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+19:3629:x1875787997408768:12345-0@lo:400:kworker.0 Request processed in 58us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891112.255208:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788891112.255267:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997408768:0@lo:400:kworker.0 00000100:00080000:1.0:1788891112.255338:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891112.255343:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788891112.255346:0:467:0:(import.c:65:import_set_state_nolock()) ffff924f82eae800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788891112.255351:0:467:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 323 00000100:00080000:1.0:1788891112.255355:0:467:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788891112.255360:0:467:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff924f82eae800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891112.255386:0:467:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83bad880 x1875787997409280/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788891112.255403:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891112.255406:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788891112.255408:0:467:0:(import.c:65:import_set_state_nolock()) ffff925086eaf800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788891112.255411:0:467:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 323 00000100:00080000:1.0:1788891112.255414:0:467:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788891112.255417:0:467:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff925086eaf800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891112.255427:0:467:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83bac700 x1875787997409408/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788891112.255516:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997409664:0@lo:400:kworker.0 00000100:00100000:3.0:1788891112.255573:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891112.255593:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788891112.255598:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997409792:0@lo:400:kworker.0 00000100:00100000:3.0:1788891112.255618:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891112.255637:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788891112.255643:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997409536:0@lo:400:kworker.0 00000100:00100000:3.0:1788891112.255665:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891112.255689:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997409664 00000100:00100000:3.0:1788891112.255692:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997409664 00000100:00100000:3.0:1788891112.255725:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997409792 00000100:00100000:3.0:1788891112.255728:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997409792 00000100:00100000:3.0:1788891112.255752:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997409536 00000100:00100000:3.0:1788891112.255756:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997409536 00000100:00100000:3.0:1788891112.255770:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788891112.255776:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997409664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891112.255811:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997409664:12345-0@lo:400:kworker.0 Request processed in 36us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891112.255818:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788891112.255832:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788891112.255838:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997409792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891112.255864:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997409792:12345-0@lo:400:kworker.0 Request processed in 27us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891112.255870:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788891112.255881:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788891112.255887:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997409536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891112.255994:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997409536:12345-0@lo:400:kworker.0 Request processed in 106us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891112.256000:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788891112.256029:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83bac000 x1875787997409792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891112.256040:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997409792:0@lo:400:kworker.0 00010000:00080000:3.0:1788891112.256048:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83baed80 x1875787997409664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891112.256055:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997409664:0@lo:400:kworker.0 00010000:00080000:3.0:1788891112.256075:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83bafb80 x1875787997409536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891112.256098:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997409536:0@lo:400:kworker.0 00000100:00080000:2.0:1788891112.256316:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788891112.256321:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788891112.256339:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997409280:0@lo:8:kworker.0 00000100:00100000:2.0:1788891112.256421:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891112.256488:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997409408:0@lo:8:kworker.0 00000100:00100000:2.0:1788891112.256513:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891112.257003:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997409280 00000100:00100000:3.0:1788891112.257010:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997409280 00000100:00100000:3.0:1788891112.257040:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997409408 00000100:00100000:3.0:1788891112.257043:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997409408 00000100:00100000:3.0:1788891112.257054:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788891112.257060:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3626:x1875787997409280:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788891112.257088:0:18613:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 334 last 0 00000020:00000080:3.0:1788891112.257117:0:18613:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd540a0 00002000:00100000:3.0:1788891112.257129:0:18613:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff924f81f19000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788891112.257133:0:18613:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788891112.257136:0:18613:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788891112.257315:0:18613:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788891112.257338:0:18613:0:(import.c:65:import_set_state_nolock()) ffff924f81f18000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788891112.257400:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3626:x1875787997409280:12345-0@lo:8:kworker.0 Request processed in 338us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891112.257408:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788891112.257421:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788891112.257425:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3626:x1875787997409408:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788891112.257437:0:18613:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1788891112.258047:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83bad880 x1875787997409280/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788891127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891112.258057:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788891112.258064:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788891112.258072:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788891112.258077:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788891112.258080:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f82eae800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788891112.258094:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788891112.258099:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997409280:0@lo:8:kworker.0 00000004:00080000:2.0:1788891112.259671:0:17849:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788891112.259767:0:17849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 334504243674ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788891112.259775:0:17849:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1788891112.259852:0:17850:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788891112.259877:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83167480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17850:1875787997410048:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788891112.260248:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891112.260282:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8215b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788891112.260297:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788891112.260308:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997409920:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788891112.260332:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891112.260398:0:18616:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788891112.260405:0:18616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788891112.260828:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997410048 00000100:00100000:0.0:1788891112.260839:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997410048 00000100:00080000:1.0:1788891112.261068:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891112.261580:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997409920 00000100:00100000:0.0:1788891112.261585:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997409920 00000100:00100000:0.0:1788891112.261632:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788891112.261642:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3630:x1875787997409920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788891112.261665:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788891112.261729:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3630:x1875787997409920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891112.261736:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:1.0:1788891112.262030:0:17841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:2.0:1788891112.262272:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83166a00 x1875787997409920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891112.262294:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997409920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788891112.265135:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788891112.265155:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17850:x1875787997410048:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:1.0:1788891112.270075:0:18720:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788891112.270085:0:18720:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788891112.270240:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17850:x1875787997410048:12345-0@lo:7:osp-pre-0-1.0 Request processed in 5089us (9988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891112.270254:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788891112.270326:0:17850:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83167480 x1875787997410048/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788891128 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891112.270370:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83167480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17850:1875787997410048:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788891112.270385:0:17850:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788891112.270424:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83167480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17850:1875787997410176:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788891112.270459:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891112.270625:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8215b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788891112.270702:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997410176 00000100:00100000:0.0:1788891112.270709:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997410176 00000100:00100000:0.0:1788891112.270757:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788891112.270767:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17850:x1875787997410176:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788891112.270801:0:18615:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788891112.270847:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17850:x1875787997410176:12345-0@lo:5:osp-pre-0-1.0 Request processed in 82us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891112.270862:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788891112.270868:0:17850:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83167480 x1875787997410176/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788891128 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891112.270878:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83167480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17850:1875787997410176:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788891112.270886:0:17850:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788891112.270979:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bad880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17850:1875787997410304:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788891112.271008:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891112.271033:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847780 going to sleep for 11 seconds 00000100:00100000:2.0:1788891112.271082:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997410304 00000100:00100000:2.0:1788891112.271086:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997410304 00000100:00100000:2.0:1788891112.271117:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788891112.271125:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17850:x1875787997410304:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788891112.271154:0:18720:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788891112.275373:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3626:x1875787997409408:12345-0@lo:8:kworker.0 Request processed in 17938us (18852us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788891112.275387:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788891112.278190:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925086eaf800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788891112.278201:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788891112.278207:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997409408:0@lo:8:kworker.0 00000001:00080000:2.0:1788891112.295314:0:18610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788891112.295330:0:18610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788891112.296337:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17850:x1875787997410304:12345-0@lo:5:osp-pre-0-1.0 Request processed in 25206us (25321us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788891112.296349:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788891112.296460:0:17850:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83bad880 x1875787997410304/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788891128 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891112.296473:0:17850:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788891112.296495:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bad880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17850:1875787997410304:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788891112.296510:0:17850:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1788891112.296597:0:17850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83164e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17850:1875787997410432:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788891112.296635:0:17850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891112.296720:0:17850:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8215bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891112.296872:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997410432 00000100:00100000:3.0:1788891112.296879:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997410432 00000100:00100000:3.0:1788891112.297001:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788891112.297010:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17850:x1875787997410432:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788891112.297070:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17850:x1875787997410432:12345-0@lo:900:osp-pre-0-1.0 Request processed in 61us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891112.297078:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788891112.297202:0:17850:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83164e00 x1875787997410432/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788891128 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891112.297221:0:17850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83164e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17850:1875787997410432:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788891112.571833:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997410560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788891112.571907:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891112.571979:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997410560 00000100:00100000:1.0:1788891112.571987:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997410560 00000100:00100000:1.0:1788891112.572037:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788891112.572048:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997410560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788891112.572082:0:17934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788891112.574219:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997410560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788891112.574285:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997410560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2237us (2375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891112.574296:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 10000000:01000000:0.0:1788891112.765842:0:17106:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788891112.765850:0:17106:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9250c12df800 from 9 10000000:01000000:0.0:1788891112.765855:0:17106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788891112.765895:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ed200/0xa66601b03fd540a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891112.765907:0:17106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250813ed200/0xa66601b03fd540a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891112.765918:0:17106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250813ed200/0xa66601b03fd540a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891112.765942:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997410688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788891112.766017:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891112.766071:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891112.766188:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997410688 00000100:00100000:1.0:1788891112.766196:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997410688 00000100:00100000:1.0:1788891112.766353:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788891112.766363:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+19:17106:x1875787997410688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891112.766381:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891112.766394:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250857dea00/0xa66601b03fd540ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd540a7 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891112.766416:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250857dea00/0xa66601b03fd540ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd540a7 expref: 20 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891112.766425:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250857dea00/0xa66601b03fd540ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd540a7 expref: 20 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891112.766433:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857dea00, rc 0) 00000100:00100000:1.0:1788891112.766481:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+20:17106:x1875787997410688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891112.766496:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788891112.766573:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997410688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788891112.766587:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250813ed200/0xa66601b03fd540a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd540ae expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891112.766601:0:17106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250813ed200/0xa66601b03fd540a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd540ae expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891112.766649:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997410816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788891112.766680:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891112.766930:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997410816 00000100:00100000:0.0:1788891112.766935:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997410816 00000100:00100000:3.0:1788891112.766946:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6540 going to sleep for 11 seconds 00000100:00100000:0.0:1788891112.766956:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788891112.766963:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+20:17106:x1875787997410816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788891112.766975:0:17104:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788891112.767284:0:17104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788891112.767288:0:17104:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788891112.767368:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+20:17106:x1875787997410816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 404us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891112.767375:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788891112.767414:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997410816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788891112.767474:0:17106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788891112.767485:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ed200/0xa66601b03fd540a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd540ae expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891112.767494:0:17106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250813ed200/0xa66601b03fd540a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd540ae expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891112.767502:0:17106:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788891112.767504:0:17106:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff924f839d2800 from 9 10000000:01000000:0.0:1788891112.767507:0:17106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788891112.767548:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd540b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891112.767556:0:17106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd540b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891112.767565:0:17106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd540b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891112.767580:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997410944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788891112.767608:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891112.767621:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250902d2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788891112.769438:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997410944 00000100:00100000:2.0:1788891112.769452:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997410944 00000100:00100000:2.0:1788891112.769500:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788891112.769510:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+20:17106:x1875787997410944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891112.769540:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891112.769558:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924f82310c00/0xa66601b03fd540bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd540b5 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891112.769583:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924f82310c00/0xa66601b03fd540bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd540b5 expref: 21 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891112.769594:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924f82310c00/0xa66601b03fd540bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd540b5 expref: 21 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891112.769604:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310c00, rc 0) 00000100:00100000:2.0:1788891112.769670:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+21:17106:x1875787997410944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891112.769677:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788891112.769735:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997410944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891112.769750:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd540b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd540bc expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891112.769767:0:17106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd540b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd540bc expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891112.769828:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83164a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997411072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788891112.769862:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891112.769896:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8215b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788891112.770196:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997411072 00000100:00100000:1.0:1788891112.770202:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997411072 00000100:00100000:1.0:1788891112.770231:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788891112.770237:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925093b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+21:17106:x1875787997411072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788891112.770251:0:17102:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788891112.770266:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788891112.770269:0:17102:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788891112.770353:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925093b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+21:17106:x1875787997411072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891112.770360:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788891112.770372:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83164a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997411072:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788891112.770429:0:17106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788891112.770436:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd540b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd540bc expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891112.770445:0:17106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd540b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd540bc expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891113.019734:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788891113.532778:0:17861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788891114.044700:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788891114.366368:0:17147:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788891115.070868:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788891115.325854:0:18981:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1788891116.018247:0:19034:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788891116.018447:0:19034:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788891116.092234:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788891116.621914:0:19084:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788891116.622162:0:19084:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788891116.667715:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788891116.667738:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997411200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788891116.667844:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891116.667948:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997411200 00000100:00100000:2.0:1788891116.667955:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997411200 00000100:00100000:2.0:1788891116.668008:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788891116.668020:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997411200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788891116.668052:0:17114:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788891116.668758:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997411200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 738us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891116.668767:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788891116.668872:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997411200:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788891117.116234:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891117.373974:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891102/real 1788891102] req@ffff924f823eb800 x1875787997401344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891117 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891117.374213:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff924f823eb800 x1875787997401344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891117 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891117.374329:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891102/real 1788891102] req@ffff924f84295880 x1875787997401472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891117 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891117.374344:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff924f84295880 x1875787997401472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891117 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788891117.374363:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f81773800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788891117.374417:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788891117.374434:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f823eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997401344:0@lo:8:kworker.0 00000100:00080000:0.0:1788891117.374440:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250ba96f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788891117.374540:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891117.374545:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788891117.374547:0:467:0:(import.c:65:import_set_state_nolock()) ffff924f81773800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788891117.374552:0:467:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 324 00000100:00080000:3.0:1788891117.374557:0:467:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788891117.374563:0:467:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff924f81773800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1788891117.374582:0:467:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f84297800 x1875787997411584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788891117.374591:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891117.374594:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788891117.374595:0:467:0:(import.c:65:import_set_state_nolock()) ffff9250ba96f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788891117.374598:0:467:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 324 00000100:00080000:3.0:1788891117.374600:0:467:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788891117.374603:0:467:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9250ba96f000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1788891117.374615:0:467:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f84294000 x1875787997411712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788891117.374636:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891117.374639:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788891117.374641:0:467:0:(import.c:65:import_set_state_nolock()) ffff925086eaf800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788891117.374644:0:467:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 334 00000100:00080000:3.0:1788891117.374646:0:467:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788891117.374649:0:467:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff925086eaf800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1788891117.374660:0:467:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f84297480 x1875787997412224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788891117.374720:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997411968:0@lo:400:kworker.0 00000100:00080000:0.0:1788891117.374724:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788891117.374727:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997401472:0@lo:8:kworker.0 00000100:00100000:0.0:1788891117.374748:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997411584:0@lo:8:kworker.0 00000100:00100000:3.0:1788891117.374779:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891117.374825:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891117.374826:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997412608:0@lo:400:kworker.0 00000100:00100000:0.0:1788891117.374849:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997411712:0@lo:8:kworker.0 00000100:00100000:3.0:1788891117.374850:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891117.374870:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788891117.374872:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891117.374875:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997411328:0@lo:400:kworker.0 00000100:00100000:0.0:1788891117.374884:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997412224:0@lo:8:kworker.0 00000100:00100000:3.0:1788891117.374898:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891117.374914:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997412096:0@lo:400:kworker.0 00000100:00100000:0.0:1788891117.374919:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891117.374936:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891117.374961:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997411968 00000100:00100000:3.0:1788891117.374968:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997411968 00000100:00100000:2.0:1788891117.375081:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997411456:0@lo:400:kworker.0 00000100:00100000:2.0:1788891117.375117:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891117.375150:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997412352:0@lo:400:kworker.0 00000100:00100000:2.0:1788891117.375171:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891117.375178:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997411584 00000100:00100000:1.0:1788891117.375182:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997411584 00000100:00100000:2.0:1788891117.375189:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788891117.375194:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997411840:0@lo:400:kworker.0 00000100:00100000:1.0:1788891117.375203:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997411712 00000100:00100000:1.0:1788891117.375205:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997411712 00000100:00100000:2.0:1788891117.375212:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891117.375213:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997412224 00000100:00100000:1.0:1788891117.375215:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997412224 00000100:00100000:2.0:1788891117.375227:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997412480:0@lo:400:kworker.0 00000100:00100000:2.0:1788891117.375251:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891117.375278:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997412608 00000100:00100000:2.0:1788891117.375282:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997412608 00000100:00100000:1.0:1788891117.375294:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997412096 00000100:00100000:1.0:1788891117.375297:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997412096 00000100:00100000:2.0:1788891117.375313:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997412352 00000100:00100000:2.0:1788891117.375315:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997412352 00000100:00100000:1.0:1788891117.375318:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788891117.375325:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997411840 00000100:00100000:1.0:1788891117.375325:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997412096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891117.375327:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997411840 00000100:00100000:2.0:1788891117.375335:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997412480 00000100:00100000:2.0:1788891117.375337:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997412480 00000100:00100000:2.0:1788891117.375348:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788891117.375353:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997412608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891117.375392:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997412096:12345-0@lo:400:kworker.0 Request processed in 65us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891117.375398:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788891117.375414:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788891117.375418:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3626:x1875787997411584:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788891117.375442:0:18720:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:1.0:1788891117.375469:0:18720:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd540c3 00002000:00100000:1.0:1788891117.375483:0:18720:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff924f832d8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788891117.375488:0:18720:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788891117.375490:0:18720:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788891117.375498:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997412608:12345-0@lo:400:kworker.0 Request processed in 144us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891117.375504:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788891117.375518:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788891117.375544:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997412352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891117.375576:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997412352:12345-0@lo:400:kworker.0 Request processed in 53us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891117.375581:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00002000:00080000:1.0:1788891117.375583:0:18720:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1788891117.375592:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788891117.375604:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997411840:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788891117.375605:0:18720:0:(import.c:65:import_set_state_nolock()) ffff925091ac7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788891117.375632:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997411840:12345-0@lo:400:kworker.0 Request processed in 28us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891117.375632:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3626:x1875787997411584:12345-0@lo:8:kworker.0 Request processed in 212us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891117.375638:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788891117.375638:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788891117.375650:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788891117.375650:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788891117.375654:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3626:x1875787997411712:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788891117.375656:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997412480:12345-0@lo:400:kworker.0 00010000:00020000:1.0:1788891117.375665:0:18720:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788891117.375678:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997412480:12345-0@lo:400:kworker.0 Request processed in 23us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891117.375683:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788891117.375713:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f84295c00 x1875787997411840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891117.375725:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997411840:0@lo:400:kworker.0 00010000:00080000:2.0:1788891117.375735:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83a73b80 x1875787997412480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891117.375744:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997412480:0@lo:400:kworker.0 00010000:00080000:2.0:1788891117.375752:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83a71c00 x1875787997412352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891117.375758:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997412352:0@lo:400:kworker.0 00000100:00100000:0.0:1788891117.376095:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788891117.376101:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1875787997412224:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788891117.376112:0:18616:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788891117.376143:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1875787997412224:12345-0@lo:8:kworker.0 Request processed in 40us (1222us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788891117.376148:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788891117.376192:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f84297800 x1875787997411584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788891137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891117.376200:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788891117.376206:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788891117.376213:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788891117.376218:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788891117.376394:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f81773800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788891117.376409:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788891117.376421:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997411584:0@lo:8:kworker.0 00000100:00080000:0.0:1788891117.376435:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925086eaf800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788891117.376439:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788891117.376442:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997412224:0@lo:8:kworker.0 00000100:00080000:0.0:1788891117.376496:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788891117.376500:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788891117.376503:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788891117.376546:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997411456 00000100:00100000:0.0:1788891117.376552:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997411456 00000100:00100000:0.0:1788891117.376583:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788891117.376590:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997411456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891117.376632:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997411456:12345-0@lo:400:kworker.0 Request processed in 42us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891117.376639:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788891117.376662:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997411328 00000100:00100000:0.0:1788891117.376666:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997411328 00000100:00100000:0.0:1788891117.376689:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788891117.376695:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+21:3627:x1875787997411328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891117.376723:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+21:3627:x1875787997411328:12345-0@lo:400:kworker.0 Request processed in 28us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891117.376729:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788891117.376766:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997411456:0@lo:400:kworker.0 00000004:00080000:0.0:1788891117.376801:0:17133:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788891117.376865:0:17133:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339621341850ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788891117.376871:0:17133:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788891117.376917:0:17134:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:0.0:1788891117.376934:0:17134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17134:1875787997412864:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788891117.376966:0:17134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891117.377328:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788891117.377336:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997411968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891117.377375:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997411968:12345-0@lo:400:kworker.0 Request processed in 40us (2596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891117.377381:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788891117.377416:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997411328:0@lo:400:kworker.0 00010000:00080000:3.0:1788891117.377430:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f84295f80 x1875787997412096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788891133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891117.377439:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997412096:0@lo:400:kworker.0 00000100:00100000:3.0:1788891117.377448:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997411968:0@lo:400:kworker.0 00010000:00080000:3.0:1788891117.377457:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83a70e00 x1875787997412608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891117.377478:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997412608:0@lo:400:kworker.0 00000100:00100000:3.0:1788891117.377496:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788891117.377501:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997412736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788891117.377597:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891117.377633:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997412736 00000100:00100000:3.0:1788891117.377637:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997412736 00000100:00100000:3.0:1788891117.377672:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788891117.377680:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1875787997412736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788891117.377700:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788891117.377737:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1875787997412736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891117.377744:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788891117.377761:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788891117.377776:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83a5df80 x1875787997412736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891133 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891117.377790:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997412736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788891117.380348:0:17134:0:(client.c:2715:ptlrpc_set_wait()) set ffff925082d6a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788891117.380377:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997412864 00000100:00100000:0.0:1788891117.380384:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997412864 00000100:00100000:0.0:1788891117.380429:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788891117.380438:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17134:x1875787997412864:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788891117.384262:0:17089:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788891117.384370:0:18616:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788891117.384379:0:18616:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788891117.384385:0:18616:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00080000:1.0:1788891117.399159:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250ba96f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788891117.399166:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788891117.399170:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997411712:0@lo:8:kworker.0 00000100:00100000:2.0:1788891117.399270:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3626:x1875787997411712:12345-0@lo:8:kworker.0 Request processed in 23309us (24091us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788891117.399284:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00002000:00010000:0.0:1788891117.413294:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.413307:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd540ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.413324:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.413329:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.413335:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd540ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.413351:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd540ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.413361:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd540ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.413368:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd540ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.413410:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891117.413488:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891117.413496:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd540ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.413517:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ec600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891117.413599:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd540ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.413611:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd540ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.413630:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd540ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.413637:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015f56f2/0xa66601b03fd540ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.413654:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891117.413656:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891117.413657:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891117.417349:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.417364:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd33594b/0xa66601b03fd540d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.417383:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.417388:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.417394:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd33594b/0xa66601b03fd540d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.417409:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd33594b/0xa66601b03fd540d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.417421:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd33594b/0xa66601b03fd540d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.417429:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd33594b/0xa66601b03fd540d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.417462:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891117.417707:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891117.417714:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd33594b/0xa66601b03fd540d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.417738:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891117.417743:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd33594b/0xa66601b03fd540d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.417751:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd33594b/0xa66601b03fd540d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.417772:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd33594b/0xa66601b03fd540d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.417780:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd33594b/0xa66601b03fd540d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.417799:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891117.417801:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891117.417803:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891117.418311:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.418319:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bef680e/0xa66601b03fd540d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.418328:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.418338:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.418344:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bef680e/0xa66601b03fd540d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.418354:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bef680e/0xa66601b03fd540d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.418362:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bef680e/0xa66601b03fd540d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.418369:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bef680e/0xa66601b03fd540d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.418427:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788891117.418730:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.418736:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4992635/0xa66601b03fd540df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.418746:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.418749:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.418753:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4992635/0xa66601b03fd540df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.418763:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4992635/0xa66601b03fd540df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.418772:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4992635/0xa66601b03fd540df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.418786:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4992635/0xa66601b03fd540df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.418832:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788891117.418839:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bef680e/0xa66601b03fd540d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.418847:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ece00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891117.418850:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bef680e/0xa66601b03fd540d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.418858:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bef680e/0xa66601b03fd540d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.418878:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bef680e/0xa66601b03fd540d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.418886:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bef680e/0xa66601b03fd540d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.418901:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891117.418904:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4992635/0xa66601b03fd540df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.418910:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813eda00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891117.418914:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4992635/0xa66601b03fd540df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.418921:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4992635/0xa66601b03fd540df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.418931:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4992635/0xa66601b03fd540df lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.418938:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891117.418940:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891117.418941:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891117.419476:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788891117.419483:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4992635/0xa66601b03fd540df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788891117.419889:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.419896:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0163a4/0xa66601b03fd540e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.419907:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.419910:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.419916:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0163a4/0xa66601b03fd540e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.419926:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce0163a4/0xa66601b03fd540e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.419935:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0163a4/0xa66601b03fd540e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.419941:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0163a4/0xa66601b03fd540e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.419975:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891117.420424:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891117.420432:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce0163a4/0xa66601b03fd540e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.420441:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891117.420445:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0163a4/0xa66601b03fd540e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.420454:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0163a4/0xa66601b03fd540e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.420475:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce0163a4/0xa66601b03fd540e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.420483:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce0163a4/0xa66601b03fd540e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.420500:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891117.420502:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891117.420503:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891117.420613:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.420620:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd540ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.420629:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.420633:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.420637:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd540ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.420646:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd540ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.420654:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd540ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.420660:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd540ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.420682:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891117.420691:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891117.420695:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd540ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.420701:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891117.420712:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd540ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.420720:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd540ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.420732:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd540ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.420739:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd540ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.420753:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891117.420755:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891117.420756:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891117.421331:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891117.421504:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.421512:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000240a7091/0xa66601b03fd540f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.421545:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.421550:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.421555:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000240a7091/0xa66601b03fd540f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.421566:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000240a7091/0xa66601b03fd540f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.421575:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000240a7091/0xa66601b03fd540f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.421591:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000240a7091/0xa66601b03fd540f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.421611:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891117.421621:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891117.421629:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000240a7091/0xa66601b03fd540f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.421643:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5c00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891117.421647:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000240a7091/0xa66601b03fd540f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.421656:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000240a7091/0xa66601b03fd540f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.421671:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000240a7091/0xa66601b03fd540f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.421679:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000240a7091/0xa66601b03fd540f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.421694:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891117.421696:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891117.421698:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891117.421919:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.421926:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd540fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.421935:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.421938:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.421943:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd540fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.421953:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd540fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.421961:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd540fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.421969:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd540fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.422380:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788891117.422781:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.422788:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd54102 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.422804:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.422808:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.422812:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd54102 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.422823:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd54102 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.422831:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd54102 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.422837:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd54102 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.422887:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788891117.422894:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd540fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.422902:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5400 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891117.422906:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd540fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.422916:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd540fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.422938:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd540fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.422944:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd540fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.423248:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891117.423258:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891117.423262:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd54102 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.423269:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4a00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891117.423273:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd54102 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.423281:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd54102 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.423305:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd54102 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.423312:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd54102 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.423328:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891117.423330:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891117.423400:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891117.423424:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891117.423814:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.423822:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962e62b4/0xa66601b03fd54109 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.423831:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.423835:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.423839:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000962e62b4/0xa66601b03fd54109 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.423848:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000962e62b4/0xa66601b03fd54109 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.423855:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962e62b4/0xa66601b03fd54109 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.423862:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000962e62b4/0xa66601b03fd54109 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.423920:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788891117.424381:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.424387:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54110 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.424396:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.424399:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.424404:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54110 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.424413:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54110 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.424421:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54110 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.424428:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54110 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.424607:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788891117.424613:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000962e62b4/0xa66601b03fd54109 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.424621:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5e00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891117.424625:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000962e62b4/0xa66601b03fd54109 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.424633:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000962e62b4/0xa66601b03fd54109 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.424646:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000962e62b4/0xa66601b03fd54109 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.424653:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000962e62b4/0xa66601b03fd54109 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.424667:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891117.424676:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54110 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.424683:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4e00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891117.424686:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54110 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.424693:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54110 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.424703:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54110 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.424710:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891117.424712:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891117.424713:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891117.424796:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788891117.424801:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54110 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788891117.425397:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.425404:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd54117 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.425420:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.425424:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.425428:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd54117 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.425440:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd54117 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.425449:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd54117 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.425457:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd54117 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.425493:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891117.425499:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd54117 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.425508:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891117.425511:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd54117 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.425519:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd54117 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.425559:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd54117 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.425573:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891117.425575:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891117.425578:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891117.425649:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788891117.425655:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd54117 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788891117.426021:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.426028:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd5411e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.426047:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.426050:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.426054:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd5411e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.426086:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd5411e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.426183:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd5411e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.426190:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd5411e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.426358:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891117.426364:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd5411e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.426371:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4000 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891117.426374:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd5411e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.426382:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd5411e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.426397:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd5411e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.426598:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891117.426601:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891117.426616:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788891117.426623:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd5411e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788891117.427006:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.427013:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd54125 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.427022:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.427026:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.427198:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd54125 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.427211:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd54125 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.427242:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd54125 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.427250:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd54125 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.427368:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891117.427375:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd54125 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.427384:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891117.427387:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd54125 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.427408:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd54125 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.427422:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd54125 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.427430:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891117.427432:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891117.427435:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891117.429782:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891117.432258:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891117.432326:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788891117.432338:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd54125 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788891117.432853:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.432861:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5412c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.432873:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.432877:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.432883:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5412c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.432896:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5412c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.432905:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5412c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.432924:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5412c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.432947:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891117.433090:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891117.433097:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5412c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.433106:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4a00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891117.433112:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5412c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.433121:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5412c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.433139:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5412c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.433157:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5412c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.433172:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891117.433174:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891117.433176:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891117.433402:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.433408:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e1c1a04/0xa66601b03fd54133 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.433417:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.433420:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.433424:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e1c1a04/0xa66601b03fd54133 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.433433:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e1c1a04/0xa66601b03fd54133 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.433441:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e1c1a04/0xa66601b03fd54133 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.433448:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e1c1a04/0xa66601b03fd54133 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.433520:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788891117.435519:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.435547:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d33c723/0xa66601b03fd5413a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.435572:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.435576:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.435582:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d33c723/0xa66601b03fd5413a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.435596:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d33c723/0xa66601b03fd5413a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.435606:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d33c723/0xa66601b03fd5413a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.435614:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d33c723/0xa66601b03fd5413a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.436988:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788891117.437002:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e1c1a04/0xa66601b03fd54133 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.437014:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891117.437019:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e1c1a04/0xa66601b03fd54133 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.437029:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e1c1a04/0xa66601b03fd54133 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.437072:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e1c1a04/0xa66601b03fd54133 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.437081:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e1c1a04/0xa66601b03fd54133 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.439803:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891117.439834:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891117.440459:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891117.440462:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891117.440466:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891117.441122:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.441131:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bfd576d/0xa66601b03fd54141 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.441145:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.441150:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.441158:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bfd576d/0xa66601b03fd54141 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.441181:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bfd576d/0xa66601b03fd54141 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.442019:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bfd576d/0xa66601b03fd54141 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.442034:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bfd576d/0xa66601b03fd54141 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.442074:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891117.442456:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891117.442462:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bfd576d/0xa66601b03fd54141 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.442472:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891117.442476:0:19132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bfd576d/0xa66601b03fd54141 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.442487:0:19132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bfd576d/0xa66601b03fd54141 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.442505:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bfd576d/0xa66601b03fd54141 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.442513:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bfd576d/0xa66601b03fd54141 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.442560:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d33c723/0xa66601b03fd5413a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.442567:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5a00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891117.442572:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d33c723/0xa66601b03fd5413a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.442580:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d33c723/0xa66601b03fd5413a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.442592:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d33c723/0xa66601b03fd5413a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.442599:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d33c723/0xa66601b03fd5413a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.442614:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891117.442617:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891117.442618:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891117.442619:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891117.442628:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891117.442630:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891117.442632:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891117.442708:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.442715:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd54148 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.442737:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.442741:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.442747:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd54148 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.443080:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd54148 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.443091:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd54148 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.443099:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd54148 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.443119:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891117.443581:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891117.443588:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd54148 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891117.443599:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4000 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891117.443603:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd54148 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891117.443624:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd54148 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891117.443641:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd54148 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891117.443649:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085624805/0xa66601b03fd54148 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891117.443668:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891117.443670:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891117.443672:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891117.443793:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.443799:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd5414f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.443809:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.443813:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.443823:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd5414f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.443833:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd5414f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.443853:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd5414f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.443860:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd5414f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.443885:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891117.444073:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891117.444080:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd5414f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.444088:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891117.444091:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd5414f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.444100:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd5414f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.444111:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd5414f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.444119:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a316f4a3/0xa66601b03fd5414f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.444133:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891117.444134:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891117.444136:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891117.444322:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.444328:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54156 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.444337:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.444341:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.444345:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54156 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.444354:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54156 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.444362:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54156 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.444368:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54156 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.444406:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788891117.444668:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.444674:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c8531f2/0xa66601b03fd5415d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.444683:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.444687:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.444691:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c8531f2/0xa66601b03fd5415d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.444694:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891117.444699:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54156 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.444701:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c8531f2/0xa66601b03fd5415d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.444708:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4e00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891117.444709:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c8531f2/0xa66601b03fd5415d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.444711:0:19132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54156 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.444717:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c8531f2/0xa66601b03fd5415d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.444720:0:19132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54156 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.444731:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54156 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.444736:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891117.444739:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54156 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.444752:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891117.444756:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c8531f2/0xa66601b03fd5415d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.444774:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4c00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891117.444777:0:19132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c8531f2/0xa66601b03fd5415d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.444785:0:19132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c8531f2/0xa66601b03fd5415d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.444807:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c8531f2/0xa66601b03fd5415d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.444814:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c8531f2/0xa66601b03fd5415d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.444828:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891117.444830:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891117.444832:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891117.444868:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891117.444981:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.444987:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c20464/0xa66601b03fd54164 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.444995:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.445004:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.445009:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083c20464/0xa66601b03fd54164 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.445018:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083c20464/0xa66601b03fd54164 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.445026:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c20464/0xa66601b03fd54164 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.445293:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083c20464/0xa66601b03fd54164 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.445314:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891117.445720:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891117.445725:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083c20464/0xa66601b03fd54164 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.445733:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891117.445737:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c20464/0xa66601b03fd54164 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.445746:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c20464/0xa66601b03fd54164 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.445820:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083c20464/0xa66601b03fd54164 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.445829:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083c20464/0xa66601b03fd54164 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.445853:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891117.445855:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891117.445856:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891117.447215:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.447226:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd5416b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.447314:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.447319:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.447326:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd5416b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.447339:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd5416b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.447349:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd5416b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.447364:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd5416b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.447392:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891117.447599:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891117.447608:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd5416b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.447616:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891117.447619:0:19132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd5416b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.447628:0:19132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd5416b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.447644:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd5416b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.447651:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b8cf9cc/0xa66601b03fd5416b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.447669:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891117.447671:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891117.447673:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891117.448296:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.448304:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54172 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.448314:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.448318:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.448323:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54172 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.448333:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54172 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.448341:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54172 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.448349:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54172 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.448372:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891117.448579:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891117.448585:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54172 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891117.448593:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891117.448597:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54172 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891117.448605:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54172 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891117.448620:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54172 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891117.448639:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54172 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891117.448656:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891117.448658:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891117.448660:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891117.448679:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.448685:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03b75b4/0xa66601b03fd54179 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.448699:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.448702:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.448706:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03b75b4/0xa66601b03fd54179 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.448714:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03b75b4/0xa66601b03fd54179 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.448723:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03b75b4/0xa66601b03fd54179 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.448730:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03b75b4/0xa66601b03fd54179 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.448749:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891117.448843:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891117.448848:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03b75b4/0xa66601b03fd54179 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.448867:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5000 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891117.448871:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03b75b4/0xa66601b03fd54179 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.448879:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03b75b4/0xa66601b03fd54179 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.448890:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03b75b4/0xa66601b03fd54179 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.448898:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03b75b4/0xa66601b03fd54179 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891117.448912:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891117.448914:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891117.448916:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891117.449345:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891117.449351:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02171c0/0xa66601b03fd54180 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.449360:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788891117.449363:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891117.449367:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02171c0/0xa66601b03fd54180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.449375:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02171c0/0xa66601b03fd54180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.449395:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02171c0/0xa66601b03fd54180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.449402:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02171c0/0xa66601b03fd54180 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891117.449995:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788891117.450054:0:18616:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1788891117.451336:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17134:x1875787997412864:12345-0@lo:5:osp-pre-0-0.0 Request processed in 70893us (74363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891117.451348:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788891117.451411:0:17134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17134:1875787997412864:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788891117.451425:0:17134:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1788891117.451465:0:17134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17134:1875787997412992:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788891117.451497:0:17134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891117.451555:0:17134:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8221ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788891117.451570:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997412992 00000100:00100000:3.0:1788891117.451577:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997412992 00010000:00010000:1.0:1788891117.451651:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891117.451660:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02171c0/0xa66601b03fd54180 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.451672:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4400 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891117.451676:0:19132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02171c0/0xa66601b03fd54180 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.451686:0:19132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02171c0/0xa66601b03fd54180 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.451707:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02171c0/0xa66601b03fd54180 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.451714:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02171c0/0xa66601b03fd54180 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891117.451736:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891117.451738:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891117.451740:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891117.454551:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788891117.454588:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17134:x1875787997412992:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788891117.454640:0:18613:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1788891117.461174:0:18610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1788891117.461237:0:18610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788891117.462726:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17134:x1875787997412992:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8148us (11222us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788891117.462740:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788891117.463034:0:17134:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788891117.463044:0:17134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17134:1875787997412992:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788891117.463072:0:17134:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:2.0:1788891117.691768:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788891117.691792:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997413120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788891117.691864:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891117.691912:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997413120 00000100:00100000:2.0:1788891117.691919:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997413120 00000100:00100000:2.0:1788891117.691961:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788891117.691970:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997413120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788891117.692020:0:17114:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788891117.692081:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997413120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891117.692110:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788891117.692156:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997413120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788891117.692810:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997413248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788891117.692845:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891117.692942:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997413248 00000100:00100000:1.0:1788891117.692948:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997413248 00000100:00100000:1.0:1788891117.692986:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788891117.692994:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997413248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788891117.693009:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788891117.693069:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997413248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891117.693076:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788891117.693323:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997413248:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788891118.139764:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891119.165235:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891120.187855:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891121.213024:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788891121.448941:0:19430:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788891121.448945:0:19430:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788891121.448946:0:19430:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788891121.449064:0:19430:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff924f8238d000 00000020:01000004:0.0:1788891121.449087:0:19430:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788891121.449102:0:19430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788891121.449116:0:19430:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff925090b219b8) 00000020:00000080:0.0:1788891121.449134:0:19430:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788891121.500000:0:19430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788891121.500820:0:19430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788891121.501170:0:19430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788891121.501412:0:19430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788891121.501693:0:19430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788891121.501890:0:19430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788891121.502119:0:19430:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1788891121.504770:0:19430:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788891121.504998:0:19430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788891121.505015:0:19430:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788891121.505027:0:19430:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa66601b03fd5418e 00000020:01000004:3.0:1788891121.505039:0:19430:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788891121.505062:0:19430:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788891121.505065:0:19430:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788891121.505072:0:19430:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788891121.505101:0:19430:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788891121.505106:0:19430:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788891121.515423:0:19430:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788891121.515465:0:19430:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.126@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788891121.515470:0:19430:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788891121.515471:0:19430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788891121.515473:0:19430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788891121.515474:0:19430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788891121.515475:0:19430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788891121.515476:0:19430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788891121.515477:0:19430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788891121.515479:0:19430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788891121.515480:0:19430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788891121.515483:0:19430:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788891121.515486:0:19430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788891121.515487:0:19430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788891121.515488:0:19430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788891121.515489:0:19430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788891121.515490:0:19430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788891121.515492:0:19430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788891121.515492:0:19430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788891121.515493:0:19430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788891121.515494:0:19430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788891121.515520:0:19430:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788891121.515564:0:19430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83165180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997413376:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788891121.515644:0:19430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891121.515763:0:19430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab15e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788891121.515812:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997413376 00000100:00100000:0.0:1788891121.515819:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997413376 00000100:00100000:0.0:1788891121.515905:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788891121.515915:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+21:19430:x1875787997413376:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788891121.515943:0:17104:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788891121.515946:0:17104:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788891121.515950:0:17104:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788891121.516296:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+21:19430:x1875787997413376:12345-0@lo:253:mount.lustre.0 Request processed in 381us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891121.516305:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788891121.516390:0:19430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83165180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997413376:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788891121.516403:0:19430:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788891121.516405:0:19430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788891121.516406:0:19430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788891121.516408:0:19430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891121.516409:0:19430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891121.516410:0:19430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891121.516411:0:19430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891121.516412:0:19430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788891121.516414:0:19430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891121.516414:0:19430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788891121.516432:0:19430:0:(tgt_mount.c:101:server_register_mount()) register mount ffff924f8238d000 from lustre-OST0001 10000000:01000000:3.0:1788891121.516460:0:19430:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788891121.516463:0:19430:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788891121.516471:0:19430:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff924f81ed19b8 local copy 00010000:00010000:3.0:1788891121.516482:0:19430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd53de4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53deb expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891121.516586:0:19430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997413504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891121.516615:0:19430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891121.516911:0:19430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c0a18c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788891121.516972:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997413504 00000100:00100000:2.0:1788891121.516986:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997413504 00000100:00100000:2.0:1788891121.517011:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788891121.517017:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+21:19430:x1875787997413504:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891121.517088:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+21:19430:x1875787997413504:12345-0@lo:501:mount.lustre.0 Request processed in 70us (472us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788891121.517096:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788891121.517180:0:19430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997413504:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788891121.517194:0:19430:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788891121.517212:0:19430:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788891121.517218:0:19430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd53de4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53deb expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891121.517238:0:19430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd53de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53deb expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891121.517265:0:19430:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff924f8238d000 10000000:01000000:3.0:1788891121.517269:0:19430:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788891121.517275:0:19430:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788891121.517277:0:19430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788891121.517281:0:19430:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788891121.517284:0:19430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788891121.517306:0:19430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd54195 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891121.517314:0:19430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd54195 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891121.517323:0:19430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd54195 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891121.517335:0:19430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997413632:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788891121.517362:0:19430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891121.517385:0:19430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c0a18c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788891121.517425:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997413632 00000100:00100000:2.0:1788891121.517430:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997413632 00000100:00100000:2.0:1788891121.517449:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788891121.517455:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250933d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+21:19430:x1875787997413632:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891121.517462:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891121.517475:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924f82310400/0xa66601b03fd5419c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54195 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.517496:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924f82310400/0xa66601b03fd5419c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54195 expref: 22 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.517505:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924f82310400/0xa66601b03fd5419c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54195 expref: 22 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.517514:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310400, rc 0) 00000100:00100000:2.0:1788891121.517579:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250933d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+22:19430:x1875787997413632:12345-0@lo:101:mount.lustre.0 Request processed in 124us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891121.517585:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788891121.517670:0:19430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997413632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891121.517683:0:19430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd54195 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5419c expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891121.517692:0:19430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd54195 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd5419c expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788891121.518861:0:19430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788891121.519459:0:19430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788891121.521150:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788891121.521266:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788891121.521280:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788891121.521293:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788891121.521307:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788891121.521320:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788891121.521358:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788891121.521365:0:19430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788891121.521476:0:19430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997413760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891121.521681:0:19430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891121.521758:0:19430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c0a18a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788891121.521803:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997413760 00000100:00100000:2.0:1788891121.521817:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997413760 00000100:00100000:2.0:1788891121.521921:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788891121.521931:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250933d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+22:19430:x1875787997413760:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891121.522094:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250933d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+22:19430:x1875787997413760:12345-0@lo:501:mount.lustre.0 Request processed in 164us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891121.522102:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788891121.522181:0:19430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997413760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891121.522213:0:19430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997413888:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788891121.522250:0:19430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891121.522415:0:19430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c0a18a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788891121.522508:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997413888 00000100:00100000:0.0:1788891121.522515:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997413888 00000100:00100000:0.0:1788891121.522568:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788891121.522575:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250933d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+22:19430:x1875787997413888:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891121.523107:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250933d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+22:19430:x1875787997413888:12345-0@lo:503:mount.lustre.0 Request processed in 530us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891121.523115:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788891121.523281:0:19430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997413888:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788891121.523685:0:19430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788891121.523754:0:19430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997414016:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891121.523795:0:19430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891121.523822:0:19430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c0a18c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788891121.523896:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997414016 00000100:00100000:2.0:1788891121.523902:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997414016 00000100:00100000:2.0:1788891121.523928:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788891121.523934:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+22:19430:x1875787997414016:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891121.524349:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+22:19430:x1875787997414016:12345-0@lo:502:mount.lustre.0 Request processed in 413us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891121.524357:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788891121.524432:0:19430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997414016:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891121.524622:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788891121.524648:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788891121.524674:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788891121.524688:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788891121.524700:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788891121.524712:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788891121.524724:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788891121.524736:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788891121.524749:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788891121.524771:0:19430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997414144:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891121.524806:0:19430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891121.524886:0:19430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c0a18c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788891121.524995:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997414144 00000100:00100000:1.0:1788891121.525001:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997414144 00000100:00100000:0.0:1788891121.525052:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788891121.525062:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+22:19430:x1875787997414144:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891121.525242:0:19430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997414144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891121.525280:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788891121.525289:0:19430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788891121.525838:0:19434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788891121.525846:0:19434:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788891121.525852:0:19434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891121.525854:0:19434:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788891121.525859:0:19434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788891121.525873:0:19434:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff925091acb370) 00000020:00000080:2.0:1788891121.525895:0:19434:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788891121.525902:0:19434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788891121.525989:0:19434:0:(tgt_mount.c:153:server_get_mount()) get mount ffff924f8238d000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788891121.525999:0:19434:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788891121.526006:0:19434:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa66601b03fd541aa 00000100:00100000:0.0:1788891121.527023:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+22:19430:x1875787997414144:12345-0@lo:502:mount.lustre.0 Request processed in 90us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891121.527040:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00010000:2.0:1788891121.529130:0:19434:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788891121.529603:0:19434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1788891121.530788:0:19434:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788891121.532133:0:19434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788891121.532146:0:19434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891121.532233:0:19434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891121.532235:0:19434:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788891121.532240:0:19434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891121.532245:0:19434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891121.532246:0:19434:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788891121.532249:0:19434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788891121.532251:0:19434:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788891121.532254:0:19434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891121.532256:0:19434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891121.532257:0:19434:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788891121.532260:0:19434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891121.532262:0:19434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891121.532263:0:19434:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788891121.532267:0:19434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788891121.532292:0:19434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891121.532295:0:19434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891121.532296:0:19434:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788891121.532299:0:19434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788891121.537467:0:19430:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788891121.537614:0:19430:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788891121.537634:0:19430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd54195 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5419c expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891121.537646:0:19430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd54195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5419c expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891121.537667:0:19430:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff924f8238d000 from 1 10000000:01000000:0.0:1788891121.537670:0:19430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788891121.537712:0:19430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd541b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891121.537720:0:19430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd541b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891121.537809:0:19430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd541b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891121.537838:0:19430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997414272:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891121.537909:0:19430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891121.537947:0:19430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891121.538265:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997414272 00000100:00100000:1.0:1788891121.538273:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997414272 00000100:00100000:1.0:1788891121.538331:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788891121.538341:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+22:19430:x1875787997414272:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891121.538355:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891121.538369:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250857de600/0xa66601b03fd541b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd541b1 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891121.538393:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250857de600/0xa66601b03fd541b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd541b1 expref: 23 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891121.538403:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250857de600/0xa66601b03fd541b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd541b1 expref: 23 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891121.538412:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857de600, rc 0) 00000100:00100000:1.0:1788891121.538458:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+23:19430:x1875787997414272:12345-0@lo:101:mount.lustre.0 Request processed in 119us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891121.538464:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788891121.538567:0:19430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997414272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891121.538582:0:19430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd541b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd541b8 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891121.538591:0:19430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd541b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd541b8 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788891121.539492:0:19430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788891121.539869:0:19430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788891121.540084:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788891121.540110:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788891121.540129:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788891121.540135:0:19430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788891121.540278:0:19430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997414400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891121.540333:0:19430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891121.540422:0:19430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c5780 going to sleep for 11 seconds 00000100:00100000:3.0:1788891121.540486:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997414400 00000100:00100000:3.0:1788891121.540493:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997414400 00000100:00100000:3.0:1788891121.540616:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788891121.540625:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+23:19430:x1875787997414400:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891121.540734:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+23:19430:x1875787997414400:12345-0@lo:501:mount.lustre.0 Request processed in 110us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891121.540742:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788891121.540818:0:19430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997414400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891121.540847:0:19430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997414528:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891121.540885:0:19430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891121.541032:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997414528 00000100:00100000:1.0:1788891121.541037:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997414528 00000100:00100000:1.0:1788891121.541060:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788891121.541067:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+23:19430:x1875787997414528:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788891121.541141:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+23:19430:x1875787997414528:12345-0@lo:503:mount.lustre.0 Request processed in 73us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891121.541167:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788891121.541219:0:19430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c5780 going to sleep for 11 seconds 00000100:00100000:1.0:1788891121.541233:0:19430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997414528:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788891121.541649:0:19430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788891121.541706:0:19430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997414656:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891121.541743:0:19430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891121.541766:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997414656 00000100:00100000:1.0:1788891121.541770:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997414656 00000100:00100000:1.0:1788891121.541790:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788891121.541796:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+23:19430:x1875787997414656:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891121.541875:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+23:19430:x1875787997414656:12345-0@lo:502:mount.lustre.0 Request processed in 79us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891121.541881:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788891121.541913:0:19430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891121.541925:0:19430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997414656:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788891121.542112:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788891121.542139:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788891121.542155:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788891121.542168:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788891121.542182:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788891121.542196:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788891121.542222:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788891121.542238:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788891121.542251:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788891121.542264:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788891121.542278:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788891121.542297:0:19430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997414784:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891121.542335:0:19430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891121.542358:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997414784 00000100:00100000:1.0:1788891121.542362:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997414784 00000100:00100000:1.0:1788891121.542381:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788891121.542387:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+23:19430:x1875787997414784:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891121.542448:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+23:19430:x1875787997414784:12345-0@lo:502:mount.lustre.0 Request processed in 61us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891121.542454:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788891121.542484:0:19430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788891121.542497:0:19430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997414784:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788891121.542549:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788891121.542558:0:19430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788891121.542950:0:19438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788891121.542959:0:19438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891121.542961:0:19438:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788891121.542967:0:19438:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff924f8238d000 00000020:00000080:1.0:1788891121.542969:0:19438:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788891121.542976:0:19438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788891121.542992:0:19438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891121.542993:0:19438:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788891121.542996:0:19438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788891121.542998:0:19438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891121.543000:0:19438:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788891121.543003:0:19438:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff924f8238d000 00000020:00000080:1.0:1788891121.543005:0:19438:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788891121.543276:0:19438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788891121.543281:0:19438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891121.543283:0:19438:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788891121.543285:0:19438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788891121.543288:0:19438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891121.543294:0:19438:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788891121.543299:0:19438:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff924f8238d000 00000020:00000080:1.0:1788891121.543301:0:19438:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788891121.543321:0:19438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788891121.543324:0:19438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891121.543325:0:19438:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788891121.543328:0:19438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788891121.543330:0:19438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891121.543331:0:19438:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788891121.543334:0:19438:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff924f8238d000 00000020:00000080:1.0:1788891121.543336:0:19438:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788891121.543359:0:19438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788891121.543363:0:19438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891121.543364:0:19438:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788891121.543367:0:19438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788891121.543606:0:19430:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788891121.543633:0:19430:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788891121.543655:0:19430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd541b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd541b8 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.543666:0:19430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd541b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd541b8 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891121.543721:0:19430:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788891121.543724:0:19430:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff924f8238d000 10000000:01000000:2.0:1788891121.543739:0:19430:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff924f8238d000 10000000:01000000:2.0:1788891121.543743:0:19430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788891121.543749:0:19430:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff924f8238d000 from 1 10000000:01000000:2.0:1788891121.543752:0:19430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788891121.543782:0:19430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82311400/0xa66601b03fd541bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.543796:0:19430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff924f82311400/0xa66601b03fd541bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.543807:0:19430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff924f82311400/0xa66601b03fd541bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891121.543825:0:19430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83166680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997414912:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788891121.543869:0:19430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891121.543897:0:19430:0:(client.c:2715:ptlrpc_set_wait()) set ffff925087938180 going to sleep for 11 seconds 00000100:00100000:0.0:1788891121.544050:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997414912 00000100:00100000:0.0:1788891121.544057:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997414912 00000100:00100000:0.0:1788891121.544100:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788891121.544109:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+23:19430:x1875787997414912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891121.544121:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891121.544133:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae5000/0xa66601b03fd541c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd541bf expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891121.544222:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae5000/0xa66601b03fd541c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd541bf expref: 24 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891121.544234:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae5000/0xa66601b03fd541c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd541bf expref: 24 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891121.544243:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5000, rc 0) 00000100:00100000:0.0:1788891121.544359:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+24:19430:x1875787997414912:12345-0@lo:101:mount.lustre.0 Request processed in 250us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891121.544367:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788891121.546741:0:19430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83166680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997414912:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891121.546768:0:19430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff924f82311400/0xa66601b03fd541bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd541c6 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891121.546781:0:19430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff924f82311400/0xa66601b03fd541bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd541c6 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788891121.553448:0:19430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1788891121.553866:0:19430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788891121.555176:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788891121.555372:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788891121.555389:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788891121.555402:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788891121.555416:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788891121.555431:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788891121.555446:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788891121.555460:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788891121.555478:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788891121.555494:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788891121.555565:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788891121.555584:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788891121.555599:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788891121.555614:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788891121.555630:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788891121.555642:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788891121.555736:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788891121.555815:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788891121.555904:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788891121.556374:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788891121.556405:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788891121.556424:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788891121.556444:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788891121.556463:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788891121.556483:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788891121.556505:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788891121.556610:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788891121.556630:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788891121.556648:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788891121.556752:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788891121.556785:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788891121.556806:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788891121.556834:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788891121.556856:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788891121.556873:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788891121.556889:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788891121.556904:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788891121.556920:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788891121.556932:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1788891121.557411:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1788891121.557432:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1788891121.557449:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1788891121.557482:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1788891121.557503:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1788891121.557519:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1788891121.557560:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1788891121.557587:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1788891121.557597:0:19430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1788891121.557789:0:19430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83165c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997415040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891121.557861:0:19430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891121.557919:0:19430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b6854f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788891121.558021:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997415040 00000100:00100000:1.0:1788891121.558029:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997415040 00000100:00100000:1.0:1788891121.558962:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788891121.559218:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+24:19430:x1875787997415040:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891121.559441:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+24:19430:x1875787997415040:12345-0@lo:501:mount.lustre.0 Request processed in 468us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891121.559449:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788891121.563006:0:19430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83165c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997415040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891121.563071:0:19430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83165c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997415168:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788891121.563210:0:19430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891121.563294:0:19430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b6854f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788891121.569281:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997415168 00000100:00100000:0.0:1788891121.569295:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997415168 00000100:00100000:0.0:1788891121.569379:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788891121.569389:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+24:19430:x1875787997415168:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891121.569574:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+24:19430:x1875787997415168:12345-0@lo:503:mount.lustre.0 Request processed in 186us (6424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891121.569580:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788891121.570019:0:19430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83165c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997415168:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788891121.570472:0:19430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788891121.570588:0:19430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83165c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997415296:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891121.570644:0:19430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891121.570678:0:19430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b6854f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788891121.570922:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997415296 00000100:00100000:1.0:1788891121.570934:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997415296 00000100:00100000:1.0:1788891121.571002:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788891121.571010:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+24:19430:x1875787997415296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891121.571111:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+24:19430:x1875787997415296:12345-0@lo:502:mount.lustre.0 Request processed in 101us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891121.571119:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788891121.571646:0:19430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83165c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997415296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891121.571944:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788891121.571971:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788891121.572640:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788891121.572663:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788891121.572678:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788891121.572698:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788891121.572713:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788891121.572813:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788891121.572843:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788891121.572856:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788891121.572867:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788891121.572878:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788891121.572889:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788891121.572900:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788891121.572912:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788891121.572923:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788891121.572934:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788891121.572946:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788891121.572957:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788891121.572969:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788891121.572994:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788891121.573008:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788891121.573017:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788891121.573028:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788891121.573049:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788891121.573061:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788891121.573070:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788891121.573079:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788891121.573089:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788891121.573098:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788891121.573108:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788891121.573118:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788891121.573129:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788891121.573140:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788891121.573152:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788891121.573165:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788891121.573178:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788891121.573190:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788891121.573202:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788891121.573215:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788891121.573248:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788891121.573263:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788891121.573275:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788891121.573286:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788891121.573298:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788891121.573309:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788891121.573485:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788891121.573500:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788891121.573588:0:19430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997415424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891121.573657:0:19430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891121.573697:0:19430:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82263e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788891121.573719:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997415424 00000100:00100000:3.0:1788891121.573724:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997415424 00000100:00100000:3.0:1788891121.574457:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788891121.574467:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+24:19430:x1875787997415424:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891121.574627:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+24:19430:x1875787997415424:12345-0@lo:502:mount.lustre.0 Request processed in 160us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891121.574635:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788891121.575023:0:19430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997415424:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788891121.575226:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788891121.575251:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788891121.575277:0:19430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83166d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997415552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891121.575319:0:19430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891121.575353:0:19430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b6854b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788891121.575456:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997415552 00000100:00100000:0.0:1788891121.575463:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997415552 00000100:00100000:0.0:1788891121.575500:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788891121.575508:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+24:19430:x1875787997415552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891121.575605:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+24:19430:x1875787997415552:12345-0@lo:502:mount.lustre.0 Request processed in 97us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891121.575612:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788891121.575697:0:19430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83166d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997415552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788891121.575734:0:19430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788891121.575741:0:19430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788891121.577028:0:19443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788891121.577043:0:19443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9250b717b370) 00000020:00000080:1.0:1788891121.577070:0:19443:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788891121.577147:0:19443:0:(tgt_mount.c:153:server_get_mount()) get mount ffff924f8238d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788891121.577208:0:19443:0:(tgt_mount.c:187:server_put_mount()) put mount ffff924f8238d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788891121.577210:0:19443:0:(obd_mount.c:710:lustre_put_lsi()) put ffff924f8238d000 3 00010000:00080000:1.0:1788891121.577233:0:19443:0:(ldlm_lib.c:102:import_set_conn()) imp ffff925087571000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1788891121.579440:0:19443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788891121.579764:0:19443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788891121.579806:0:19443:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788891121.579820:0:19443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa66601b03fd541d4 00000100:00080000:1.0:1788891121.579831:0:19443:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788891121.579838:0:19443:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff925087571000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891121.579873:0:19443:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83bad500 x1875787997415680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788891121.579904:0:19443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788891121.579986:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1875787997415680:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788891121.580059:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1788891121.580293:0:19443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788891121.580306:0:19443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff925090b20000) 00000020:00000080:0.0:1788891121.580320:0:19443:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788891121.580383:0:19443:0:(tgt_mount.c:153:server_get_mount()) get mount ffff924f8238d000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788891121.580387:0:19443:0:(tgt_mount.c:187:server_put_mount()) put mount ffff924f8238d000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788891121.580389:0:19443:0:(obd_mount.c:710:lustre_put_lsi()) put ffff924f8238d000 3 00010000:00080000:0.0:1788891121.580413:0:19443:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f81ec9800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.126@tcp at head 00000100:00080000:2.0:1788891121.580901:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788891121.580906:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788891121.580909:0:37:0:(import.c:65:import_set_state_nolock()) ffff9250ba96f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788891121.580914:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 339 00000100:00080000:2.0:1788891121.580919:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788891121.580924:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9250ba96f000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788891121.580948:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83166680 x1875787997416064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788891121.581009:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788891121.581012:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788891121.581014:0:37:0:(import.c:65:import_set_state_nolock()) ffff925086eaf800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788891121.581018:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 339 00000100:00080000:2.0:1788891121.581021:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788891121.581025:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff925086eaf800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788891121.581192:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83164e00 x1875787997416576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788891121.581241:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997416064:0@lo:8:kworker.0 00000100:00100000:2.0:1788891121.581298:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891121.581324:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997416576:0@lo:8:kworker.0 00000100:00100000:2.0:1788891121.581346:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891121.581376:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997416064 00000100:00100000:0.0:1788891121.581385:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997416064 00000100:00100000:0.0:1788891121.581414:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997416576 00000100:00100000:0.0:1788891121.581418:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997416576 00000100:00100000:0.0:1788891121.581437:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788891121.581451:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1875787997416064:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788891121.581460:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997416192:0@lo:400:kworker.0 00000100:00100000:0.0:1788891121.581518:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1875787997416064:12345-0@lo:8:kworker.0 Request processed in 65us (219us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788891121.581546:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788891121.581565:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788891121.581570:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1875787997416576:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788891121.581595:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891121.581608:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1875787997416576:12345-0@lo:8:kworker.0 Request processed in 35us (260us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788891121.581616:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788891121.581625:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997416832:0@lo:400:kworker.0 00000100:00100000:2.0:1788891121.581653:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891121.581678:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788891121.581685:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997416320:0@lo:400:kworker.0 00000100:00100000:2.0:1788891121.581713:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891121.581732:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997416960:0@lo:400:kworker.0 00000100:00100000:2.0:1788891121.581757:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891121.581792:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997415680 00000100:00100000:2.0:1788891121.581804:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997415680 00000100:00100000:2.0:1788891121.581822:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997416192 00000100:00100000:2.0:1788891121.581824:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997416192 00000100:00100000:2.0:1788891121.581846:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997416832 00000100:00100000:2.0:1788891121.581849:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997416832 00000100:00100000:2.0:1788891121.581873:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997416960 00000100:00100000:2.0:1788891121.581876:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997416960 00000100:00100000:2.0:1788891121.581896:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788891121.581902:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997416192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891121.581950:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997416192:12345-0@lo:400:kworker.0 Request processed in 48us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891121.581957:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788891121.581972:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788891121.581993:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997416832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891121.582023:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997416832:12345-0@lo:400:kworker.0 Request processed in 45us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891121.582029:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788891121.582042:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788891121.582049:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997416960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891121.582079:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997416960:12345-0@lo:400:kworker.0 Request processed in 31us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891121.582085:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788891121.582110:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788891121.582114:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3626:x1875787997415680:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788891121.582132:0:17110:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 343 last 0 00000020:00000080:2.0:1788891121.582170:0:17110:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa66601b03fd541e2 00000004:00100000:2.0:1788891121.582186:0:17110:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788891121.582222:0:17110:0:(import.c:65:import_set_state_nolock()) ffff9250c12db000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788891121.582254:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875787997415680:12345-0@lo:38:llog_process_th.0 Request processed in 139us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891121.582260:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788891121.582293:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788891121.582299:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250ba96f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788891121.582303:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788891121.582306:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997416064:0@lo:8:kworker.0 00000100:00100000:2.0:1788891121.582315:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788891121.582318:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925086eaf800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788891121.582321:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788891121.582324:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997416576:0@lo:8:kworker.0 00010000:00080000:2.0:1788891121.582340:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83bad500 x1875787997415680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788891131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891121.582348:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788891121.582352:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788891121.582359:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788891121.582362:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788891121.582364:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925087571000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788891121.582369:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1875787997415680:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788891121.582406:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83890a80 x1875787997416960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891121.582417:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997416960:0@lo:400:kworker.0 00010000:00080000:2.0:1788891121.582432:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83165180 x1875787997416192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788891121.582435:0:19443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:2.0:1788891121.582449:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997416192:0@lo:400:kworker.0 00010000:00080000:2.0:1788891121.582464:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83893800 x1875787997416832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891121.582472:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997416832:0@lo:400:kworker.0 00000100:00100000:2.0:1788891121.582599:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997415936:0@lo:400:kworker.0 00000100:00100000:2.0:1788891121.582629:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891121.582652:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875787997416704:0@lo:400:kworker.0 00000100:00100000:2.0:1788891121.582677:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891121.582697:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997416704 00000100:00100000:2.0:1788891121.582702:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788891121.582703:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997416704 00000100:00100000:2.0:1788891121.582712:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997415808:0@lo:400:kworker.0 00000100:00100000:1.0:1788891121.582742:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788891121.582743:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891121.582755:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875787997416704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891121.582766:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997416448:0@lo:400:kworker.0 00000100:00100000:2.0:1788891121.582816:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891121.582817:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875787997416704:12345-0@lo:400:kworker.0 Request processed in 62us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891121.582841:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788891121.582846:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83167480 x1875787997416704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891121.582857:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875787997416704:0@lo:400:kworker.0 00000100:00100000:2.0:1788891121.582899:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997415936 00000100:00100000:2.0:1788891121.582903:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997415936 00000100:00100000:2.0:1788891121.582931:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997416448 00000100:00100000:2.0:1788891121.582934:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997416448 00000100:00100000:2.0:1788891121.582954:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788891121.582961:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997415936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891121.583014:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997415936:12345-0@lo:400:kworker.0 Request processed in 53us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891121.583028:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788891121.583045:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788891121.583054:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997416448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891121.583091:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997416448:12345-0@lo:400:kworker.0 Request processed in 39us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891121.583098:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788891121.583118:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997416320 00000100:00100000:2.0:1788891121.583121:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997416320 00000100:00100000:2.0:1788891121.583145:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997415808 00000100:00100000:2.0:1788891121.583148:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997415808 00000100:00100000:2.0:1788891121.583160:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788891121.583163:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997416320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891121.583189:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997416320:12345-0@lo:400:kworker.0 Request processed in 26us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891121.583193:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788891121.583201:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788891121.583204:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997415808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891121.583224:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997415808:12345-0@lo:400:kworker.0 Request processed in 20us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891121.583228:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788891121.583255:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997415808:0@lo:400:kworker.0 00000100:00100000:2.0:1788891121.583265:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997416448:0@lo:400:kworker.0 00000100:00100000:2.0:1788891121.583274:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997415936:0@lo:400:kworker.0 00000020:00000080:0.0:1788891121.583291:0:19443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000100:00100000:2.0:1788891121.583298:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997416320:0@lo:400:kworker.0 00000010:01000000:0.0:1788891121.583335:0:19443:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788891121.583344:0:19443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xa66601b03fd541e9 00000100:00080000:0.0:1788891121.583350:0:19443:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788891121.583355:0:19443:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff924f81ec9800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891121.583375:0:19443:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83a5ea00 x1875787997417088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788891121.583401:0:19443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788891121.583459:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3626:1875787997417088:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788891121.583494:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891121.583556:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997417088 00000100:00100000:2.0:1788891121.583561:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997417088 00000100:00100000:2.0:1788891121.583586:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788891121.583591:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3626:x1875787997417088:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788891121.583623:0:18639:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 343 last 0 00000040:00080000:0.0:1788891121.583649:0:19443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:00000080:2.0:1788891121.583656:0:18639:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xa66601b03fd541f0 00000004:00100000:2.0:1788891121.583671:0:18639:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788891121.583697:0:18639:0:(import.c:65:import_set_state_nolock()) ffff924f83375000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788891121.583739:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875787997417088:12345-0@lo:38:llog_process_th.0 Request processed in 146us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891121.583745:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788891121.583779:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83a5ea00 x1875787997417088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788891131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891121.583788:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788891121.583793:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788891121.583799:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788891121.583804:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788891121.583806:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f81ec9800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788891121.583812:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3626:1875787997417088:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788891121.583837:0:19430:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788891121.583866:0:19430:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788891121.583889:0:19430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82311400/0xa66601b03fd541bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd541c6 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.583910:0:19430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff924f82311400/0xa66601b03fd541bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd541c6 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788891121.583965:0:19430:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788891121.583968:0:19430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788891121.583970:0:19430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788891121.583972:0:19430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788891121.583973:0:19430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788891121.583975:0:19430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788891121.583989:0:19430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788891121.583992:0:19430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788891121.583994:0:19430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788891121.583998:0:19430:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788891121.584000:0:19430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788891121.584002:0:19430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788891121.584003:0:19430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788891121.584004:0:19430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788891121.584005:0:19430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788891121.584007:0:19430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788891121.584008:0:19430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788891121.584009:0:19430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788891121.584011:0:19430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788891121.584028:0:19430:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788891121.584041:0:19430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83890e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997417216:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788891121.584079:0:19430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891121.584116:0:19430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b6854b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788891121.584237:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997417216 00000100:00100000:0.0:1788891121.584243:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997417216 00000100:00100000:0.0:1788891121.584316:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788891121.584325:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+24:19430:x1875787997417216:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788891121.584343:0:17102:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788891121.584355:0:17102:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1788891121.587718:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788891121.587809:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788891121.587813:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:1.0:1788891121.588394:0:17102:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788891121.588409:0:17102:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788891121.588672:0:17125:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788891121.588677:0:17125:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788891121.588699:0:17125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9250baae4800/0xa66601b03fd541f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891121.588725:0:17125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250857dea00/0xa66601b03fd540ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd540a7 expref: 24 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891121.588733:0:17125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff924f82310c00/0xa66601b03fd540bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd540b5 expref: 24 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891121.588740:0:17125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9250baae4800/0xa66601b03fd541f7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891121.588777:0:17125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff924f82310c00/0xa66601b03fd540bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd540b5 expref: 24 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891121.588791:0:17125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff924f82310c00/0xa66601b03fd540bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd540b5 expref: 24 pid: 17104 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891121.588807:0:17125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17125:1875787997417344:0@lo:104: 00000100:00100000:0.0:1788891121.588871:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788891121.588924:0:17125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250857dea00/0xa66601b03fd540ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd540a7 expref: 24 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891121.588932:0:17125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250857dea00/0xa66601b03fd540ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd540a7 expref: 24 pid: 17102 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891121.588940:0:17125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17125:1875787997417472:0@lo:104: 00000100:00100000:0.0:1788891121.588960:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891121.589048:0:17125:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f822f5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788891121.589146:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+24:19430:x1875787997417216:12345-0@lo:253:mount.lustre.0 Request processed in 4822us (5065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891121.589171:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788891121.590122:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997417344 00000100:00100000:2.0:1788891121.590131:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997417344 00000100:00100000:2.0:1788891121.590178:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997417472 00000100:00100000:2.0:1788891121.590181:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997417472 00000100:00100000:2.0:1788891121.590194:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788891121.590202:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+4:17125:x1875787997417344:12345-0@lo:104: 00010000:00010000:2.0:1788891121.590215:0:17093:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd540b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd540bc expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.590293:0:17093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788891121.590300:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+4:17125:x1875787997417344:12345-0@lo:104: Request processed in 99us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891121.590307:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788891121.590321:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788891121.590328:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+3:17125:x1875787997417472:12345-0@lo:104: 00010000:00010000:2.0:1788891121.590335:0:17093:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250813ed200/0xa66601b03fd540a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd540ae expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.590368:0:17093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788891121.590373:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+3:17125:x1875787997417472:12345-0@lo:104: Request processed in 47us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891121.590379:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788891121.590396:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788891121.590401:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd540b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd540bc expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.590409:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ede00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891121.590412:0:17097:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd540b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd540bc expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.590421:0:17097:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd540b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd540bc expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891121.590427:0:17097:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd540b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd540bc expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891121.590433:0:17097:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788891121.590472:0:17097:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd540b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd540bc expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.590478:0:17097:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891121.590497:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd540b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd540bc expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.590503:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd540b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd540bc expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.590514:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891121.590517:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250813ed200/0xa66601b03fd540a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd540ae expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.590544:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed200 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891121.590548:0:17097:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250813ed200/0xa66601b03fd540a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd540ae expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.590554:0:17097:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250813ed200/0xa66601b03fd540a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd540ae expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891121.590560:0:17097:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250813ed200/0xa66601b03fd540a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd540ae expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891121.590565:0:17097:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788891121.590577:0:17097:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250813ed200/0xa66601b03fd540a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd540ae expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.590582:0:17097:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891121.590588:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250813ed200/0xa66601b03fd540a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd540ae expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.590602:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250813ed200/0xa66601b03fd540a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd540ae expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.590615:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891121.590617:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891121.590618:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891121.590625:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891121.590644:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997417600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891121.590677:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891121.590710:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788891121.590716:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997417728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891121.590737:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891121.590765:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997417600 00000100:00100000:2.0:1788891121.590769:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997417600 00010000:00010000:2.0:1788891121.590786:0:17094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff924f82310c00/0xa66601b03fd540bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd540b5 expref: 24 pid: 17104 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891121.590805:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997417728 00000100:00100000:2.0:1788891121.590808:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997417728 00010000:00010000:2.0:1788891121.590819:0:17094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250857dea00/0xa66601b03fd540ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd540a7 expref: 25 pid: 17102 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891121.590831:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788891121.590837:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189d2e4e-bf9f-4645-ba04-f80564b97077+25:3627:x1875787997417600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891121.590846:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891121.590851:0:17094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff924f82310c00/0xa66601b03fd540bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd540b5 expref: 25 pid: 17104 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.590870:0:17094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff924f82310c00/0xa66601b03fd540bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd540b5 expref: 25 pid: 17104 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.590887:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891121.590914:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189d2e4e-bf9f-4645-ba04-f80564b97077+25:3627:x1875787997417600:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891121.590921:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788891121.590933:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788891121.590939:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189d2e4e-bf9f-4645-ba04-f80564b97077+24:3627:x1875787997417728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891121.590946:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891121.590950:0:17094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250857dea00/0xa66601b03fd540ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd540a7 expref: 24 pid: 17102 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.590958:0:17094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250857dea00/0xa66601b03fd540ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd540a7 expref: 24 pid: 17102 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.590970:0:17094:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9250baae4800/0xa66601b03fd541f7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.590989:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae4800/0xa66601b03fd541f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788891121.591001:0:17094:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010550113s 00010000:00010000:2.0:1788891121.591005:0:17094:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250baae4800/0xa66601b03fd541f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.591012:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250baae4800/0xa66601b03fd541f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.591027:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9250baae4800/0xa66601b03fd541f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.591033:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9250baae4800/0xa66601b03fd541f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.591037:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891121.591041:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9250baae4800/0xa66601b03fd541f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.591047:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9250baae4800/0xa66601b03fd541f7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.591055:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9250baae4800/0xa66601b03fd541f7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891121.591064:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891121.591085:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189d2e4e-bf9f-4645-ba04-f80564b97077+24:3627:x1875787997417728:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891121.591091:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788891121.591126:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997417728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891121.591134:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997417600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891121.591164:0:19430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83890e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:189d2e4e-bf9f-4645-ba04-f80564b97077:19430:1875787997417216:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788891121.591174:0:19430:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788891121.591177:0:19430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788891121.591179:0:19430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788891121.591180:0:19430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788891121.591186:0:19430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788891121.591187:0:19430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788891121.591189:0:19430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788891121.591190:0:19430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788891121.591192:0:19430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788891121.591193:0:19430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788891121.591204:0:19430:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788891121.593031:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924f82310c00/0xa66601b03fd540bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd540b5 expref: 23 pid: 17104 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891121.593051:0:17125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17125:1875787997417344:0@lo:104: 00010000:00010000:1.0:1788891121.593064:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250857dea00/0xa66601b03fd540ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd540a7 expref: 22 pid: 17102 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891121.593071:0:17125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17125:1875787997417472:0@lo:104: 00010000:00010000:1.0:1788891121.593092:0:17125:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9250baae4800/0xa66601b03fd541f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891121.593101:0:17125:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9250baae4800/0xa66601b03fd541f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891121.593108:0:17125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9250baae4800/0xa66601b03fd541f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891121.593113:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae4800/0xa66601b03fd541f7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1788891121.600427:0:19430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788891121.603659:0:19430:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788891121.603668:0:19430:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788891121.603707:0:19430:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788891121.603764:0:19430:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788891121.603783:0:19430:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788891121.603801:0:19430:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788891121.604722:0:19430:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788891121.604992:0:19430:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788891121.791617:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997417856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788891121.791689:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891121.791869:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997417856 00000100:00100000:0.0:1788891121.791882:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997417856 00000100:00100000:0.0:1788891121.791933:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788891121.791950:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997417856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788891121.791997:0:17114:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788891121.792060:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997417856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891121.792067:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788891121.792116:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997417856:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1788891122.212678:0:19496:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788891122.212922:0:19496:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788891122.240007:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891122.811841:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788891122.811869:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997417984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788891122.811948:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891122.812042:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997417984 00000100:00100000:0.0:1788891122.812051:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997417984 00000100:00100000:0.0:1788891122.812116:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788891122.812128:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997417984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788891122.812159:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788891122.812205:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997417984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891122.812213:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788891122.812304:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997417984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788891122.812599:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788891122.812608:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997418112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788891122.812636:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891122.812665:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997418112 00000100:00100000:2.0:1788891122.812669:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997418112 00000100:00100000:2.0:1788891122.812693:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788891122.812699:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997418112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788891122.812710:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788891122.812742:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997418112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891122.812762:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788891122.812798:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997418112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788891122.812922:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997418240:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788891122.812951:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891122.813027:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997418240 00000100:00100000:3.0:1788891122.813032:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997418240 00000100:00100000:3.0:1788891122.813068:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788891122.813077:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997418240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788891122.813100:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788891122.813138:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997418240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891122.813152:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788891122.813182:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997418240:0@lo:41:osp-pre-1-0.0 10000000:01000000:3.0:1788891123.196918:0:17106:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788891123.196926:0:17106:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9250c12df800 from 10 10000000:01000000:3.0:1788891123.196931:0:17106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788891123.196990:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd541fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891123.197001:0:17106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd541fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891123.197013:0:17106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd541fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891123.197039:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997418368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788891123.197110:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891123.197171:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82263480 going to sleep for 11 seconds 00000100:00100000:2.0:1788891123.197436:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997418368 00000100:00100000:2.0:1788891123.197445:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997418368 00000100:00100000:3.0:1788891123.197555:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788891123.197617:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+22:17106:x1875787997418368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788891123.197631:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891123.197645:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8ba00/0xa66601b03fd54205 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd541fe expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891123.197667:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8ba00/0xa66601b03fd54205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd541fe expref: 23 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891123.197677:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8ba00/0xa66601b03fd54205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd541fe expref: 23 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891123.197700:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8ba00, rc 0) 00000100:00100000:3.0:1788891123.197741:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+23:17106:x1875787997418368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891123.201621:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997418368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891123.201648:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd541fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54205 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891123.201662:0:17106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd541fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54205 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891123.201747:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997418496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788891123.201823:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891123.201864:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff925095fc6900 going to sleep for 11 seconds 00000100:00100000:1.0:1788891123.201901:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997418496 00000100:00100000:1.0:1788891123.201909:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997418496 00000100:00100000:3.0:1788891123.203460:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788891123.204030:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788891123.204040:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+23:17106:x1875787997418496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788891123.204062:0:17102:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788891123.204084:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788891123.204087:0:17102:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788891123.204201:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+23:17106:x1875787997418496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 162us (2377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891123.204207:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788891123.204300:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997418496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788891123.204395:0:17106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788891123.204406:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd541fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54205 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891123.204418:0:17106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd541fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54205 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891123.204430:0:17106:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788891123.204433:0:17106:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff924f839d2800 from 10 10000000:01000000:2.0:1788891123.204441:0:17106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788891123.204474:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82310e00/0xa66601b03fd5420c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891123.204482:0:17106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff924f82310e00/0xa66601b03fd5420c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891123.204491:0:17106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff924f82310e00/0xa66601b03fd5420c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891123.204511:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997418624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788891123.204596:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891123.204628:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff925081254780 going to sleep for 11 seconds 00000100:00100000:1.0:1788891123.204666:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997418624 00000100:00100000:1.0:1788891123.204672:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997418624 00000100:00100000:1.0:1788891123.204701:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788891123.204708:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+23:17106:x1875787997418624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891123.204716:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891123.204728:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250857de200/0xa66601b03fd54213 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd5420c expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891123.204749:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250857de200/0xa66601b03fd54213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd5420c expref: 24 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891123.204758:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250857de200/0xa66601b03fd54213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd5420c expref: 24 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891123.204768:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857de200, rc 0) 00000100:00100000:1.0:1788891123.204859:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+24:17106:x1875787997418624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891123.204865:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788891123.207157:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997418624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891123.207188:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff924f82310e00/0xa66601b03fd5420c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54213 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891123.207202:0:17106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff924f82310e00/0xa66601b03fd5420c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54213 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891123.207281:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997418752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788891123.207349:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891123.207459:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff925081254780 going to sleep for 11 seconds 00000100:00100000:0.0:1788891123.207508:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997418752 00000100:00100000:0.0:1788891123.207516:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997418752 00000100:00100000:0.0:1788891123.207671:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788891123.207681:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+24:17106:x1875787997418752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788891123.207704:0:17102:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788891123.207724:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788891123.207728:0:17102:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788891123.207831:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+24:17106:x1875787997418752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 150us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891123.207840:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788891123.207849:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83891c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997418752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788891123.207930:0:17106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788891123.207939:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82310e00/0xa66601b03fd5420c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54213 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891123.207962:0:17106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff924f82310e00/0xa66601b03fd5420c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54213 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891123.262001:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788891123.774126:0:17861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788891124.283762:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788891124.607864:0:17147:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788891125.309403:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788891125.841918:0:19786:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788891126.332687:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788891126.522671:0:19838:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788891126.522955:0:19838:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788891126.907796:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788891126.907822:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997418880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788891126.907900:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891126.908202:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997418880 00000100:00100000:2.0:1788891126.908210:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997418880 00000100:00100000:2.0:1788891126.908254:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788891126.908272:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997418880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788891126.908309:0:17934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788891126.908355:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997418880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891126.908362:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788891126.909420:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997418880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788891126.909708:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788891126.909719:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997419008:0@lo:400:kworker.0 00000100:00080000:0.0:1788891126.909726:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891126.909736:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788891126.909738:0:467:0:(import.c:65:import_set_state_nolock()) ffff9250ba96f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891126.909746:0:467:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9250ba96f000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891126.909769:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891126.909769:0:467:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f84294000 x1875787997419392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788891126.909797:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891126.909800:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788891126.909802:0:467:0:(import.c:65:import_set_state_nolock()) ffff925086eaf800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788891126.909803:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997419520:0@lo:400:kworker.0 00000100:00080000:0.0:1788891126.909806:0:467:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff925086eaf800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891126.909815:0:467:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f84294e00 x1875787997419776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788891126.909827:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891126.909847:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997420160:0@lo:400:kworker.0 00000100:00100000:0.0:1788891126.909862:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997419136:0@lo:400:kworker.0 00000100:00100000:0.0:1788891126.909904:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891126.909925:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997419904:0@lo:400:kworker.0 00000100:00100000:0.0:1788891126.909950:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997419392:0@lo:8:kworker.0 00000100:00100000:1.0:1788891126.909957:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891126.909975:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891126.909984:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788891126.909989:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997419648:0@lo:400:kworker.0 00000100:00100000:0.0:1788891126.909989:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997419776:0@lo:8:kworker.0 00000100:00100000:0.0:1788891126.910008:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891126.910018:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997419008 00000100:00100000:1.0:1788891126.910023:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997419008 00000100:00100000:0.0:1788891126.910036:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997419136 00000100:00100000:0.0:1788891126.910039:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997419136 00000100:00100000:0.0:1788891126.910070:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788891126.910078:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997419136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891126.910115:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788891126.910118:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997419136:12345-0@lo:400:kworker.0 Request processed in 41us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891126.910122:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+24:3629:x1875787997419008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891126.910132:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788891126.910149:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+24:3629:x1875787997419008:12345-0@lo:400:kworker.0 Request processed in 28us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891126.910152:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997419392 00000100:00100000:1.0:1788891126.910154:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788891126.910155:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997419392 00000100:00100000:0.0:1788891126.910170:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997419776 00000100:00100000:0.0:1788891126.910173:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997419776 00000100:00100000:0.0:1788891126.910187:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788891126.910188:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891126.910191:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3626:x1875787997419392:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788891126.910205:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997420416:0@lo:400:kworker.0 00010000:00080000:0.0:1788891126.910215:0:18615:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 349 last 0 00000100:00100000:1.0:1788891126.910229:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788891126.910245:0:18615:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd5421a 00000100:00100000:1.0:1788891126.910254:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997419136:0@lo:400:kworker.0 00002000:00100000:0.0:1788891126.910258:0:18615:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff924f81ec8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788891126.910262:0:18615:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:1.0:1788891126.910264:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00002000:00100000:0.0:1788891126.910264:0:18615:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788891126.910269:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997419264:0@lo:400:kworker.0 00000100:00100000:1.0:1788891126.910290:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891126.910300:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997420032:0@lo:400:kworker.0 00000100:00100000:1.0:1788891126.910316:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891126.910340:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891126.910350:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997420288:0@lo:400:kworker.0 00000100:00100000:1.0:1788891126.910371:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891126.910385:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997419008:0@lo:400:kworker.0 00000100:00100000:1.0:1788891126.910409:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997419264 00000100:00100000:1.0:1788891126.910412:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997419264 00002000:00080000:0.0:1788891126.910437:0:18615:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788891126.910458:0:18615:0:(import.c:65:import_set_state_nolock()) ffff924f81ec9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788891126.910496:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1875787997419392:12345-0@lo:8:kworker.0 Request processed in 303us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891126.910503:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788891126.910513:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997419648 00000100:00100000:0.0:1788891126.910516:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997419648 00000100:00100000:1.0:1788891126.910545:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788891126.910568:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997419264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891126.910605:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997419264:12345-0@lo:400:kworker.0 Request processed in 53us (314us total) trans 0 rc 0/0 00000100:00080000:3.0:1788891126.910608:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788891126.910612:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788891126.910687:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788891126.910694:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997419648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891126.910700:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997419520 00000100:00100000:2.0:1788891126.910703:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997419520 00000100:00100000:2.0:1788891126.910721:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997420160 00000100:00100000:2.0:1788891126.910724:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997420160 00000100:00100000:1.0:1788891126.910733:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997419648:12345-0@lo:400:kworker.0 Request processed in 41us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891126.910739:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997419904 00000100:00100000:2.0:1788891126.910741:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997419904 00000100:00100000:2.0:1788891126.910748:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997420416 00000100:00100000:2.0:1788891126.910750:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997420416 00000100:00100000:2.0:1788891126.910758:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997420032 00000100:00100000:2.0:1788891126.910760:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997420032 00000100:00100000:2.0:1788891126.910768:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997420288 00000100:00100000:2.0:1788891126.910769:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997420288 00000100:00100000:2.0:1788891126.910779:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788891126.910784:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997419520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891126.910812:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997419520:12345-0@lo:400:kworker.0 Request processed in 28us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891126.910818:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788891126.910827:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788891126.910832:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997420160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891126.910850:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997420160:12345-0@lo:400:kworker.0 Request processed in 19us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891126.910855:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788891126.910862:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788891126.910866:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997419904:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788891126.910902:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788891126.910905:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788891126.910927:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997419648:0@lo:400:kworker.0 00010000:00080000:3.0:1788891126.910938:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84297800 x1875787997420160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891126.910947:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997420160:0@lo:400:kworker.0 00010000:00080000:3.0:1788891126.910970:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84296d80 x1875787997419520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891126.910979:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997419520:0@lo:400:kworker.0 00000100:00100000:0.0:1788891126.911024:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788891126.911030:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3626:x1875787997419776:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788891126.911048:0:18615:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 349 last 0 00000020:00000080:0.0:1788891126.911066:0:18615:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd54221 00002000:00100000:0.0:1788891126.911073:0:18615:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff924f81ece800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788891126.911076:0:18615:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788891126.911078:0:18615:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788891126.911112:0:18615:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788891126.911126:0:18615:0:(import.c:65:import_set_state_nolock()) ffff924f81ecb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788891126.911155:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3626:x1875787997419776:12345-0@lo:8:kworker.0 Request processed in 125us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891126.911162:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788891126.911189:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788891126.911195:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997420416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891126.911223:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1875787997420416:12345-0@lo:400:kworker.0 Request processed in 28us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891126.911229:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788891126.911239:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788891126.911245:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997420032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891126.911268:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997420032:12345-0@lo:400:kworker.0 Request processed in 24us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891126.911274:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788891126.911285:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788891126.911290:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997420288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891126.911369:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997420288:12345-0@lo:400:kworker.0 Request processed in 78us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891126.911376:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788891126.911402:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84294000 x1875787997419392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788891151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788891126.911414:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788891126.911421:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788891126.911426:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788891126.911429:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250ba96f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788891126.911448:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788891126.911454:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997419392:0@lo:8:kworker.0 00010000:00080000:0.0:1788891126.911468:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84294e00 x1875787997419776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788891151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788891126.911477:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788891126.911481:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788891126.911484:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788891126.911486:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925086eaf800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788891126.911499:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788891126.911502:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997419776:0@lo:8:kworker.0 00000004:00080000:0.0:1788891126.911545:0:17135:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788891126.911609:0:17135:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 349156085231ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788891126.911616:0:17135:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788891126.911826:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997419264:0@lo:400:kworker.0 00010000:00080000:0.0:1788891126.911841:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84297480 x1875787997420032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891126.911850:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997420032:0@lo:400:kworker.0 00010000:00080000:0.0:1788891126.911862:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84295880 x1875787997420416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891126.911869:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997420416:0@lo:400:kworker.0 00000004:00080000:0.0:1788891126.911909:0:17851:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788891126.911952:0:17851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 349156428686ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788891126.911957:0:17851:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788891126.912333:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997419904:12345-0@lo:400:kworker.0 Request processed in 1465us (2142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891126.912339:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788891126.912344:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000004:00080000:2.0:1788891126.912411:0:17852:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788891126.912432:0:17852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83890e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17852:1875787997420672:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788891126.912464:0:17852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891126.912487:0:17852:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8324d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788891126.912507:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997420672 00000100:00100000:1.0:1788891126.912514:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997420672 00000100:00100000:1.0:1788891126.912574:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788891126.912582:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17852:x1875787997420672:12345-0@lo:7:osp-pre-1-1.0 00010000:00080000:0.0:1788891126.913967:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84297100 x1875787997419904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891126.914010:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997419904:0@lo:400:kworker.0 00002000:00080000:1.0:1788891126.914029:0:18615:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00000100:00100000:0.0:1788891126.914034:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00002000:00080000:1.0:1788891126.914035:0:18615:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788891126.914045:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997420544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788891126.914093:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891126.914149:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997420544 00000100:00100000:0.0:1788891126.914154:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997420544 00000100:00100000:0.0:1788891126.914187:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788891126.914195:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3627:x1875787997420544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788891126.914218:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788891126.914257:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3627:x1875787997420544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891126.914264:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788891126.914315:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83891c00 x1875787997420544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891126.914329:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997420544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788891126.914466:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17852:x1875787997420672:12345-0@lo:7:osp-pre-1-1.0 Request processed in 1883us (1999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891126.914476:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788891126.914514:0:17852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83890e00 x1875787997420672/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788891142 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891126.914630:0:17852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83890e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17852:1875787997420672:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788891126.914643:0:17852:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788891126.914672:0:17852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83adf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17852:1875787997420800:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788891126.914699:0:17852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891126.914716:0:17852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c0a18840 going to sleep for 11 seconds 00000100:00100000:1.0:1788891126.914730:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997420800 00000100:00100000:1.0:1788891126.914734:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997420800 00000100:00100000:1.0:1788891126.914762:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788891126.914771:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17852:x1875787997420800:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788891126.914793:0:18616:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788891126.914830:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17852:x1875787997420800:12345-0@lo:5:osp-pre-1-1.0 Request processed in 60us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891126.914836:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1788891126.914909:0:17089:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:1.0:1788891126.914929:0:17852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83adf480 x1875787997420800/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788891142 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891126.914939:0:17852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83adf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17852:1875787997420800:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788891126.914950:0:17852:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788891126.914977:0:17852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83adf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17852:1875787997420928:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788891126.915004:0:17852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891126.915024:0:17852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c0a18840 going to sleep for 11 seconds 00000100:00100000:1.0:1788891126.915038:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997420928 00000100:00100000:1.0:1788891126.915042:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997420928 00000100:00100000:1.0:1788891126.915186:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788891126.915194:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17852:x1875787997420928:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788891126.915224:0:18720:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00010000:00080000:3.0:1788891126.916890:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84295c00 x1875787997420288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891126.916908:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997420288:0@lo:400:kworker.0 00000004:00080000:3.0:1788891126.916987:0:17136:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1788891126.917010:0:17136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a72300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17136:1875787997421184:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788891126.917079:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891126.917105:0:17136:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82263d80 going to sleep for 11 seconds 00000100:00080000:3.0:1788891126.917137:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788891126.917154:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997421184 00000100:00100000:3.0:1788891126.917161:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997421184 00000100:00100000:3.0:1788891126.917204:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788891126.917212:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17136:x1875787997421184:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:3.0:1788891126.917362:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788891126.917404:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788891126.917417:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997421056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788891126.917483:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891126.917557:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997421056 00000100:00100000:2.0:1788891126.917561:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997421056 00000100:00100000:2.0:1788891126.917593:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788891126.917600:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3630:x1875787997421056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788891126.917616:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788891126.917659:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3630:x1875787997421056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891126.917666:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788891126.917699:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83a70380 x1875787997421056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891126.917716:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997421056:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1788891126.918432:0:17841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:1.0:1788891126.919456:0:18616:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788891126.919466:0:18616:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788891126.919472:0:18616:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00010000:3.0:1788891126.933679:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788891126.933694:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f842df50/0xa66601b03fd54228 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.933713:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=349s v=(0 0) 00010000:00010000:3.0:1788891126.933718:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891126.933726:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f842df50/0xa66601b03fd54228 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.933760:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f842df50/0xa66601b03fd54228 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.933772:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f842df50/0xa66601b03fd54228 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.933780:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f842df50/0xa66601b03fd54228 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.933806:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891126.933906:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891126.933915:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f842df50/0xa66601b03fd54228 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.933925:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891126.933930:0:19132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f842df50/0xa66601b03fd54228 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.933939:0:19132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f842df50/0xa66601b03fd54228 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.933962:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f842df50/0xa66601b03fd54228 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.933969:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f842df50/0xa66601b03fd54228 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.933986:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891126.933988:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891126.933990:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788891126.934435:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788891126.934448:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023b38f42/0xa66601b03fd5422f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.934485:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=349s v=(0 0) 00010000:00010000:3.0:1788891126.934489:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891126.934493:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023b38f42/0xa66601b03fd5422f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.934502:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023b38f42/0xa66601b03fd5422f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.934509:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023b38f42/0xa66601b03fd5422f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.934546:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023b38f42/0xa66601b03fd5422f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.934562:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891126.934577:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891126.934583:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023b38f42/0xa66601b03fd5422f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.934602:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8bc00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891126.934606:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023b38f42/0xa66601b03fd5422f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.934615:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023b38f42/0xa66601b03fd5422f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.934629:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023b38f42/0xa66601b03fd5422f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.934637:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023b38f42/0xa66601b03fd5422f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.934656:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891126.934658:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891126.934659:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788891126.935568:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788891126.935577:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd54236 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.935590:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=349s v=(0 0) 00010000:00010000:3.0:1788891126.935595:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891126.935600:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd54236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.935611:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd54236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.935620:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd54236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.935627:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd54236 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.935759:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891126.935913:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891126.935920:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd54236 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.935928:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891126.935933:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd54236 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.935941:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd54236 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.935962:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd54236 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.935970:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd54236 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.935984:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891126.935986:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891126.935988:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788891126.937596:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788891126.937609:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d16bf654/0xa66601b03fd5423d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.937631:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=349s v=(0 0) 00010000:00010000:3.0:1788891126.937635:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891126.937641:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d16bf654/0xa66601b03fd5423d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.937654:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d16bf654/0xa66601b03fd5423d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.937664:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d16bf654/0xa66601b03fd5423d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.937672:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d16bf654/0xa66601b03fd5423d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.937696:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788891126.939254:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891126.939347:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd54244 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.939361:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1788891126.939373:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891126.939379:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd54244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.939394:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd54244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.939404:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd54244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.939412:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd54244 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.939431:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788891126.939489:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788891126.939497:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d16bf654/0xa66601b03fd5423d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.939507:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8ae00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891126.939513:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d16bf654/0xa66601b03fd5423d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.939541:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d16bf654/0xa66601b03fd5423d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.939572:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d16bf654/0xa66601b03fd5423d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.939580:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d16bf654/0xa66601b03fd5423d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.939596:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891126.939599:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd54244 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.939606:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891126.939609:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd54244 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.939617:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd54244 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.939626:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd54244 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.939634:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd54244 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.939651:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.939652:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.939658:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788891126.940112:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891126.940120:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8992438/0xa66601b03fd5424b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.940130:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1788891126.940134:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891126.940138:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8992438/0xa66601b03fd5424b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.940149:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8992438/0xa66601b03fd5424b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.940158:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8992438/0xa66601b03fd5424b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.940171:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8992438/0xa66601b03fd5424b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.940188:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891126.940382:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891126.940388:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8992438/0xa66601b03fd5424b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.940397:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310a00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891126.940400:0:19132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8992438/0xa66601b03fd5424b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.940409:0:19132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8992438/0xa66601b03fd5424b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.940421:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8992438/0xa66601b03fd5424b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.940427:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8992438/0xa66601b03fd5424b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.940453:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891126.940455:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891126.940457:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891126.940656:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891126.943765:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891126.943778:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54252 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.943795:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1788891126.943801:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891126.943807:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.943837:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.943848:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.943856:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.944481:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891126.945046:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891126.945056:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.945069:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4a00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891126.945074:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.945084:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54252 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.945104:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54252 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.945111:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54252 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.945136:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.945139:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.945142:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891126.945189:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891126.945198:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000962e62b4/0xa66601b03fd54259 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.945210:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1788891126.945214:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891126.945220:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000962e62b4/0xa66601b03fd54259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.945231:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000962e62b4/0xa66601b03fd54259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.945240:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000962e62b4/0xa66601b03fd54259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.945326:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000962e62b4/0xa66601b03fd54259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788891126.945342:0:19431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:0.0:1788891126.945353:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00100000:2.0:1788891126.945364:0:19431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788891126.945371:0:19431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788891126.945471:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891126.945477:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000962e62b4/0xa66601b03fd54259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.945486:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5e00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891126.945489:0:19132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000962e62b4/0xa66601b03fd54259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.945511:0:19132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000962e62b4/0xa66601b03fd54259 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.945546:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000962e62b4/0xa66601b03fd54259 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.945555:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000962e62b4/0xa66601b03fd54259 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.945574:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.945576:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.945578:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891126.945726:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17852:x1875787997420928:12345-0@lo:5:osp-pre-1-1.0 Request processed in 30529us (30718us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788891126.945737:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00002000:00010000:0.0:1788891126.946124:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891126.946130:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54260 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.946140:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1788891126.946143:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891126.946148:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.946157:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.946165:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.946257:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.946280:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788891126.946560:0:17852:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788891126.946570:0:17852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83adf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17852:1875787997420928:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788891126.946584:0:17852:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788891126.946633:0:17852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83164a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17852:1875787997421312:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1788891126.946674:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891126.946682:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891126.946682:0:17852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788891126.946693:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5400 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891126.946698:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.946706:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54260 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891126.946712:0:17852:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8324d540 going to sleep for 11 seconds 00010000:00010000:3.0:1788891126.946736:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54260 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891126.946739:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997421312 00010000:00010000:3.0:1788891126.946747:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54260 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891126.946747:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997421312 00010000:00010000:3.0:1788891126.946767:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.946769:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.946770:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891126.946803:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788891126.946812:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17852:x1875787997421312:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788891126.946959:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17852:x1875787997421312:12345-0@lo:900:osp-pre-1-1.0 Request processed in 146us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891126.946966:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:2.0:1788891126.947798:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891126.947808:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd54267 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.947834:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1788891126.947838:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891126.947844:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd54267 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.947858:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd54267 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.947866:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd54267 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.947887:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd54267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.947914:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891126.947951:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891126.947958:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd54267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.947967:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310000 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891126.947971:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd54267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.947979:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd54267 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.947995:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd54267 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.948003:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd54267 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.948036:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.948038:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.948040:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788891126.948149:0:17852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83164a80 x1875787997421312/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788891142 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891126.948174:0:17852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83164a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17852:1875787997421312:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1788891126.948289:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891126.948295:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd5426e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.948304:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1788891126.948307:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891126.948311:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd5426e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.948320:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd5426e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.948341:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd5426e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.948349:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd5426e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.948364:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891126.948388:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891126.948395:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd5426e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.948402:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311c00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891126.948406:0:19132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd5426e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.948415:0:19132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd5426e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.948427:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd5426e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.948435:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd5426e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.948451:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.948453:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.948454:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891126.949169:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891126.949179:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000240a7091/0xa66601b03fd54275 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.949193:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1788891126.949197:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891126.949202:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000240a7091/0xa66601b03fd54275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.949212:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000240a7091/0xa66601b03fd54275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.949220:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000240a7091/0xa66601b03fd54275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.949227:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000240a7091/0xa66601b03fd54275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.949252:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891126.949290:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891126.949296:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000240a7091/0xa66601b03fd54275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.949317:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5c00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891126.949322:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000240a7091/0xa66601b03fd54275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.949331:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000240a7091/0xa66601b03fd54275 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.949344:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000240a7091/0xa66601b03fd54275 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.949351:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000240a7091/0xa66601b03fd54275 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.949366:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.949369:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.949371:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891126.950307:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891126.950318:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e1c1a04/0xa66601b03fd5427c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.950332:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1788891126.950344:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891126.950350:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e1c1a04/0xa66601b03fd5427c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.950368:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e1c1a04/0xa66601b03fd5427c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.950377:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e1c1a04/0xa66601b03fd5427c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.950383:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e1c1a04/0xa66601b03fd5427c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.950406:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891126.950617:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891126.950623:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e1c1a04/0xa66601b03fd5427c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.950632:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891126.950635:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e1c1a04/0xa66601b03fd5427c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.950643:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e1c1a04/0xa66601b03fd5427c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.950662:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e1c1a04/0xa66601b03fd5427c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.950669:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e1c1a04/0xa66601b03fd5427c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.950684:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.950686:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.950688:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891126.951633:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891126.951644:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd54283 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.951656:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1788891126.951661:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891126.951667:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd54283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.951679:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd54283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.951688:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd54283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.951705:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd54283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.952388:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891126.952799:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891126.952807:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd54283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.952818:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891126.952827:0:19132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd54283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.952838:0:19132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd54283 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.952860:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd54283 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.952868:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bfd576d/0xa66601b03fd54283 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.952914:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.952916:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.952918:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891126.954920:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891126.954933:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d33c723/0xa66601b03fd5428a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.954947:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1788891126.954950:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891126.954956:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d33c723/0xa66601b03fd5428a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.954969:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d33c723/0xa66601b03fd5428a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.954985:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d33c723/0xa66601b03fd5428a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.954992:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d33c723/0xa66601b03fd5428a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.955008:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891126.957005:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891126.957016:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d33c723/0xa66601b03fd5428a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.957029:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5a00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891126.957033:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d33c723/0xa66601b03fd5428a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.957044:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d33c723/0xa66601b03fd5428a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.957064:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d33c723/0xa66601b03fd5428a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.957072:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d33c723/0xa66601b03fd5428a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891126.957090:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.957092:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891126.957094:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788891126.960157:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891126.960173:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de573d19/0xa66601b03fd54291 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.960189:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1788891126.960193:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891126.960200:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de573d19/0xa66601b03fd54291 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.960214:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de573d19/0xa66601b03fd54291 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.960225:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de573d19/0xa66601b03fd54291 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.960232:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de573d19/0xa66601b03fd54291 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.960276:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891126.960505:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891126.960513:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de573d19/0xa66601b03fd54291 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.960550:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310c00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891126.960555:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de573d19/0xa66601b03fd54291 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.960564:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de573d19/0xa66601b03fd54291 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.960583:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de573d19/0xa66601b03fd54291 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.960591:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de573d19/0xa66601b03fd54291 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.960609:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891126.960610:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891126.960612:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788891126.961120:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891126.961128:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd54298 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.961140:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1788891126.961144:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891126.961149:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd54298 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.961160:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd54298 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.961170:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd54298 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.961178:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd54298 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.961204:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891126.961493:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891126.961500:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd54298 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.961515:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311c00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891126.961545:0:19132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd54298 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.961555:0:19132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd54298 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.961572:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd54298 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.961579:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070dbd957/0xa66601b03fd54298 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.961605:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891126.961608:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891126.961611:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788891126.963203:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891126.963216:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5429f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.963229:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1788891126.963245:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891126.963252:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5429f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.963265:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5429f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.963274:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5429f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.963282:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5429f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.963313:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891126.963564:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891126.963572:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5429f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.963581:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310000 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891126.963586:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5429f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.963594:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5429f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.963620:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5429f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.963627:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b062e06f/0xa66601b03fd5429f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.963655:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891126.963658:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891126.963661:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788891126.963821:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891126.963829:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd542a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.963840:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1788891126.963843:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891126.963848:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd542a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.963859:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd542a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.963868:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd542a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.963894:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd542a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.963916:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891126.964102:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891126.964108:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd542a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.964116:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891126.964119:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd542a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.964127:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd542a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.964138:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd542a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.964145:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036c6dfa2/0xa66601b03fd542a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.964167:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891126.964169:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891126.964171:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788891126.964837:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788891126.964844:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd542ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.964855:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1788891126.964859:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891126.964864:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd542ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.964884:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd542ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.964893:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd542ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.964900:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd542ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.964921:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891126.965119:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891126.965125:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd542ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.965134:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857dea00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891126.965138:0:19132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd542ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.965147:0:19132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd542ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.965162:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd542ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.965170:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c06a6dc8/0xa66601b03fd542ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.965186:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891126.965188:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891126.965190:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788891126.965346:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788891126.965353:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065662109/0xa66601b03fd542b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.965374:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1788891126.965377:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891126.965381:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065662109/0xa66601b03fd542b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.965391:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065662109/0xa66601b03fd542b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.965400:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065662109/0xa66601b03fd542b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.965406:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065662109/0xa66601b03fd542b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.965430:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891126.965503:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891126.965510:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065662109/0xa66601b03fd542b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.965629:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891126.965634:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065662109/0xa66601b03fd542b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.965642:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065662109/0xa66601b03fd542b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.965656:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065662109/0xa66601b03fd542b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.965663:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065662109/0xa66601b03fd542b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.965676:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891126.965677:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891126.965679:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788891126.965891:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788891126.965898:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ef9117c/0xa66601b03fd542bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.965906:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1788891126.965909:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891126.965914:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ef9117c/0xa66601b03fd542bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.965922:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ef9117c/0xa66601b03fd542bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.965941:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ef9117c/0xa66601b03fd542bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.965948:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ef9117c/0xa66601b03fd542bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.965967:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891126.966138:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891126.966144:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ef9117c/0xa66601b03fd542bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.966153:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857dfc00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891126.966157:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ef9117c/0xa66601b03fd542bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.966165:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ef9117c/0xa66601b03fd542bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.966187:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ef9117c/0xa66601b03fd542bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.966195:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ef9117c/0xa66601b03fd542bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.966212:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891126.966214:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891126.966216:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788891126.966350:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788891126.966356:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3c51e0e/0xa66601b03fd542c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.966365:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1788891126.966368:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891126.966372:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3c51e0e/0xa66601b03fd542c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.966382:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3c51e0e/0xa66601b03fd542c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.966389:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3c51e0e/0xa66601b03fd542c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.966396:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3c51e0e/0xa66601b03fd542c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.966429:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891126.966783:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891126.966790:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3c51e0e/0xa66601b03fd542c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.966798:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df000 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891126.966801:0:19132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3c51e0e/0xa66601b03fd542c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.966808:0:19132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3c51e0e/0xa66601b03fd542c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.966821:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3c51e0e/0xa66601b03fd542c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.966829:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3c51e0e/0xa66601b03fd542c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.966858:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891126.966861:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891126.966863:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891126.966988:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891126.966996:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b8cf9cc/0xa66601b03fd542c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.967012:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1788891126.967016:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891126.967021:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b8cf9cc/0xa66601b03fd542c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.967032:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b8cf9cc/0xa66601b03fd542c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.967040:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b8cf9cc/0xa66601b03fd542c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.967048:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b8cf9cc/0xa66601b03fd542c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.967072:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891126.967229:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891126.967235:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b8cf9cc/0xa66601b03fd542c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.967243:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891126.967246:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b8cf9cc/0xa66601b03fd542c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.967254:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b8cf9cc/0xa66601b03fd542c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.967268:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b8cf9cc/0xa66601b03fd542c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.967275:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b8cf9cc/0xa66601b03fd542c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.967289:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891126.967291:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891126.967292:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891126.967385:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891126.967391:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083c20464/0xa66601b03fd542d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.967400:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1788891126.967403:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891126.967407:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083c20464/0xa66601b03fd542d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.967417:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083c20464/0xa66601b03fd542d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.967436:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083c20464/0xa66601b03fd542d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.967444:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083c20464/0xa66601b03fd542d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.967463:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891126.967564:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891126.967570:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083c20464/0xa66601b03fd542d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.967578:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891126.967582:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083c20464/0xa66601b03fd542d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.967591:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083c20464/0xa66601b03fd542d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.967603:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083c20464/0xa66601b03fd542d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.967610:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083c20464/0xa66601b03fd542d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.967624:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891126.967625:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891126.967627:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891126.967946:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891126.967952:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd542d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.967961:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1788891126.967964:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891126.967968:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd542d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.967977:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd542d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.967984:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd542d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.967993:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd542d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891126.968024:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891126.968074:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891126.969193:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd542d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.969217:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4c00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891126.969222:0:19132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd542d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.969232:0:19132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd542d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.969253:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd542d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.969260:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c8531f2/0xa66601b03fd542d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.969281:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891126.969284:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891126.969286:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788891126.970501:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788891126.970512:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b8498f6/0xa66601b03fd542de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.970628:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1788891126.970640:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891126.970647:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b8498f6/0xa66601b03fd542de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.970662:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b8498f6/0xa66601b03fd542de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.970672:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b8498f6/0xa66601b03fd542de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.970678:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b8498f6/0xa66601b03fd542de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.973602:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891126.973794:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891126.973804:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b8498f6/0xa66601b03fd542de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.973818:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857dfa00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891126.973823:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b8498f6/0xa66601b03fd542de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.973836:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b8498f6/0xa66601b03fd542de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.973865:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b8498f6/0xa66601b03fd542de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.973885:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b8498f6/0xa66601b03fd542de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.973909:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891126.973910:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891126.973913:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788891126.974661:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788891126.974671:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6a1aecc/0xa66601b03fd542e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.974685:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1788891126.974689:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891126.974696:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6a1aecc/0xa66601b03fd542e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.974708:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6a1aecc/0xa66601b03fd542e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.974717:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6a1aecc/0xa66601b03fd542e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.974730:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6a1aecc/0xa66601b03fd542e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891126.974756:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788891126.974805:0:18616:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00010000:00010000:2.0:1788891126.974961:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891126.974967:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6a1aecc/0xa66601b03fd542e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.974975:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891126.974978:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6a1aecc/0xa66601b03fd542e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.974987:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6a1aecc/0xa66601b03fd542e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.975000:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6a1aecc/0xa66601b03fd542e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.975008:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6a1aecc/0xa66601b03fd542e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891126.975036:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891126.975038:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891126.975039:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891126.975088:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17136:x1875787997421184:12345-0@lo:5:osp-pre-1-0.0 Request processed in 57873us (58005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891126.975098:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788891126.976221:0:17136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a72300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17136:1875787997421184:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788891126.976240:0:17136:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1788891126.976291:0:17136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17136:1875787997421440:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788891126.976339:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891126.976375:0:17136:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250989a0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788891126.976486:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997421440 00000100:00100000:3.0:1788891126.976493:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997421440 00000100:00100000:3.0:1788891126.976678:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788891126.976693:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17136:x1875787997421440:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788891126.976729:0:18613:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:3.0:1788891126.980417:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17136:x1875787997421440:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3714us (4065us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788891126.980431:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788891126.980620:0:17136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17136:1875787997421440:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788891126.980641:0:17136:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000020:00000004:0.0:1788891127.163857:0:19889:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788891127.164102:0:19889:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788891127.338089:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891127.338427:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987922944 00000100:00100000:0.0:1788891127.338439:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987922944 00000100:00100000:0.0:1788891127.338491:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 112 00000100:00100000:0.0:1788891127.338499:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2390:x1875787987922944:12345-192.168.204.26@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788891127.338557:0:17102:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from e08b9a10-102a-4021-bba3-9abf67ad4662@192.168.204.26@tcp t0 exp 0000000000000000 cur 349 last 0 00000020:00000080:0.0:1788891127.338586:0:17102:0:(genops.c:1385:class_connect()) connect: client e08b9a10-102a-4021-bba3-9abf67ad4662, cookie 0xa66601b03fd542ec 00000100:00080000:2.0:1788891127.338879:0:17102:0:(import.c:65:import_set_state_nolock()) ffff924f823b4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788891127.338981:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+5:2390:x1875787987922944:12345-192.168.204.26@tcp:250:mount.lustre.0 Request processed in 480us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891127.338994:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 112 00000100:00100000:0.0:1788891127.345024:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891127.345140:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987923072 00000100:00100000:2.0:1788891127.345151:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987923072 00000100:00100000:2.0:1788891127.345215:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 113 00000100:00100000:2.0:1788891127.345226:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+5:14856:x1875787987923072:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788891127.345244:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891127.345264:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924f82310a00/0xa66601b03fd542f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204de1c4 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891127.345319:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924f82310a00/0xa66601b03fd542f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de1c4 expref: 6 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891127.345332:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924f82310a00/0xa66601b03fd542f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de1c4 expref: 6 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891127.345342:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310a00, rc 0) 00000100:00100000:2.0:1788891127.345404:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+6:14856:x1875787987923072:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 180us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891127.345418:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 113 00000100:00100000:3.0:1788891127.349404:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891127.349558:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987923200 00000100:00100000:2.0:1788891127.349569:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987923200 00000100:00100000:2.0:1788891127.349637:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 114 00000100:00100000:2.0:1788891127.349648:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+6:14856:x1875787987923200:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788891127.349785:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+6:14856:x1875787987923200:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 137us (393us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788891127.349794:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 114 00010000:00010000:2.0:1788891127.355781:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891127.356437:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891127.356669:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987923328 00000100:00100000:1.0:1788891127.356680:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987923328 00000100:00100000:1.0:1788891127.356726:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 115 00000100:00100000:1.0:1788891127.356736:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+6:14856:x1875787987923328:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788891127.356753:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891127.356771:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250857df800/0xa66601b03fd542fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204de1cb expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891127.356800:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250857df800/0xa66601b03fd542fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de1cb expref: 7 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891127.356811:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250857df800/0xa66601b03fd542fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de1cb expref: 7 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891127.356821:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857df800, rc 0) 00000100:00100000:1.0:1788891127.356888:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+7:14856:x1875787987923328:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 154us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891127.356895:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 115 00000100:00100000:1.0:1788891127.360087:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891127.360197:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987923456 00000100:00100000:2.0:1788891127.360210:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987923456 00000100:00100000:2.0:1788891127.360282:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 116 00000100:00100000:2.0:1788891127.360293:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+7:14856:x1875787987923456:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788891127.360472:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+8:14856:x1875787987923456:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 181us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891127.360480:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 116 00000100:00100000:3.0:1788891127.363596:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891127.366127:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987923584 00000100:00100000:1.0:1788891127.366143:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987923584 00000100:00100000:1.0:1788891127.366212:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 117 00000100:00100000:1.0:1788891127.366224:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+8:14856:x1875787987923584:12345-192.168.204.26@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788891127.366566:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+8:14856:x1875787987923584:12345-192.168.204.26@tcp:503:mount.lustre.0 Request processed in 342us (2977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891127.366575:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 117 00000100:00100000:3.0:1788891127.373409:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891127.374755:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987923712 00000100:00100000:2.0:1788891127.374767:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987923712 00000100:00100000:2.0:1788891127.374826:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 118 00000100:00100000:2.0:1788891127.374836:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+8:14874:x1875787987923712:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788891127.375042:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+8:14874:x1875787987923712:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 207us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891127.375051:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 118 00000100:00100000:0.0:1788891127.400857:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891127.403061:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987923840 00000100:00100000:1.0:1788891127.403078:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987923840 00000100:00100000:1.0:1788891127.403148:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 119 00000100:00100000:1.0:1788891127.403159:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+8:14874:x1875787987923840:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788891127.403337:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+8:14874:x1875787987923840:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 179us (2490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891127.403345:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 119 00000100:00100000:0.0:1788891127.408769:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891127.410281:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987923968 00000100:00100000:2.0:1788891127.410310:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987923968 00000100:00100000:2.0:1788891127.410595:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 120 00000100:00100000:2.0:1788891127.410605:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+8:14874:x1875787987923968:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788891127.410764:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+8:14874:x1875787987923968:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 158us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891127.410772:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 120 00000100:00100000:3.0:1788891127.412791:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891127.412892:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987924096 00000100:00100000:0.0:1788891127.412900:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987924096 00000100:00100000:0.0:1788891127.413025:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 121 00000100:00100000:0.0:1788891127.413032:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+8:14856:x1875787987924096:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788891127.413062:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891127.413079:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae4000/0xa66601b03fd54301 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204de1fc expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891127.413102:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae4000/0xa66601b03fd54301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de1fc expref: 9 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891127.413109:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae4000/0xa66601b03fd54301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de1fc expref: 9 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891127.413116:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4000, rc 0) 00000100:00100000:0.0:1788891127.413163:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+9:14856:x1875787987924096:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 132us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891127.413167:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 121 00000100:00100000:0.0:1788891127.417006:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891127.419312:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987924224 00000100:00100000:2.0:1788891127.419328:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987924224 00000100:00100000:2.0:1788891127.419407:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 122 00000100:00100000:2.0:1788891127.419418:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+9:14856:x1875787987924224:12345-192.168.204.26@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788891127.419445:0:17102:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788891127.419482:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788891127.419486:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788891127.419490:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788891127.419492:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788891127.419495:0:17102:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788891127.422648:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+9:14856:x1875787987924224:12345-192.168.204.26@tcp:256:mount.lustre.0 Request processed in 3220us (5640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891127.422663:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 122 00000100:00100000:3.0:1788891127.427406:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891127.427597:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987924352 00000100:00100000:0.0:1788891127.427607:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987924352 00000100:00100000:0.0:1788891127.427659:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 123 00000100:00100000:0.0:1788891127.427668:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+9:14856:x1875787987924352:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788891127.427684:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891127.427702:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae4600/0xa66601b03fd54308 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204de203 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891127.427730:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae4600/0xa66601b03fd54308 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de203 expref: 10 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891127.427740:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae4600/0xa66601b03fd54308 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de203 expref: 10 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891127.427880:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4600, rc 0) 00000100:00100000:0.0:1788891127.427945:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+10:14856:x1875787987924352:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 277us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891127.427952:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 123 00000100:00100000:0.0:1788891127.430779:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891127.432114:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987924480 00000100:00100000:1.0:1788891127.432128:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987924480 00000100:00100000:1.0:1788891127.432231:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 124 00000100:00100000:1.0:1788891127.432247:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+10:14856:x1875787987924480:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788891127.432421:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+10:14856:x1875787987924480:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 175us (1652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891127.432430:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 124 00000100:00100000:2.0:1788891127.435904:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891127.436013:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987924608 00000100:00100000:1.0:1788891127.436025:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987924608 00000100:00100000:1.0:1788891127.436082:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 125 00000100:00100000:1.0:1788891127.436093:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+10:14856:x1875787987924608:12345-192.168.204.26@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788891127.438519:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+10:14856:x1875787987924608:12345-192.168.204.26@tcp:503:mount.lustre.0 Request processed in 2416us (2612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891127.438549:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 125 00000100:00100000:3.0:1788891127.442166:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891127.442564:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987924736 00000100:00100000:1.0:1788891127.442575:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987924736 00000100:00100000:1.0:1788891127.442634:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 126 00000100:00100000:1.0:1788891127.442644:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+10:14878:x1875787987924736:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788891127.442817:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+10:14878:x1875787987924736:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 173us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891127.442826:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 126 00000100:00100000:2.0:1788891127.445100:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891127.445234:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987924864 00000100:00100000:1.0:1788891127.445244:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987924864 00000100:00100000:1.0:1788891127.445302:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 127 00000100:00100000:1.0:1788891127.445312:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bab20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+10:14878:x1875787987924864:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788891127.445510:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bab20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+10:14878:x1875787987924864:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 198us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891127.445519:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 127 00000100:00100000:2.0:1788891127.452375:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891127.452487:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891127.452507:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987924992 00000100:00100000:0.0:1788891127.452519:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987924992 00000100:00100000:0.0:1788891127.452600:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987925248 00000100:00100000:0.0:1788891127.452604:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987925248 00000100:00100000:0.0:1788891127.452625:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:0.0:1788891127.452633:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1875787987924992:12345-192.168.204.26@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788891127.452662:0:17109:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 6f09a10f-9224-43a2-a8d4-25920b0f419e@192.168.204.26@tcp t0 exp 0000000000000000 cur 349 last 0 00000100:00100000:2.0:1788891127.452700:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:2.0:1788891127.452708:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1875787987925248:12345-192.168.204.26@tcp:38:mount.lustre.0 00000020:00000080:0.0:1788891127.452711:0:17109:0:(genops.c:1385:class_connect()) connect: client 6f09a10f-9224-43a2-a8d4-25920b0f419e, cookie 0xa66601b03fd5430f 00010000:00080000:2.0:1788891127.452728:0:18639:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from 6f09a10f-9224-43a2-a8d4-25920b0f419e@192.168.204.26@tcp t0 exp 0000000000000000 cur 349 last 0 00000004:00100000:0.0:1788891127.452738:0:17109:0:(mdt_handler.c:7304:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000020:00000080:2.0:1788891127.452769:0:18639:0:(genops.c:1385:class_connect()) connect: client 6f09a10f-9224-43a2-a8d4-25920b0f419e, cookie 0xa66601b03fd54316 00000004:00100000:2.0:1788891127.452785:0:18639:0:(mdt_handler.c:7304:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788891127.453127:0:18639:0:(import.c:65:import_set_state_nolock()) ffff924f823b7800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788891127.453144:0:17109:0:(import.c:65:import_set_state_nolock()) ffff924f81ecf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788891127.453207:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2390:x1875787987924992:12345-192.168.204.26@tcp:38:mount.lustre.0 Request processed in 572us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891127.453215:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:3.0:1788891127.455833:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891127.455876:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891127.455912:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987925504 00000100:00100000:3.0:1788891127.455922:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987925504 00000100:00100000:3.0:1788891127.455981:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987925120 00000100:00100000:3.0:1788891127.455985:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987925120 00000100:00100000:3.0:1788891127.456002:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:3.0:1788891127.456011:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:14856:x1875787987925504:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788891127.456054:0:17110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788891127.456129:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:14856:x1875787987925504:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 118us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891127.456136:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:3.0:1788891127.456153:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:3.0:1788891127.456160:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:0:x1875787987925120:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788891127.456185:0:17110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788891127.456209:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:0:x1875787987925120:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 50us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891127.456216:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00080000:3.0:1788891127.456246:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788891127.457167:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2390:x1875787987925248:12345-192.168.204.26@tcp:38:mount.lustre.0 Request processed in 4452us (4675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891127.457177:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:2.0:1788891127.461853:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891127.461942:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891127.465223:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987925632 00000100:00100000:3.0:1788891127.465239:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987925632 00000100:00100000:1.0:1788891127.466012:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987925376 00000100:00100000:1.0:1788891127.466019:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987925376 00000100:00100000:3.0:1788891127.466041:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:3.0:1788891127.466055:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:14856:x1875787987925632:12345-192.168.204.26@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788891127.466083:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:1.0:1788891127.466094:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:0:x1875787987925376:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788891127.466119:0:17111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788891127.466197:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:0:x1875787987925376:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 105us (4254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891127.466204:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:14856:x1875787987925632:12345-192.168.204.26@tcp:40:mount.lustre.0 Request processed in 150us (4358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891127.466213:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:1.0:1788891127.466335:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00080000:1.0:1788891127.466362:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788891127.471493:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891127.471583:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891127.471627:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891127.471692:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987926016 00000100:00100000:1.0:1788891127.471746:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987925760 00000100:00100000:3.0:1788891127.471748:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987926016 00000100:00100000:1.0:1788891127.471752:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987925760 00000100:00100000:3.0:1788891127.471942:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:3.0:1788891127.471953:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:14856:x1875787987926016:12345-192.168.204.26@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788891127.472042:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:14856:x1875787987926016:12345-192.168.204.26@tcp:900:mount.lustre.0 Request processed in 91us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891127.472049:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:2.0:1788891127.473977:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987925888 00000100:00100000:1.0:1788891127.473986:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:2.0:1788891127.473989:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987925888 00000100:00100000:1.0:1788891127.473993:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1875787987925760:12345-192.168.204.26@tcp:8:mount.lustre.0 00000100:00100000:2.0:1788891127.474020:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 20 00010000:00080000:1.0:1788891127.474023:0:18720:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 6f09a10f-9224-43a2-a8d4-25920b0f419e@192.168.204.26@tcp t0 exp 0000000000000000 cur 349 last 0 00000100:00100000:2.0:1788891127.474024:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1875787987925888:12345-192.168.204.26@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788891127.474038:0:18616:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 6f09a10f-9224-43a2-a8d4-25920b0f419e@192.168.204.26@tcp t0 exp 0000000000000000 cur 349 last 0 00000020:00000080:2.0:1788891127.474053:0:18616:0:(genops.c:1385:class_connect()) connect: client 6f09a10f-9224-43a2-a8d4-25920b0f419e, cookie 0xa66601b03fd54324 00000020:00000080:1.0:1788891127.474053:0:18720:0:(genops.c:1385:class_connect()) connect: client 6f09a10f-9224-43a2-a8d4-25920b0f419e, cookie 0xa66601b03fd5431d 00002000:00100000:2.0:1788891127.474064:0:18616:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6f09a10f-9224-43a2-a8d4-25920b0f419e/ffff924f823b7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788891127.474064:0:18720:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6f09a10f-9224-43a2-a8d4-25920b0f419e/ffff925087577800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788891127.474074:0:18616:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:1.0:1788891127.474078:0:18720:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788891127.474228:0:18720:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788891127.474263:0:18720:0:(import.c:65:import_set_state_nolock()) ffff925087573800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788891127.474333:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2390:x1875787987925760:12345-192.168.204.26@tcp:8:mount.lustre.0 Request processed in 338us (2749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891127.474342:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 19 00002000:00080000:2.0:1788891127.474464:0:18616:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788891127.474480:0:18616:0:(import.c:65:import_set_state_nolock()) ffff924f823b2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788891127.474660:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2390:x1875787987925888:12345-192.168.204.26@tcp:8:mount.lustre.0 Request processed in 633us (3032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891127.474669:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:3.0:1788891127.474706:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891127.474935:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987926144 00000100:00100000:1.0:1788891127.474940:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987926144 00000100:00100000:1.0:1788891127.475013:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:1.0:1788891127.475022:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:14856:x1875787987926144:12345-192.168.204.26@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788891127.475713:0:17112:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 616us 00000004:00200000:2.0:1788891127.488483:0:17112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788891127.488649:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:14856:x1875787987926144:12345-192.168.204.26@tcp:33:mount.lustre.0 Request processed in 13621us (13937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891127.488665:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:3.0:1788891127.609183:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891127.610153:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987926272 00000100:00100000:0.0:1788891127.610165:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987926272 00000100:00100000:0.0:1788891127.610238:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:0.0:1788891127.610250:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:14901:x1875787987926272:12345-192.168.204.26@tcp:101:mkdir.0 00010000:00010000:0.0:1788891127.610288:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891127.610315:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5432b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de234 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891127.610385:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd54332 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891127.610399:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd54332 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891127.610414:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd54332 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891127.610473:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788891127.610476:0:17110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788891127.610724:0:17110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd54332 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891127.610751:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5600/0xa66601b03fd5432b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de234 expref: 8 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891127.610770:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd54332 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de234 expref: 7 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891127.610779:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925085363100) 00010000:00010000:0.0:1788891127.610782:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788891127.610787:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5a00, rc 0) 00000100:00100000:0.0:1788891127.610914:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:14901:x1875787987926272:12345-192.168.204.26@tcp:101:mkdir.0 Request processed in 665us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891127.610922:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:0.0:1788891127.931780:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997421696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788891127.931866:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891127.932067:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997421568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788891127.932097:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891127.932119:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997421568 00000100:00100000:0.0:1788891127.932121:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997421824:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788891127.932126:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997421568 00000100:00100000:0.0:1788891127.932141:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891127.934329:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788891127.934341:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997421696 00000100:00100000:0.0:1788891127.934349:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997421696 00000100:00100000:3.0:1788891127.934351:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997421568:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788891127.934379:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997421824 00000100:00100000:0.0:1788891127.934382:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997421824 00000100:00100000:0.0:1788891127.934393:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788891127.934398:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997421696:12345-0@lo:13:osp-pre-0-0.0 00000004:00000024:3.0:1788891127.934406:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00002000:00000024:0.0:1788891127.934410:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788891127.934833:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997421568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 490us (2733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891127.934841:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788891127.934948:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997421696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 549us (3094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891127.934956:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788891127.934970:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788891127.934978:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997421824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788891127.934988:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788891127.935028:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997421824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (2885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891127.935034:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788891127.935118:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997421824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788891127.935200:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997421696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788891127.935257:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997421568:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788891128.379757:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891129.300985:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891129.301120:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987926400 00000100:00100000:1.0:1788891129.301130:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987926400 00000100:00080000:3.0:1788891129.301190:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891129.301214:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:1.0:1788891129.301235:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:14954:x1875787987926400:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:1.0:1788891129.301273:0:18639:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788891129.301664:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:14954:x1875787987926400:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 430us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891129.301674:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:3.0:1788891129.304947:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891129.305138:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987926528 00000100:00100000:1.0:1788891129.305148:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987926528 00000100:00100000:1.0:1788891129.305308:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:1.0:1788891129.305318:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:14954:x1875787987926528:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:1.0:1788891129.305387:0:17111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788891129.305479:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:14954:x1875787987926528:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 162us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891129.305487:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00080000:3.0:1788891129.309014:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788891129.309273:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891129.309398:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987926656 00000100:00100000:0.0:1788891129.309407:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987926656 00000100:00100000:0.0:1788891129.309553:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:0.0:1788891129.309564:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:14954:x1875787987926656:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:0.0:1788891129.309611:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788891129.309693:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:14954:x1875787987926656:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 132us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891129.309701:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00080000:3.0:1788891129.310347:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788891129.312499:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891129.312681:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987926784 00000100:00100000:0.0:1788891129.312691:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987926784 00000100:00100000:0.0:1788891129.312756:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:0.0:1788891129.312777:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:14954:x1875787987926784:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:0.0:1788891129.312806:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788891129.312900:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:14954:x1875787987926784:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 135us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891129.312908:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00080000:3.0:1788891129.313655:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788891129.403750:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891129.424422:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891129.424571:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987926912 00000100:00100000:0.0:1788891129.424581:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987926912 00000100:00100000:0.0:1788891129.424640:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 128 00000100:00100000:0.0:1788891129.424650:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+10:14984:x1875787987926912:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788891129.424667:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891129.424685:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae5600/0xa66601b03fd54339 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204de23b expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891129.424714:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae5600/0xa66601b03fd54339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de23b expref: 11 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891129.424726:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae5600/0xa66601b03fd54339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de23b expref: 11 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891129.424736:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5600, rc 0) 00000100:00100000:0.0:1788891129.424817:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+11:14984:x1875787987926912:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 168us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891129.424837:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 128 00000100:00100000:1.0:1788891129.427649:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891129.427740:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987927040 00000100:00100000:2.0:1788891129.427749:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987927040 00000100:00100000:2.0:1788891129.427804:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 129 00000100:00100000:2.0:1788891129.427813:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+11:14984:x1875787987927040:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788891129.427989:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+11:14984:x1875787987927040:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 175us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891129.427997:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 129 00000100:00100000:2.0:1788891129.435426:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891129.435853:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987927168 00000100:00100000:1.0:1788891129.435863:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987927168 00000100:00100000:1.0:1788891129.435966:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 130 00000100:00100000:1.0:1788891129.435977:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+11:14984:x1875787987927168:12345-192.168.204.26@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788891129.436137:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+11:14984:x1875787987927168:12345-192.168.204.26@tcp:503:mount.lustre.0 Request processed in 160us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891129.436145:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 130 00000100:00100000:1.0:1788891129.438632:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891129.439035:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987927296 00000100:00100000:0.0:1788891129.439046:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987927296 00000100:00100000:0.0:1788891129.439114:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 131 00000100:00100000:0.0:1788891129.439126:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+11:14992:x1875787987927296:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788891129.439305:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+11:14992:x1875787987927296:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 181us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891129.439314:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 131 00000100:00100000:3.0:1788891129.455171:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891129.458006:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987927424 00000100:00100000:1.0:1788891129.458023:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987927424 00000100:00100000:1.0:1788891129.458103:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 132 00000100:00100000:1.0:1788891129.458130:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+11:14992:x1875787987927424:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788891129.458307:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+11:14992:x1875787987927424:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 179us (3146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891129.458325:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 132 00000100:00100000:2.0:1788891129.462129:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891129.466264:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987927552 00000100:00100000:0.0:1788891129.466280:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987927552 00000100:00100000:0.0:1788891129.466425:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 133 00000100:00100000:0.0:1788891129.466438:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+11:14992:x1875787987927552:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788891129.466637:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+11:14992:x1875787987927552:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 201us (4517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891129.466646:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 133 00000100:00100000:3.0:1788891129.470841:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891129.470937:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987927680 00000100:00100000:1.0:1788891129.470948:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987927680 00000100:00100000:1.0:1788891129.471006:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 134 00000100:00100000:1.0:1788891129.471016:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+11:14984:x1875787987927680:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788891129.471033:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891129.471052:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250857dea00/0xa66601b03fd54340 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204de26c expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891129.471081:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250857dea00/0xa66601b03fd54340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de26c expref: 12 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891129.471094:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250857dea00/0xa66601b03fd54340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de26c expref: 12 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891129.471103:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857dea00, rc 0) 00000100:00100000:1.0:1788891129.471166:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+12:14984:x1875787987927680:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 150us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891129.471172:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 134 00000100:00100000:1.0:1788891129.475619:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891129.475962:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987927808 00000100:00100000:0.0:1788891129.475974:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987927808 00000100:00100000:0.0:1788891129.476035:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 135 00000100:00100000:0.0:1788891129.476047:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+12:14984:x1875787987927808:12345-192.168.204.26@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788891129.476072:0:17104:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788891129.476095:0:17104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788891129.476099:0:17104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788891129.476102:0:17104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788891129.476105:0:17104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788891129.476113:0:17104:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788891129.483302:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+12:14984:x1875787987927808:12345-192.168.204.26@tcp:256:mount.lustre.0 Request processed in 7246us (7682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891129.483318:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 135 00000100:00100000:3.0:1788891129.488134:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891129.488248:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987927936 00000100:00100000:2.0:1788891129.488258:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987927936 00000100:00100000:2.0:1788891129.488317:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 136 00000100:00100000:2.0:1788891129.488328:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+12:14984:x1875787987927936:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788891129.488344:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891129.488363:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924f82310c00/0xa66601b03fd54347 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204de273 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891129.488392:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924f82310c00/0xa66601b03fd54347 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de273 expref: 13 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891129.488404:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924f82310c00/0xa66601b03fd54347 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de273 expref: 13 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891129.488412:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310c00, rc 0) 00000100:00100000:2.0:1788891129.488486:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+13:14984:x1875787987927936:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 159us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891129.488508:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 136 00000100:00100000:1.0:1788891129.491057:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891129.491177:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987928064 00000100:00100000:0.0:1788891129.491184:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987928064 00000100:00100000:0.0:1788891129.491353:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 137 00000100:00100000:0.0:1788891129.491365:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+13:14984:x1875787987928064:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788891129.491586:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+13:14984:x1875787987928064:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 224us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891129.491592:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 137 00000100:00100000:0.0:1788891129.493887:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891129.494090:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987928192 00000100:00100000:1.0:1788891129.494100:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987928192 00000100:00100000:1.0:1788891129.494148:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 138 00000100:00100000:1.0:1788891129.494170:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+13:14984:x1875787987928192:12345-192.168.204.26@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788891129.494310:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+13:14984:x1875787987928192:12345-192.168.204.26@tcp:503:mount.lustre.0 Request processed in 140us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891129.494318:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 138 00000100:00100000:2.0:1788891129.498272:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891129.498491:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987928320 00000100:00100000:0.0:1788891129.498501:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987928320 00000100:00100000:0.0:1788891129.498596:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 139 00000100:00100000:0.0:1788891129.498606:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+13:14997:x1875787987928320:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788891129.498772:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+13:14997:x1875787987928320:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 166us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891129.498780:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 139 00000100:00100000:3.0:1788891129.502507:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891129.502677:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987928448 00000100:00100000:2.0:1788891129.502686:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987928448 00000100:00100000:2.0:1788891129.502786:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 140 00000100:00100000:2.0:1788891129.502797:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+13:14997:x1875787987928448:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788891129.502976:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+13:14997:x1875787987928448:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 180us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891129.504284:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 140 00000100:00100000:2.0:1788891129.514857:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891129.514956:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891129.515697:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987928576 00000100:00100000:1.0:1788891129.515709:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987928576 00000100:00100000:1.0:1788891129.515756:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987928832 00000100:00100000:1.0:1788891129.515760:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987928832 00000100:00100000:1.0:1788891129.515790:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:1.0:1788891129.515797:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1875787987928576:12345-192.168.204.26@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788891129.515839:0:18639:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 6db8dbfb-e84b-4eac-afbf-d489bcb0a680@192.168.204.26@tcp t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:1.0:1788891129.515875:0:18639:0:(genops.c:1385:class_connect()) connect: client 6db8dbfb-e84b-4eac-afbf-d489bcb0a680, cookie 0xa66601b03fd5434e 00000004:00100000:1.0:1788891129.515900:0:18639:0:(mdt_handler.c:7304:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788891129.516010:0:18639:0:(import.c:65:import_set_state_nolock()) ffff9250b72d6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788891129.516071:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:2390:x1875787987928576:12345-192.168.204.26@tcp:38:mount.lustre.0 Request processed in 273us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891129.516079:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:1.0:1788891129.516096:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:1.0:1788891129.516101:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1875787987928832:12345-192.168.204.26@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788891129.516115:0:18639:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from 6db8dbfb-e84b-4eac-afbf-d489bcb0a680@192.168.204.26@tcp t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:1.0:1788891129.516154:0:18639:0:(genops.c:1385:class_connect()) connect: client 6db8dbfb-e84b-4eac-afbf-d489bcb0a680, cookie 0xa66601b03fd54355 00000004:00100000:1.0:1788891129.516167:0:18639:0:(mdt_handler.c:7304:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788891129.516212:0:18639:0:(import.c:65:import_set_state_nolock()) ffff9250b72d5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788891129.516237:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:2390:x1875787987928832:12345-192.168.204.26@tcp:38:mount.lustre.0 Request processed in 134us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891129.516252:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:1.0:1788891129.522080:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891129.522126:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891129.522156:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891129.522241:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987929088 00000100:00100000:2.0:1788891129.522250:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987929088 00000100:00100000:2.0:1788891129.522316:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987928960 00000100:00100000:2.0:1788891129.522319:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987928960 00000100:00100000:2.0:1788891129.522333:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987928704 00000100:00100000:2.0:1788891129.522335:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987928704 00000100:00100000:2.0:1788891129.522348:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:2.0:1788891129.522358:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+7:14984:x1875787987929088:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788891129.522386:0:18639:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788891129.522448:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+7:14984:x1875787987929088:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 91us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891129.522455:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:2.0:1788891129.522472:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:2.0:1788891129.522478:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:0:x1875787987928960:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788891129.522508:0:18639:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788891129.522572:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:0:x1875787987928960:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 94us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891129.522578:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:2.0:1788891129.522591:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:2.0:1788891129.522597:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:0:x1875787987928704:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788891129.522607:0:18639:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788891129.522629:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:0:x1875787987928704:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 31us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891129.522635:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00080000:1.0:1788891129.522691:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788891129.522699:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891129.525433:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891129.525703:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987929216 00000100:00100000:2.0:1788891129.525712:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987929216 00000100:00100000:2.0:1788891129.525769:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:2.0:1788891129.525780:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:14984:x1875787987929216:12345-192.168.204.26@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788891129.525920:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:14984:x1875787987929216:12345-192.168.204.26@tcp:40:mount.lustre.0 Request processed in 142us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891129.525928:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:2.0:1788891129.529065:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891129.529166:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891129.529477:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987929600 00000100:00100000:3.0:1788891129.529488:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987929600 00000100:00100000:3.0:1788891129.529565:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:3.0:1788891129.529576:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:14984:x1875787987929600:12345-192.168.204.26@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788891129.529646:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:14984:x1875787987929600:12345-192.168.204.26@tcp:900:mount.lustre.0 Request processed in 72us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891129.529654:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:0.0:1788891129.529786:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891129.530571:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987929344 00000100:00100000:3.0:1788891129.530578:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987929344 00000100:00100000:3.0:1788891129.530616:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987929472 00000100:00100000:3.0:1788891129.530619:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987929472 00000100:00100000:3.0:1788891129.530644:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:3.0:1788891129.530663:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1875787987929344:12345-192.168.204.26@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788891129.530692:0:18613:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 6db8dbfb-e84b-4eac-afbf-d489bcb0a680@192.168.204.26@tcp t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:3.0:1788891129.530721:0:18613:0:(genops.c:1385:class_connect()) connect: client 6db8dbfb-e84b-4eac-afbf-d489bcb0a680, cookie 0xa66601b03fd5435c 00002000:00100000:3.0:1788891129.530731:0:18613:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6db8dbfb-e84b-4eac-afbf-d489bcb0a680/ffff92509df7e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788891129.530741:0:18613:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788891129.530803:0:18613:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788891129.530841:0:18613:0:(import.c:65:import_set_state_nolock()) ffff92509df78000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788891129.530891:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:2390:x1875787987929344:12345-192.168.204.26@tcp:8:mount.lustre.0 Request processed in 227us (1724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891129.530898:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:3.0:1788891129.530915:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:3.0:1788891129.530919:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1875787987929472:12345-192.168.204.26@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788891129.530935:0:18613:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 6db8dbfb-e84b-4eac-afbf-d489bcb0a680@192.168.204.26@tcp t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:3.0:1788891129.530950:0:18613:0:(genops.c:1385:class_connect()) connect: client 6db8dbfb-e84b-4eac-afbf-d489bcb0a680, cookie 0xa66601b03fd54363 00002000:00100000:3.0:1788891129.530956:0:18613:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6db8dbfb-e84b-4eac-afbf-d489bcb0a680/ffff92509df7a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788891129.530963:0:18613:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788891129.531004:0:18613:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788891129.531018:0:18613:0:(import.c:65:import_set_state_nolock()) ffff92509df7c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788891129.531042:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:2390:x1875787987929472:12345-192.168.204.26@tcp:8:mount.lustre.0 Request processed in 121us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891129.531048:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:0.0:1788891129.532194:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891129.532371:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987929728 00000100:00100000:2.0:1788891129.532378:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987929728 00000100:00100000:2.0:1788891129.532466:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:2.0:1788891129.532476:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:14984:x1875787987929728:12345-192.168.204.26@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788891129.532589:0:17113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788891129.532677:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:14984:x1875787987929728:12345-192.168.204.26@tcp:33:mount.lustre.0 Request processed in 202us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891129.532684:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:1.0:1788891129.664628:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891129.664669:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987929856 00000100:00100000:0.0:1788891129.664679:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987929856 00000100:00100000:0.0:1788891129.664779:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:0.0:1788891129.664790:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:15020:x1875787987929856:12345-192.168.204.26@tcp:101:mkdir.0 00010000:00010000:0.0:1788891129.664810:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891129.664854:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5c00/0xa66601b03fd5436a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de2a4 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891129.664923:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54371 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891129.664936:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891129.664948:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891129.665007:0:17109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788891129.665011:0:17109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788891129.665031:0:17109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891129.665129:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5c00/0xa66601b03fd5436a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2a4 expref: 8 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891129.665149:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54371 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2a4 expref: 7 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891129.665158:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925085363100) 00010000:00010000:0.0:1788891129.665161:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788891129.665164:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5400, rc 0) 00000100:00100000:0.0:1788891129.665232:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+7:15020:x1875787987929856:12345-192.168.204.26@tcp:101:mkdir.0 Request processed in 444us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891129.665239:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 22 00010000:00010000:2.0:1788891130.429238:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891131.451744:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788891131.546340:0:19986:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788891132.027746:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997421952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788891132.027786:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788891132.027802:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997422208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788891132.027830:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891132.027843:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891132.027897:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788891132.027907:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997422080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788891132.027910:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997422208 00000100:00100000:3.0:1788891132.027918:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997422208 00000100:00100000:2.0:1788891132.027934:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891132.027970:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788891132.027980:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997421952 00000100:00100000:3.0:1788891132.027982:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997422208:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788891132.027986:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997421952 00000004:00000024:3.0:1788891132.028018:0:17934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788891132.028019:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997422080 00000100:00100000:2.0:1788891132.028022:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997422080 00000100:00100000:2.0:1788891132.028040:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788891132.028048:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997421952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788891132.028068:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788891132.028073:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997422208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891132.028109:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997421952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891132.028115:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788891132.028130:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788891132.028137:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3629:x1875787997422080:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788891132.028155:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00002000:00000024:2.0:1788891132.028158:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788891132.028188:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3629:x1875787997422080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891132.028194:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788891132.028220:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997422208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788891132.028234:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997422080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788891132.028277:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997421952:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788891132.030090:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788891132.030461:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997422592:0@lo:400:kworker.0 00000100:00100000:1.0:1788891132.030554:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891132.030567:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:189d2e4e-bf9f-4645-ba04-f80564b97077:3628:1875787997422336:0@lo:400:kworker.0 00000100:00100000:1.0:1788891132.030592:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1875787997423104:0@lo:400:kworker.0 00000100:00100000:3.0:1788891132.030832:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997422464:0@lo:400:kworker.0 00000100:00100000:2.0:1788891132.034958:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891132.035016:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997422848:0@lo:400:kworker.0 00000100:00100000:2.0:1788891132.035061:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891132.035079:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1875787997423360:0@lo:400:kworker.0 00000100:00100000:2.0:1788891132.035100:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891132.035125:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997423360 00000100:00100000:2.0:1788891132.035132:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997423360 00000100:00100000:2.0:1788891132.035185:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788891132.035192:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875787997423360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891132.035235:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875787997423360:12345-0@lo:400:kworker.0 Request processed in 44us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891132.035242:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788891132.035282:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1875787997423360:0@lo:400:kworker.0 00000100:00100000:2.0:1788891132.035303:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788891132.035309:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997422720:0@lo:400:kworker.0 00000100:00100000:2.0:1788891132.035328:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891132.035350:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997423232:0@lo:400:kworker.0 00000100:00100000:2.0:1788891132.035368:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891132.035385:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997422720 00000100:00100000:2.0:1788891132.035388:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997422720 00000100:00100000:2.0:1788891132.035418:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997423232 00000100:00100000:2.0:1788891132.035421:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997423232 00000100:00100000:2.0:1788891132.035439:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788891132.035454:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997422720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891132.035485:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997422720:12345-0@lo:400:kworker.0 Request processed in 33us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891132.035491:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788891132.035502:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788891132.035507:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875787997423232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891132.035555:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875787997423232:12345-0@lo:400:kworker.0 Request processed in 47us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891132.035562:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788891132.035590:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83adca80 x1875787997423232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891132.035601:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997423232:0@lo:400:kworker.0 00000100:00100000:2.0:1788891132.035621:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997422720:0@lo:400:kworker.0 00000100:00100000:2.0:1788891132.035686:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997422592 00000100:00100000:2.0:1788891132.035690:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997422592 00000100:00100000:2.0:1788891132.035716:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997422848 00000100:00100000:2.0:1788891132.035720:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997422848 00000100:00100000:2.0:1788891132.035739:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788891132.035745:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997422592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891132.035966:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891132.036007:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997422464 00000100:00100000:3.0:1788891132.036012:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997422464 00000100:00100000:3.0:1788891132.036041:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788891132.036050:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997422464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891132.036079:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997422592:12345-0@lo:400:kworker.0 Request processed in 332us (5557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891132.036088:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788891132.036102:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997422464:12345-0@lo:400:kworker.0 Request processed in 52us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891132.036107:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788891132.036114:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788891132.036118:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997422848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891132.036151:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997422464:0@lo:400:kworker.0 00000100:00100000:3.0:1788891132.036161:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997422976:0@lo:400:kworker.0 00000100:00100000:2.0:1788891132.036167:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997422848:12345-0@lo:400:kworker.0 Request processed in 51us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891132.036181:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788891132.036193:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891132.036223:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997422976 00000100:00100000:3.0:1788891132.036230:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997422976 00000100:00100000:3.0:1788891132.036260:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788891132.036267:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997422976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891132.036302:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891132.036313:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1875787997422976:12345-0@lo:400:kworker.0 Request processed in 45us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891132.036315:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997422848:0@lo:400:kworker.0 00000100:00100000:3.0:1788891132.036331:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788891132.036350:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997423104 00000100:00100000:3.0:1788891132.036354:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997423104 00000100:00100000:2.0:1788891132.036358:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3629:1875787997422976:0@lo:400:kworker.0 00000100:00100000:2.0:1788891132.036369:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997423488:0@lo:400:kworker.0 00000100:00100000:3.0:1788891132.036388:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788891132.036402:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875787997423104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891132.036407:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891132.036447:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875787997423104:12345-0@lo:400:kworker.0 Request processed in 51us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891132.036453:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997423488 00000100:00100000:3.0:1788891132.036454:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788891132.036459:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997423488 00000100:00100000:2.0:1788891132.036496:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788891132.036505:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997423488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891132.036548:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997422336 00000100:00100000:3.0:1788891132.036553:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997422336 00000100:00100000:2.0:1788891132.036571:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1875787997423488:12345-0@lo:400:kworker.0 Request processed in 67us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891132.036580:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788891132.036585:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788891132.036594:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+24:3628:x1875787997422336:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788891132.036611:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83adf100 x1875787997423488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891132.036623:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3629:1875787997423488:0@lo:400:kworker.0 00000100:00100000:3.0:1788891132.036637:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+24:3628:x1875787997422336:12345-0@lo:400:kworker.0 Request processed in 43us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891132.036644:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1788891132.036658:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788891132.036664:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788891132.036667:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891132.036683:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:189d2e4e-bf9f-4645-ba04-f80564b97077:3628:1875787997422336:0@lo:400:kworker.0 00000100:00100000:1.0:1788891132.036762:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997422592:0@lo:400:kworker.0 00000100:00100000:1.0:1788891132.036803:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1875787997423104:0@lo:400:kworker.0 00010000:00010000:1.0:1788891132.476718:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788891132.545424:0:17089:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6db8dbfb-e84b-4eac-afbf-d489bcb0a680 00000001:00100000:1.0:1788891132.545438:0:17089:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6f09a10f-9224-43a2-a8d4-25920b0f419e 00000001:00100000:0.0:1788891132.546432:0:17841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6db8dbfb-e84b-4eac-afbf-d489bcb0a680 00000001:00100000:0.0:1788891132.546448:0:17841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6f09a10f-9224-43a2-a8d4-25920b0f419e 00000001:00100000:2.0:1788891132.547512:0:19431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6db8dbfb-e84b-4eac-afbf-d489bcb0a680 00000001:00100000:2.0:1788891132.547553:0:19431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6f09a10f-9224-43a2-a8d4-25920b0f419e 00000001:00080000:2.0:1788891132.547563:0:19431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:1.0:1788891133.051925:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788891133.051948:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997423744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788891133.052022:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891133.052394:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997423616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788891133.052428:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891133.052472:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997423744 00000100:00100000:2.0:1788891133.052486:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997423744 00000100:00100000:2.0:1788891133.052536:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997423616 00000100:00100000:2.0:1788891133.052540:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997423616 00000100:00100000:2.0:1788891133.052560:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788891133.052569:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997423744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788891133.052597:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788891133.052649:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997423744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891133.052657:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788891133.052675:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788891133.052682:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997423616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788891133.052691:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788891133.052721:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997423616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891133.052727:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788891133.052778:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997423616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788891133.052921:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997423744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788891133.052942:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997423872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788891133.052989:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891133.053027:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997423872 00000100:00100000:0.0:1788891133.053031:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997423872 00000100:00100000:1.0:1788891133.053179:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788891133.053184:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997423872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788891133.053204:0:17114:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788891133.053240:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997423872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891133.053244:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788891133.053290:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997423872:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788891133.503684:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788891133.572170:0:18610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6db8dbfb-e84b-4eac-afbf-d489bcb0a680 00000001:00100000:3.0:1788891133.572183:0:18610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6f09a10f-9224-43a2-a8d4-25920b0f419e 00000020:00000080:1.0:1788891133.840439:0:20134:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb16d2040 20000000:00000080:1.0:1788891133.840457:0:20134:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9250813f1400 uarg=0000000000000000 20000000:01000000:1.0:1788891133.840507:0:20134:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788891133.840513:0:20134:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788891133.840518:0:20134:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788891133.841025:0:20135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788891133.841180:0:20134:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788891133.846790:0:20134:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788891133.846823:0:20134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9250857dfa00/0xa66601b03fd54378 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.846843:0:20134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250857df200/0xa66601b03fd5400d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54006 expref: 23 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.846851:0:20134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff924f82311a00/0xa66601b03fd5401b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54014 expref: 23 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.846857:0:20134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250857de400/0xa66601b03fd5405a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54053 expref: 23 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.846863:0:20134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250857de600/0xa66601b03fd541b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd541b1 expref: 23 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.846888:0:20134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250baae4600/0xa66601b03fd54308 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de203 expref: 12 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.846894:0:20134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff924f82310c00/0xa66601b03fd54347 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de273 expref: 12 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.846901:0:20134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9250857dfa00/0xa66601b03fd54378 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.846942:0:20134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff924f82310c00/0xa66601b03fd54347 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de273 expref: 12 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.846957:0:20134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff924f82310c00/0xa66601b03fd54347 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de273 expref: 12 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891133.846972:0:20134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83adca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1875787997424000:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891133.847141:0:20134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250baae4600/0xa66601b03fd54308 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de203 expref: 12 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.847150:0:20134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250baae4600/0xa66601b03fd54308 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de203 expref: 12 pid: 17104 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891133.847160:0:20134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83addc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1875787997424128:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891133.847198:0:20134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250857de600/0xa66601b03fd541b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd541b1 expref: 23 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.847207:0:20134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250857de600/0xa66601b03fd541b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd541b1 expref: 23 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891133.847228:0:20134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83adc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1875787997424256:0@lo:104: 00000100:00100000:1.0:1788891133.847274:0:20134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788891133.847307:0:20134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250857de400/0xa66601b03fd5405a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd54053 expref: 23 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.847315:0:20134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250857de400/0xa66601b03fd5405a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd54053 expref: 23 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891133.847324:0:20134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83adf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1875787997424384:0@lo:104: 00000100:00100000:2.0:1788891133.847338:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997424256 00000100:00100000:2.0:1788891133.847344:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997424256 00000100:00100000:1.0:1788891133.847345:0:20134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788891133.847378:0:20134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff924f82311a00/0xa66601b03fd5401b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd54014 expref: 23 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.847385:0:20134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff924f82311a00/0xa66601b03fd5401b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd54014 expref: 23 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891133.847392:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997424384 00000100:00100000:2.0:1788891133.847395:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997424384 00000100:00100000:1.0:1788891133.847404:0:20134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83ade680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1875787997424512:0@lo:104: 00000100:00100000:2.0:1788891133.847411:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788891133.847419:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+4:20134:x1875787997424256:12345-0@lo:104: 00000100:00100000:1.0:1788891133.847424:0:20134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788891133.847431:0:17093:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd541b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd541b8 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.847444:0:20134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250857df200/0xa66601b03fd5400d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd54006 expref: 23 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.847451:0:20134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250857df200/0xa66601b03fd5400d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd54006 expref: 23 pid: 17104 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891133.847459:0:20134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1875787997424640:0@lo:104: 00000100:00100000:1.0:1788891133.847476:0:20134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788891133.847478:0:17093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788891133.847484:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+4:20134:x1875787997424256:12345-0@lo:104: Request processed in 66us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891133.847485:0:20134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788891133.847496:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788891133.847509:0:20134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83adc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1875787997424256:0@lo:104: 00000100:00100000:2.0:1788891133.847511:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997424512 00000100:00100000:2.0:1788891133.847514:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997424512 00000100:00100000:2.0:1788891133.847542:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997424640 00000100:00100000:2.0:1788891133.847546:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997424640 00000100:00100000:2.0:1788891133.847558:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788891133.847563:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+5:20134:x1875787997424384:12345-0@lo:104: 00010000:00010000:2.0:1788891133.847571:0:17093:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54053 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd5405a expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.847622:0:17093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788891133.847627:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+5:20134:x1875787997424384:12345-0@lo:104: Request processed in 65us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891133.847633:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788891133.847648:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788891133.847653:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+4:20134:x1875787997424512:12345-0@lo:104: 00010000:00010000:2.0:1788891133.847660:0:17093:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250857df400/0xa66601b03fd54014 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd5401b expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.847693:0:17093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788891133.847699:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+4:20134:x1875787997424512:12345-0@lo:104: Request processed in 46us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891133.847704:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788891133.847729:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788891133.847749:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+3:20134:x1875787997424640:12345-0@lo:104: 00010000:00010000:2.0:1788891133.847757:0:17093:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff924f82311600/0xa66601b03fd54006 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd5400d expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.847801:0:17093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788891133.847806:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+3:20134:x1875787997424640:12345-0@lo:104: Request processed in 71us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891133.847813:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788891133.847835:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788891133.847841:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd541b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd541b8 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.847849:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5200 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891133.847853:0:17097:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd541b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd541b8 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.847862:0:17097:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd541b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd541b8 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891133.847870:0:17097:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd541b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd541b8 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891133.847877:0:17097:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788891133.847886:0:20134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83adf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1875787997424384:0@lo:104: 00000100:00100000:1.0:1788891133.847895:0:20134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83ade680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1875787997424512:0@lo:104: 00000100:00100000:1.0:1788891133.847904:0:20134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1875787997424640:0@lo:104: 00010000:00010000:2.0:1788891133.847918:0:17097:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd541b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd541b8 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.847929:0:17097:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891133.847963:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd541b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd541b8 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.847971:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd541b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd541b8 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.847999:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788891133.848004:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54053 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd5405a expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.848011:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a400 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891133.848015:0:17097:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54053 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd5405a expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.848022:0:17097:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54053 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd5405a expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891133.848029:0:17097:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54053 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd5405a expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891133.848035:0:17097:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788891133.848051:0:17097:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54053 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd5405a expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.848058:0:17097:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891133.848065:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54053 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd5405a expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.848073:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54053 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd5405a expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.848083:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788891133.848086:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250857df400/0xa66601b03fd54014 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd5401b expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.848101:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df400 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891133.848104:0:17097:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250857df400/0xa66601b03fd54014 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd5401b expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.848110:0:17097:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250857df400/0xa66601b03fd54014 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd5401b expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891133.848115:0:17097:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250857df400/0xa66601b03fd54014 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd5401b expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891133.848121:0:17097:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788891133.848141:0:17097:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250857df400/0xa66601b03fd54014 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd5401b expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.848146:0:17097:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891133.848160:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250857df400/0xa66601b03fd54014 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd5401b expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.848166:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250857df400/0xa66601b03fd54014 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd5401b expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.848174:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891133.848177:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff924f82311600/0xa66601b03fd54006 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd5400d expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.848182:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311600 already unused, calling callback (ffffffffc13fbc20) 00000100:00100000:0.0:1788891133.848191:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 10000000:00010000:2.0:1788891133.848196:0:17097:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff924f82311600/0xa66601b03fd54006 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd5400d expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891133.848209:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:189d2e4e-bf9f-4645-ba04-f80564b97077:3628:1875787997425024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891133.848221:0:17097:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff924f82311600/0xa66601b03fd54006 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd5400d expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891133.848251:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891133.848295:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997425024 00000100:00100000:0.0:1788891133.848299:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997425024 00010000:00010000:0.0:1788891133.848317:0:17096:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff924f82311a00/0xa66601b03fd5401b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54014 expref: 24 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891133.848339:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788891133.848346:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189d2e4e-bf9f-4645-ba04-f80564b97077+24:3628:x1875787997425024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788891133.848375:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891133.848381:0:17096:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff924f82311a00/0xa66601b03fd5401b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54014 expref: 24 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891133.848390:0:17096:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff924f82311a00/0xa66601b03fd5401b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd54014 expref: 24 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891133.848408:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924f82311a00/0xa66601b03fd5401b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd54014 expref: 24 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891133.848421:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891133.848449:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189d2e4e-bf9f-4645-ba04-f80564b97077+23:3628:x1875787997425024:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891133.848457:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788891133.848458:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997424768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788891133.848491:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:189d2e4e-bf9f-4645-ba04-f80564b97077:3628:1875787997425024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891133.848493:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891133.848519:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788891133.848558:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997424896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788891133.848569:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997424768 00000100:00100000:0.0:1788891133.848575:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997424768 00000100:00100000:1.0:1788891133.848583:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788891133.848700:0:17094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250857de600/0xa66601b03fd541b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd541b1 expref: 23 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891133.848776:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997424896 00000100:00100000:0.0:1788891133.848780:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997424896 00010000:00010000:0.0:1788891133.848807:0:17094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250857de400/0xa66601b03fd5405a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54053 expref: 24 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891133.848907:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788891133.848916:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+24:3629:x1875787997424768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891133.848926:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891133.848931:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250857de600/0xa66601b03fd541b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd541b1 expref: 24 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.848939:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250857de600/0xa66601b03fd541b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd541b1 expref: 24 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.848949:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250857de600/0xa66601b03fd541b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd541b1 expref: 24 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.848959:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:2.0:1788891133.848973:0:17097:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff924f82311600/0xa66601b03fd54006 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd5400d expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891133.848979:0:17097:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788891133.848993:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+23:3629:x1875787997424768:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (500us total) trans 0 rc 0/0 00010000:00010000:2.0:1788891133.848999:0:17097:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff924f82311600/0xa66601b03fd54006 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd5400d expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891133.849000:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788891133.849010:0:17097:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788891133.849021:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788891133.849026:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff924f82311600/0xa66601b03fd54006 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd5400d expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891133.849031:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+22:3629:x1875787997424896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891133.849040:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff924f82311600/0xa66601b03fd54006 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd5400d expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.849057:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891133.849060:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891133.849064:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250857de400/0xa66601b03fd5405a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54053 expref: 22 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.849065:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891133.849069:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891133.849077:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891133.849078:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250857de400/0xa66601b03fd5405a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd54053 expref: 22 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.849085:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891133.849093:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250857de400/0xa66601b03fd5405a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd54053 expref: 22 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891133.849096:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788891133.849107:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891133.849110:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997425152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891133.849141:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+21:3629:x1875787997424896:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891133.849151:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788891133.849155:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891133.849170:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997425152 00000100:00100000:1.0:1788891133.849174:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997425152 00010000:00010000:1.0:1788891133.849190:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250857df200/0xa66601b03fd5400d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54006 expref: 21 pid: 17104 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891133.849206:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788891133.849212:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+21:3627:x1875787997425152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891133.849218:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891133.849222:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250857df200/0xa66601b03fd5400d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54006 expref: 21 pid: 17104 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.849230:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250857df200/0xa66601b03fd5400d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd54006 expref: 21 pid: 17104 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.849240:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250857df200/0xa66601b03fd5400d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd54006 expref: 21 pid: 17104 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.849260:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891133.849297:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189d2e4e-bf9f-4645-ba04-f80564b97077+20:3627:x1875787997425152:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891133.849306:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788891133.849339:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997424896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891133.849347:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997424768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891133.849559:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997425152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891133.850489:0:20134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83adca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1875787997424000:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891133.850504:0:20134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83addc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20134:1875787997424128:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891133.850566:0:20134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9250857dfa00/0xa66601b03fd54378 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891133.854066:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891133.854180:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891133.854259:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987929984 00000100:00100000:0.0:1788891133.854268:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987929984 00010000:00010000:0.0:1788891133.854470:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff924f82310c00/0xa66601b03fd54347 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de273 expref: 13 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891133.854601:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987930112 00000100:00100000:0.0:1788891133.854606:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987930112 00010000:00010000:0.0:1788891133.854623:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250baae4600/0xa66601b03fd54308 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de203 expref: 14 pid: 17104 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891133.854639:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:0.0:1788891133.854648:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b660ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e08b9a10-102a-4021-bba3-9abf67ad4662+14:2393:x1875787987929984:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891133.854662:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891133.854668:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff924f82310c00/0xa66601b03fd54347 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de273 expref: 14 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891133.854680:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff924f82310c00/0xa66601b03fd54347 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de273 expref: 14 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891133.854696:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924f82310c00/0xa66601b03fd54347 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de273 expref: 14 pid: 17102 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891133.854724:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891133.854998:0:17096:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788891133.855007:0:17096:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788891133.855095:0:17094:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788891133.855179:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:2.0:1788891133.855189:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e08b9a10-102a-4021-bba3-9abf67ad4662+13:2394:x1875787987930112:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891133.855199:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891133.855204:0:17094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250baae4600/0xa66601b03fd54308 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de203 expref: 13 pid: 17104 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.855215:0:17094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250baae4600/0xa66601b03fd54308 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de203 expref: 13 pid: 17104 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.855227:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae4600/0xa66601b03fd54308 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de203 expref: 13 pid: 17104 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.855238:0:17094:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9250857dfa00/0xa66601b03fd54378 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.855247:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250857dfa00/0xa66601b03fd54378 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.855261:0:17094:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250857dfa00/0xa66601b03fd54378 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.855269:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250857dfa00/0xa66601b03fd54378 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.855275:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9250857dfa00/0xa66601b03fd54378 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.855293:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9250857dfa00/0xa66601b03fd54378 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.855299:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857dfa00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891133.855304:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9250857dfa00/0xa66601b03fd54378 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.855312:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9250857dfa00/0xa66601b03fd54378 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.855335:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9250857dfa00/0xa66601b03fd54378 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891133.855346:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788891133.856169:0:20134:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9250857dfa00/0xa66601b03fd54378 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.856181:0:20134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9250857dfa00/0xa66601b03fd54378 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891133.856187:0:20134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250857dfa00/0xa66601b03fd54378 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891133.856633:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b660ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e08b9a10-102a-4021-bba3-9abf67ad4662+12:2393:x1875787987929984:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 1981us (2572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891133.856643:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:2.0:1788891133.856871:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e08b9a10-102a-4021-bba3-9abf67ad4662+11:2394:x1875787987930112:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 1682us (2690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891133.856879:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 14 00000040:00080000:1.0:1788891134.012856:0:17861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788891134.525458:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788891134.845208:0:17147:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788891134.927276:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891134.927323:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891134.927405:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987930240 00000100:00100000:1.0:1788891134.927413:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891134.927418:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987930240 00000100:00100000:1.0:1788891134.927454:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891134.927472:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 142 00000100:00100000:2.0:1788891134.927483:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+11:2392:x1875787987930240:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891134.927512:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987930752 00000100:00100000:0.0:1788891134.927518:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987930752 00000100:00100000:0.0:1788891134.927584:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:0.0:1788891134.927594:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+5:2392:x1875787987930752:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891134.927773:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987930496 00000100:00100000:2.0:1788891134.927775:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+11:2392:x1875787987930240:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 291us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891134.927783:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987930496 00000100:00100000:2.0:1788891134.927788:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 142 00000100:00100000:0.0:1788891134.927861:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+5:2392:x1875787987930752:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 269us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891134.927872:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:3.0:1788891134.927900:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987931008 00000100:00100000:3.0:1788891134.927903:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987931008 00000100:00100000:3.0:1788891134.927926:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:3.0:1788891134.927932:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+5:2392:x1875787987930496:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891134.927961:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+5:2392:x1875787987930496:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 29us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891134.927984:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:3.0:1788891134.928003:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:3.0:1788891134.928012:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2392:x1875787987931008:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891134.928049:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2392:x1875787987931008:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 39us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891134.928058:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00080000:0.0:1788891134.928152:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788891134.928158:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788891134.928473:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891134.928669:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891134.928685:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891134.928753:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987930368 00000100:00100000:3.0:1788891134.928757:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987930368 00000100:00100000:3.0:1788891134.928789:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:3.0:1788891134.928796:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2392:x1875787987930368:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891134.928834:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2392:x1875787987930368:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 38us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891134.928841:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00080000:3.0:1788891134.928866:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891134.930207:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891134.930247:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891134.930303:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987930880 00000100:00100000:2.0:1788891134.930309:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987930880 00000100:00100000:2.0:1788891134.930352:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:2.0:1788891134.930370:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:2392:x1875787987930880:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788891134.930425:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:2392:x1875787987930880:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 55us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891134.930431:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:0.0:1788891134.930814:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987931264 00000100:00100000:0.0:1788891134.930821:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987931264 00000100:00100000:0.0:1788891134.930891:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987930624 00000100:00100000:0.0:1788891134.930895:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987930624 00000100:00100000:2.0:1788891134.930998:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:2.0:1788891134.931009:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2392:x1875787987931264:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788891134.931059:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2392:x1875787987931264:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 52us (2586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891134.931067:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:2.0:1788891134.931082:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:2.0:1788891134.931088:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+5:2392:x1875787987930624:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788891134.931130:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+5:2392:x1875787987930624:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 42us (2443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891134.931136:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00080000:1.0:1788891134.931567:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788891134.931572:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788891134.931574:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788891134.932275:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987931136 00000100:00100000:2.0:1788891134.932282:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987931136 00000100:00100000:2.0:1788891134.932328:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:2.0:1788891134.932337:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2392:x1875787987931136:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788891134.932383:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2392:x1875787987931136:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 48us (2136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891134.932390:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00080000:1.0:1788891134.932494:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1788891135.227622:0:17106:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788891135.227631:0:17106:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff924f8238d000 from 13 10000000:01000000:3.0:1788891135.227635:0:17106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788891135.227678:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd5437f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891135.227689:0:17106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd5437f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891135.227700:0:17106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd5437f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891135.227733:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997425280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788891135.227802:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891135.227845:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff925082d22d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788891135.227910:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997425280 00000100:00100000:1.0:1788891135.227917:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997425280 00000100:00100000:1.0:1788891135.227967:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788891135.227975:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+20:17106:x1875787997425280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891135.227988:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891135.228000:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250857de600/0xa66601b03fd54386 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd5437f expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891135.228021:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250857de600/0xa66601b03fd54386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd5437f expref: 21 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891135.228030:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250857de600/0xa66601b03fd54386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd5437f expref: 21 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891135.228039:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857de600, rc 0) 00000100:00100000:1.0:1788891135.228084:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+21:17106:x1875787997425280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891135.228090:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788891135.228168:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997425280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891135.228182:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd5437f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54386 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891135.228197:0:17106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd5437f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54386 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891135.228259:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997425408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788891135.228282:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891135.228304:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82263780 going to sleep for 11 seconds 00000100:00100000:1.0:1788891135.228344:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997425408 00000100:00100000:1.0:1788891135.228349:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997425408 00000100:00100000:1.0:1788891135.228375:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788891135.228381:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+21:17106:x1875787997425408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891135.228476:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+21:17106:x1875787997425408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891135.228488:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788891135.228513:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997425408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891135.228561:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997425536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788891135.228593:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891135.228605:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6840 going to sleep for 11 seconds 00000100:00100000:1.0:1788891135.228614:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997425536 00000100:00100000:1.0:1788891135.228617:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997425536 00000100:00100000:1.0:1788891135.228631:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788891135.228635:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+21:17106:x1875787997425536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788891135.228697:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+21:17106:x1875787997425536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891135.228703:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788891135.228755:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997425536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788891135.229452:0:20224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788891135.229511:0:17106:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788891135.229562:0:17106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788891135.229571:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd5437f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54386 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891135.229581:0:17106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd5437f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54386 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891135.229591:0:17106:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788891135.229593:0:17106:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff925086f0e000 from 13 10000000:01000000:1.0:1788891135.229595:0:17106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788891135.229616:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250857de400/0xa66601b03fd5438d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891135.229630:0:17106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250857de400/0xa66601b03fd5438d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891135.229639:0:17106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250857de400/0xa66601b03fd5438d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891135.229653:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997425664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788891135.229688:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891135.229706:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788891135.229743:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997425664 00000100:00100000:1.0:1788891135.229747:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997425664 00000100:00100000:1.0:1788891135.229768:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788891135.229774:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+21:17106:x1875787997425664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891135.229785:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891135.229796:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250857df200/0xa66601b03fd54394 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd5438d expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891135.229816:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250857df200/0xa66601b03fd54394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd5438d expref: 22 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891135.229826:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250857df200/0xa66601b03fd54394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd5438d expref: 22 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891135.229834:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857df200, rc 0) 00000100:00100000:1.0:1788891135.229865:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+22:17106:x1875787997425664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891135.229871:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788891135.229913:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997425664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891135.229924:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250857de400/0xa66601b03fd5438d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54394 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891135.229933:0:17106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250857de400/0xa66601b03fd5438d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54394 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891135.229972:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997425792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891135.229995:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891135.230008:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788891135.230019:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997425792 00000100:00100000:1.0:1788891135.230022:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997425792 00000100:00100000:1.0:1788891135.230039:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788891135.230044:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+22:17106:x1875787997425792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891135.230120:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+22:17106:x1875787997425792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891135.230126:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788891135.230155:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997425792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891135.230177:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997425920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788891135.230211:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891135.230225:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788891135.230236:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997425920 00000100:00100000:1.0:1788891135.230239:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997425920 00000100:00100000:1.0:1788891135.230256:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788891135.230262:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+22:17106:x1875787997425920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788891135.230325:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+22:17106:x1875787997425920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891135.230338:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788891135.230378:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997425920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788891135.233704:0:20225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788891135.233905:0:17106:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788891135.233926:0:17106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788891135.233937:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250857de400/0xa66601b03fd5438d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54394 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891135.233948:0:17106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250857de400/0xa66601b03fd5438d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54394 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891135.233958:0:17106:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788891135.233961:0:17106:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9250c12df800 from 13 10000000:01000000:1.0:1788891135.233964:0:17106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788891135.234001:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250857dfa00/0xa66601b03fd5439b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891135.234009:0:17106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250857dfa00/0xa66601b03fd5439b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891135.234019:0:17106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250857dfa00/0xa66601b03fd5439b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891135.234045:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997426048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788891135.234109:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891135.234155:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8215b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788891135.234205:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997426048 00000100:00100000:3.0:1788891135.234211:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997426048 00000100:00100000:3.0:1788891135.234262:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788891135.234271:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925092ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+22:17106:x1875787997426048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788891135.234285:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891135.234298:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8b600/0xa66601b03fd543a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd5439b expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891135.234321:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8b600/0xa66601b03fd543a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd5439b expref: 23 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891135.234330:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8b600/0xa66601b03fd543a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd5439b expref: 23 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891135.234339:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8b600, rc 0) 00000100:00100000:3.0:1788891135.234377:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925092ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+23:17106:x1875787997426048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891135.234384:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788891135.234470:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997426048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891135.234483:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250857dfa00/0xa66601b03fd5439b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd543a2 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891135.234504:0:17106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250857dfa00/0xa66601b03fd5439b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd543a2 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891135.234587:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997426176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891135.234614:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891135.234632:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8215b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788891135.234695:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997426176 00000100:00100000:3.0:1788891135.234700:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997426176 00000100:00100000:3.0:1788891135.234743:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788891135.234751:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925093b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+23:17106:x1875787997426176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788891135.234866:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925093b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+23:17106:x1875787997426176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891135.234873:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788891135.235333:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997426176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891135.235364:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997426304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788891135.235403:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891135.235427:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8215b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788891135.235471:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997426304 00000100:00100000:0.0:1788891135.235476:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997426304 00000100:00100000:0.0:1788891135.235511:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788891135.235519:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+23:17106:x1875787997426304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788891135.235623:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090143050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+23:17106:x1875787997426304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891135.235630:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788891135.235729:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997426304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788891135.238405:0:20226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788891135.238704:0:17106:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788891135.238744:0:17106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788891135.238755:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250857dfa00/0xa66601b03fd5439b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd543a2 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891135.238766:0:17106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250857dfa00/0xa66601b03fd5439b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd543a2 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891135.238776:0:17106:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788891135.238778:0:17106:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff924f839d2800 from 13 10000000:01000000:0.0:1788891135.238780:0:17106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788891135.238815:0:17106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd543a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891135.238822:0:17106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd543a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891135.238832:0:17106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd543a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891135.238857:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997426432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788891135.238916:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891135.238960:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8324de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788891135.239010:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997426432 00000100:00100000:1.0:1788891135.239017:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997426432 00000100:00100000:1.0:1788891135.239089:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788891135.239100:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+23:17106:x1875787997426432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891135.239112:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891135.239123:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250857df400/0xa66601b03fd543b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd543a9 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891135.239146:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250857df400/0xa66601b03fd543b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd543a9 expref: 24 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891135.239156:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250857df400/0xa66601b03fd543b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd543a9 expref: 24 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891135.239176:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857df400, rc 0) 00000100:00100000:1.0:1788891135.239225:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090143450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+24:17106:x1875787997426432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891135.239232:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788891135.239304:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997426432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891135.239319:0:17106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd543a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd543b0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891135.239328:0:17106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd543a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd543b0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891135.239387:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997426560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788891135.239415:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891135.242056:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f822630c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891135.244749:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997426560 00000100:00100000:0.0:1788891135.244763:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997426560 00000100:00100000:0.0:1788891135.244816:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788891135.244826:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+24:17106:x1875787997426560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788891135.245001:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090140850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+24:17106:x1875787997426560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (5584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891135.245009:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788891135.245109:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997426560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788891135.245160:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997426688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788891135.245206:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891135.245245:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f822630c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891135.245290:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997426688 00000100:00100000:0.0:1788891135.245294:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997426688 00000100:00100000:0.0:1788891135.245311:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788891135.245316:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250933d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+24:17106:x1875787997426688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788891135.245395:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250933d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+24:17106:x1875787997426688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891135.245402:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788891135.247704:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:189d2e4e-bf9f-4645-ba04-f80564b97077:17106:1875787997426688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788891135.251459:0:20230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788891135.257679:0:17106:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788891135.257724:0:17106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788891135.257736:0:17106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd543a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd543b0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891135.257754:0:17106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd543a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd543b0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891135.439566:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891135.439660:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987931392 00000100:00100000:0.0:1788891135.439672:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987931392 00000100:00100000:0.0:1788891135.439745:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 155 00000100:00100000:0.0:1788891135.439756:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250933d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+11:14870:x1875787987931392:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788891135.439775:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891135.439794:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae4400/0xa66601b03fd543b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204de2ab expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891135.439821:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae4400/0xa66601b03fd543b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2ab expref: 12 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891135.439834:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae4400/0xa66601b03fd543b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2ab expref: 12 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891135.439843:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4400, rc 0) 00000100:00100000:0.0:1788891135.439907:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250933d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+12:14870:x1875787987931392:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 153us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891135.439913:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 155 00000100:00100000:2.0:1788891135.443976:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891135.444107:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987931520 00000100:00100000:3.0:1788891135.444120:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987931520 00000100:00100000:3.0:1788891135.444195:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 156 00000100:00100000:3.0:1788891135.444209:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250933d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+12:14870:x1875787987931520:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788891135.444425:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250933d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+12:14870:x1875787987931520:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 218us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891135.444435:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 156 00000100:00100000:3.0:1788891135.451340:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891135.451491:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987931648 00000100:00100000:1.0:1788891135.451509:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987931648 00000100:00100000:1.0:1788891135.451622:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 157 00000100:00100000:1.0:1788891135.451631:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+12:14870:x1875787987931648:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788891135.451803:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e08b9a10-102a-4021-bba3-9abf67ad4662+12:14870:x1875787987931648:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 171us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891135.451811:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 157 00000100:00100000:1.0:1788891135.460312:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891135.460459:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987931776 00000100:00100000:2.0:1788891135.460722:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987931776 00000100:00100000:2.0:1788891135.460783:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 158 00000100:00100000:2.0:1788891135.460793:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+12:14870:x1875787987931776:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891135.460811:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891135.460829:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924f82310c00/0xa66601b03fd543be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204de2b2 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891135.460860:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924f82310c00/0xa66601b03fd543be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2b2 expref: 13 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891135.460871:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924f82310c00/0xa66601b03fd543be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2b2 expref: 13 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891135.461052:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310c00, rc 0) 00000100:00100000:2.0:1788891135.461178:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+13:14870:x1875787987931776:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 386us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891135.461185:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 158 00000100:00100000:2.0:1788891135.472023:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891135.472100:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987931904 00000100:00100000:0.0:1788891135.472111:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987931904 00000100:00100000:0.0:1788891135.472176:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 159 00000100:00100000:0.0:1788891135.472199:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+13:14870:x1875787987931904:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788891135.472359:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+13:14870:x1875787987931904:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 161us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891135.472367:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 159 00000100:00100000:3.0:1788891135.487154:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891135.487298:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987932032 00000100:00100000:2.0:1788891135.487309:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987932032 00000100:00100000:2.0:1788891135.487434:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 160 00000100:00100000:2.0:1788891135.487445:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+13:14870:x1875787987932032:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788891135.487655:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+13:14870:x1875787987932032:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 203us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891135.487663:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 160 00010000:00010000:2.0:1788891135.548694:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891136.214657:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891136.214743:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987932160 00000100:00100000:3.0:1788891136.214753:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987932160 00000100:00080000:1.0:1788891136.214826:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891136.214832:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:3.0:1788891136.214843:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:15536:x1875787987932160:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788891136.214870:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891136.214892:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd543c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de2b9 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.214952:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd543cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.214965:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd543cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.214979:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd543cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.214993:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd543d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215018:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd543d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215025:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd543d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215110:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd543da lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215118:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd543da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215124:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd543da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891136.215151:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788891136.215154:0:17111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891136.215191:0:17111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd543da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215201:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd543cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215207:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd543cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215214:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd543cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215220:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891136.215224:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd543cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215237:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd543cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215249:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925085363100) 00010000:00010000:3.0:1788891136.215252:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891136.215257:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd543cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215264:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd543cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215276:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd543d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215282:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd543d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215289:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd543d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215294:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8be00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891136.215297:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd543d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215303:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd543d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215309:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9250905a3900) 00010000:00010000:3.0:1788891136.215311:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891136.215314:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd543d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215328:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd543d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215358:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd543c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2b9 expref: 8 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215395:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd543da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2b9 expref: 7 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.215403:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9250905a3500) 00010000:00010000:3.0:1788891136.215405:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788891136.215408:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8a600, rc 0) 00000100:00100000:3.0:1788891136.215463:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:15536:x1875787987932160:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 623us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891136.215470:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:3.0:1788891136.220332:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891136.221441:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987932288 00000100:00100000:2.0:1788891136.221454:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987932288 00000100:00100000:2.0:1788891136.221713:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:2.0:1788891136.221724:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:15536:x1875787987932288:12345-192.168.204.26@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788891136.221815:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:15536:x1875787987932288:12345-192.168.204.26@tcp:900:lhsmtool_posix.0 Request processed in 93us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891136.221823:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:1.0:1788891136.229739:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891136.229882:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987932544 00000100:00100000:2.0:1788891136.229899:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987932544 00000100:00100000:2.0:1788891136.230046:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:2.0:1788891136.230057:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:15536:x1875787987932544:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891136.230079:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891136.230103:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd543e1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de2c0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.230181:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd543e8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.230195:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd543e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.230207:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd543e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.231270:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd543ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.231285:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd543ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.231295:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd543ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.231411:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311a00/0xa66601b03fd543f6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.231421:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311a00/0xa66601b03fd543f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.231428:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311a00/0xa66601b03fd543f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891136.231438:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788891136.231610:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd543e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.231619:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd543e8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.231626:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd543e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.231632:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891136.231637:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd543e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.231656:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd543e8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.231668:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9250905a3500) 00010000:00010000:2.0:1788891136.231671:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891136.231676:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd543e8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.231682:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd543e8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.231709:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd543ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.231715:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd543ef lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.231721:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd543ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.231726:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891136.231729:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd543ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.231734:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd543ef lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.231741:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff924f82e37100) 00010000:00010000:2.0:1788891136.231744:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891136.231747:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd543ef lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.231762:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd543ef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.232602:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd543e1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2c0 expref: 10 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.232619:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311a00/0xa66601b03fd543f6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2c0 expref: 9 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.232626:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff924f82e37d00) 00010000:00010000:2.0:1788891136.232628:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891136.232630:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311a00, rc 0) 00000100:00100000:2.0:1788891136.232708:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+9:15536:x1875787987932544:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 2652us (2985us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788891136.232716:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:1.0:1788891136.235172:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891136.235271:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987932672 00000100:00100000:0.0:1788891136.235281:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987932672 00000100:00100000:0.0:1788891136.235343:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:0.0:1788891136.235353:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+9:15536:x1875787987932672:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788891136.235717:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+9:15536:x1875787987932672:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 Request processed in 364us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891136.235726:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:3.0:1788891136.242840:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891136.243071:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987932800 00000100:00100000:1.0:1788891136.243081:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987932800 00000100:00100000:1.0:1788891136.243148:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 26 00000100:00100000:1.0:1788891136.243158:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+5:15536:x1875787987932800:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1788891136.243304:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1788891136.246356:0:18639:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3159us 00000100:00100000:1.0:1788891136.253840:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891136.254607:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987932928 00000100:00100000:3.0:1788891136.254618:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987932928 00000100:00100000:3.0:1788891136.254721:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:3.0:1788891136.254732:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+9:15542:x1875787987932928:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891136.254752:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891136.254824:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd54404 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de2c7 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255016:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5440b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255043:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5440b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255069:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5440b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255087:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd54412 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255094:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd54412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255100:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd54412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255136:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5440b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255143:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5440b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255150:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5440b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255155:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8be00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891136.255159:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5440b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255165:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5440b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255176:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925085363100) 00010000:00010000:3.0:1788891136.255185:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891136.255190:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5440b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255197:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5440b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255211:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd54412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255221:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd54412 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255227:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd54412 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255232:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891136.255235:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd54412 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255241:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd54412 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255250:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9250905a3900) 00010000:00010000:3.0:1788891136.255252:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891136.255255:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd54412 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255261:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd54412 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255295:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd54404 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2c7 expref: 10 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255312:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925085363100) 00010000:00010000:3.0:1788891136.255315:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891136.255319:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd54404 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2c7 expref: 10 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.255328:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8ac00, rc 0) 00000100:00100000:3.0:1788891136.255394:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+9:15542:x1875787987932928:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 664us (1564us total) trans 0 rc 301/301 00000100:00100000:3.0:1788891136.255402:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:1.0:1788891136.259912:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+5:15536:x1875787987932800:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 Request processed in 16747us (17073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891136.259933:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 26 00000100:00100000:1.0:1788891136.261999:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891136.262133:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987933056 00000100:00100000:0.0:1788891136.262143:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987933056 00000100:00100000:0.0:1788891136.262192:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:0.0:1788891136.262203:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6f09a10f-9224-43a2-a8d4-25920b0f419e+9:15542:x1875787987933056:12345-192.168.204.26@tcp:700:lfs.0 00000100:00100000:0.0:1788891136.262291:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6f09a10f-9224-43a2-a8d4-25920b0f419e+9:15542:x1875787987933056:12345-192.168.204.26@tcp:700:lfs.0 Request processed in 89us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891136.262299:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:3.0:1788891136.264228:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891136.264331:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987933312 00000100:00100000:2.0:1788891136.264341:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987933312 00000100:00100000:2.0:1788891136.264398:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:2.0:1788891136.264407:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+9:15542:x1875787987933312:12345-192.168.204.26@tcp:36:lfs.0 00010000:00010000:2.0:1788891136.264459:0:17110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891136.264710:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd54332 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de234 expref: 9 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.264730:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925085363100) 00010000:00010000:2.0:1788891136.264734:0:17110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891136.264844:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54419 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.264875:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54371 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2a4 expref: 5 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.264884:0:17110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54419 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.264917:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54371 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2a4 expref: 5 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.264931:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54371 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2a4 expref: 5 pid: 17109 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891136.265077:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997426816:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891136.265159:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82263cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788891136.267132:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997426816:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891136.267160:0:17110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54419 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891136.267427:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891136.267505:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987933440 00000100:00100000:1.0:1788891136.267513:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987933440 00010000:00010000:1.0:1788891136.267598:0:17096:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54371 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2a4 expref: 6 pid: 17109 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788891136.267618:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891136.267633:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:1.0:1788891136.267643:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:2393:x1875787987933440:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891136.267657:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891136.267664:0:17096:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54371 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2a4 expref: 6 pid: 17109 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.267676:0:17096:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54371 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2a4 expref: 6 pid: 17109 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.267713:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54371 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2a4 expref: 6 pid: 17109 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.267729:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925085363100) 00010000:00010000:1.0:1788891136.267734:0:17096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54419 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.267744:0:17096:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54419 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.267751:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54419 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.267794:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788891136.267813:0:17110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54419 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.267820:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54419 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.267848:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd54420 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891136.267849:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2393:x1875787987933440:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 207us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891136.267857:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 15 00010000:00010000:3.0:1788891136.267858:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd54420 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.267865:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd54420 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.270677:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd54427 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.270711:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd54427 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.270723:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd54427 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788891136.270742:0:17110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008562db9c reply state 000000005e5dcb83 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd54427 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.270772:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd54427 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.270780:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:2.0:1788891136.270782:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788891136.270786:0:17110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788891136.270793:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788891136.270802:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54419 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.270809:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54419 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.270816:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54419 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.270823:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891136.270826:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54419 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.270833:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54419 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.270844:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff925085363100) 00010000:00010000:2.0:1788891136.270846:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891136.270850:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54419 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.270857:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54419 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788891136.270893:0:17110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008562db9c reply state 000000005e5dcb83 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd54420 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.270900:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd54420 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.270904:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9250905a3400) 00010000:00010000:2.0:1788891136.270905:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788891136.270907:0:17110:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788891136.270994:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+10:15542:x1875787987933312:12345-192.168.204.26@tcp:36:lfs.0 Request processed in 6586us (6771us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788891136.271001:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:3.0:1788891136.343954:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891136.344287:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987933568 00000100:00100000:2.0:1788891136.344298:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987933568 00000100:00100000:2.0:1788891136.344416:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:2.0:1788891136.344427:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+10:15550:x1875787987933568:12345-192.168.204.26@tcp:101:lctl.0 00010000:00010000:2.0:1788891136.344450:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891136.344473:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd5442e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de2ce expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.344594:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd54435 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.344605:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd54435 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.344613:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd54435 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891136.344658:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788891136.344661:0:17111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788891136.344701:0:17111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd54435 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.344740:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd5442e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2ce expref: 12 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.344758:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd54435 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2ce expref: 11 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.344767:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e37a00) 00010000:00010000:2.0:1788891136.344770:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788891136.344773:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310000, rc 0) 00000100:00100000:2.0:1788891136.344827:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+11:15550:x1875787987933568:12345-192.168.204.26@tcp:101:lctl.0 Request processed in 402us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891136.344835:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:1.0:1788891136.367125:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891136.367259:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987933696 00000100:00100000:0.0:1788891136.367271:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987933696 00000100:00100000:0.0:1788891136.367383:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:0.0:1788891136.367394:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:15551:x1875787987933696:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891136.367414:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891136.367434:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5443c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de2d5 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.367517:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4200/0xa66601b03fd54443 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.367565:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4200/0xa66601b03fd54443 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.367578:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4200/0xa66601b03fd54443 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891136.367626:0:17109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788891136.367631:0:17109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788891136.367656:0:17109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4200/0xa66601b03fd54443 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.367681:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5443c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2d5 expref: 7 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.367711:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4200/0xa66601b03fd54443 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2d5 expref: 6 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.367720:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e37a00) 00010000:00010000:0.0:1788891136.367723:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788891136.367727:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4200, rc 0) 00000100:00100000:0.0:1788891136.367791:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:15551:x1875787987933696:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 399us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891136.367798:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:0.0:1788891136.370199:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891136.370905:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987933824 00000100:00100000:1.0:1788891136.370915:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987933824 00000100:00100000:1.0:1788891136.370973:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:1.0:1788891136.370984:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:15551:x1875787987933824:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788891136.371003:0:18639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891136.371024:0:18639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd5444a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de2dc expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371088:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd54451 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371104:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd54451 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371115:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd54451 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371126:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd54458 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371134:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd54458 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371140:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd54458 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371247:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5445f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371255:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5445f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371260:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5445f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891136.371298:0:18639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788891136.371430:0:18639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788891136.371456:0:18639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5445f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371468:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd54451 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371473:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd54451 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371479:0:18639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd54451 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371485:0:18639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857de000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891136.371489:0:18639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd54451 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371497:0:18639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd54451 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371510:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e37a00) 00010000:00010000:1.0:1788891136.371597:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891136.371605:0:18639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd54451 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371612:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd54451 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371627:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd54458 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371633:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd54458 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371638:0:18639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd54458 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371644:0:18639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891136.371647:0:18639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd54458 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371653:0:18639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd54458 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371662:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9250905a3400) 00010000:00010000:1.0:1788891136.371666:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891136.371669:0:18639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd54458 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371675:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd54458 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371714:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd5444a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2dc expref: 8 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371741:0:18639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5445f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2dc expref: 7 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.371749:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:1.0:1788891136.371751:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788891136.371753:0:18639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857dfc00, rc 0) 00000100:00100000:1.0:1788891136.371878:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+7:15551:x1875787987933824:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 894us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891136.371886:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:3.0:1788891136.375701:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891136.375906:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987933952 00000100:00100000:2.0:1788891136.375916:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987933952 00000100:00100000:2.0:1788891136.375991:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:2.0:1788891136.376002:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:15551:x1875787987933952:12345-192.168.204.26@tcp:900:lfs.0 00000100:00100000:2.0:1788891136.376083:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:15551:x1875787987933952:12345-192.168.204.26@tcp:900:lfs.0 Request processed in 83us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891136.376101:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00080000:3.0:1788891136.376213:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788891136.380641:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891136.381453:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987934208 00000100:00100000:2.0:1788891136.381465:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987934208 00000100:00100000:2.0:1788891136.381842:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:2.0:1788891136.381853:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+7:15551:x1875787987934208:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788891136.381873:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891136.381894:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54466 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de2e3 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891136.381989:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788891136.382085:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54466 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2e3 expref: 9 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.382099:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e37a00) 00010000:00010000:2.0:1788891136.382102:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788891136.382106:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54466 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2e3 expref: 9 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.382119:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311c00, rc 0) 00000100:00100000:2.0:1788891136.382242:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+8:15551:x1875787987934208:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 389us (1611us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788891136.382249:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:1.0:1788891136.391500:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891136.391639:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987934464 00000100:00100000:2.0:1788891136.391649:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987934464 00000100:00100000:2.0:1788891136.391715:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:2.0:1788891136.391726:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+8:15551:x1875787987934464:12345-192.168.204.26@tcp:36:lfs.0 00010000:00010000:2.0:1788891136.391780:0:17111:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891136.391806:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5445f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2dc expref: 8 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.391843:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:2.0:1788891136.391848:0:17111:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891136.391868:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54474 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.391880:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54474 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.392298:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54474 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788891136.393740:0:17111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b20edbae reply state 0000000035002873 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54474 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.393758:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54474 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.393766:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:2.0:1788891136.393768:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788891136.393771:0:17111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788891136.393781:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788891136.393985:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+9:15551:x1875787987934464:12345-192.168.204.26@tcp:36:lfs.0 Request processed in 2258us (5297us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788891136.393993:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:3.0:1788891136.397647:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891136.397874:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987934720 00000100:00100000:2.0:1788891136.397884:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987934720 00000100:00100000:2.0:1788891136.398075:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:2.0:1788891136.398088:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+9:15551:x1875787987934720:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788891136.398303:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+10:15551:x1875787987934720:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 218us (786us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788891136.398324:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:3.0:1788891136.402511:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891136.403196:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987934976 00000100:00100000:2.0:1788891136.403208:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987934976 00000100:00100000:2.0:1788891136.403335:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:2.0:1788891136.403346:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+10:15551:x1875787987934976:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788891136.403372:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891136.403394:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd5447b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de2ea expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.403482:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54482 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.403507:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54482 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.403518:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54482 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.403568:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54489 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.403575:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54489 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.403582:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54489 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891136.403899:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788891136.403984:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54482 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.404008:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54482 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.404016:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54482 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.404022:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891136.404027:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54482 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.404034:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54482 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.404048:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e37a00) 00010000:00010000:2.0:1788891136.404051:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891136.404056:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54482 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.404062:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54482 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.404076:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54489 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.404082:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54489 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.404089:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54489 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.404094:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ede00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891136.404104:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54489 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.404110:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54489 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.404118:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9250905a3400) 00010000:00010000:2.0:1788891136.404121:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891136.404124:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54489 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.404130:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54489 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.404166:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd5447b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2ea expref: 12 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.404177:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e37a00) 00010000:00010000:2.0:1788891136.404179:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788891136.404182:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310600/0xa66601b03fd5447b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2ea expref: 12 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.404192:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82310600, rc 0) 00000100:00100000:2.0:1788891136.404261:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+11:15551:x1875787987934976:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 916us (1760us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788891136.404269:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:1.0:1788891136.410481:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891136.410676:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987935104 00000100:00100000:3.0:1788891136.410698:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987935104 00000100:00100000:3.0:1788891136.410859:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:3.0:1788891136.410870:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+11:15551:x1875787987935104:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891136.410893:0:18639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891136.410916:0:18639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd54497 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de2f1 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.411015:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd5449e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.411029:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd5449e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.411040:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd5449e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891136.411064:0:18639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788891136.411068:0:18639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891136.411089:0:18639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd5449e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.411114:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd54497 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2f1 expref: 13 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.411133:0:18639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd5449e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2f1 expref: 12 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.411156:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:3.0:1788891136.411159:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788891136.411162:0:18639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8b800, rc 0) 00000100:00100000:3.0:1788891136.412189:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+12:15551:x1875787987935104:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1317us (1715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891136.412199:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:3.0:1788891136.418273:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891136.418498:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987935232 00000100:00100000:1.0:1788891136.418517:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987935232 00000100:00100000:1.0:1788891136.418598:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:1.0:1788891136.418609:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+12:15551:x1875787987935232:12345-192.168.204.26@tcp:37:lfs.0 00000100:00100000:1.0:1788891136.427149:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+12:15551:x1875787987935232:12345-192.168.204.26@tcp:37:lfs.0 Request processed in 8529us (8872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891136.427163:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:0.0:1788891136.432663:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891136.432731:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987935488 00000100:00100000:2.0:1788891136.432742:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987935488 00000100:00100000:2.0:1788891136.432801:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:2.0:1788891136.432812:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f81fde450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+12:15551:x1875787987935488:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788891136.433024:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f81fde450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+13:15551:x1875787987935488:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 214us (371us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788891136.433032:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:3.0:1788891136.468084:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891136.468249:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987935616 00000100:00100000:0.0:1788891136.468260:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987935616 00000100:00100000:0.0:1788891136.468323:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:0.0:1788891136.468333:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+11:15557:x1875787987935616:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788891136.468354:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891136.468374:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd544a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de2f8 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468440:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd544ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468453:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd544ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468464:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd544ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468475:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd544b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468482:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd544b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468489:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd544b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468603:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5e00/0xa66601b03fd544ba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468612:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5e00/0xa66601b03fd544ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468638:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5e00/0xa66601b03fd544ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891136.468675:0:17109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788891136.468679:0:17109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788891136.468732:0:17109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5e00/0xa66601b03fd544ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468746:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd544ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468752:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd544ac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468758:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd544ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468764:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891136.468769:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd544ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468776:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd544ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468787:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e37a00) 00010000:00010000:0.0:1788891136.468790:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891136.468794:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd544ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468800:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd544ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468824:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd544b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468831:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd544b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468837:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd544b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468841:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891136.468844:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd544b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468850:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd544b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468869:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9250905a3400) 00010000:00010000:0.0:1788891136.468871:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891136.468874:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd544b3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468879:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd544b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468904:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd544a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2f8 expref: 13 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468918:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5e00/0xa66601b03fd544ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2f8 expref: 12 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.468938:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:0.0:1788891136.468940:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788891136.468942:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5e00, rc 0) 00000100:00100000:0.0:1788891136.469125:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+12:15557:x1875787987935616:12345-192.168.204.26@tcp:101:bash.0 Request processed in 792us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891136.469133:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:0.0:1788891136.471616:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891136.471714:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987935744 00000100:00100000:2.0:1788891136.471733:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987935744 00000100:00100000:2.0:1788891136.471787:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:2.0:1788891136.471798:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6f09a10f-9224-43a2-a8d4-25920b0f419e+5:15557:x1875787987935744:12345-192.168.204.26@tcp:900:bash.0 00000100:00100000:2.0:1788891136.472020:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6f09a10f-9224-43a2-a8d4-25920b0f419e+5:15557:x1875787987935744:12345-192.168.204.26@tcp:900:bash.0 Request processed in 223us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891136.472029:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:0.0:1788891136.474010:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891136.474086:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987936000 00000100:00100000:2.0:1788891136.474094:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987936000 00000100:00100000:2.0:1788891136.474145:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:2.0:1788891136.474154:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+12:15557:x1875787987936000:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788891136.474181:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891136.474210:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd544c1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de2ff expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.474322:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544c8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.474344:0:17111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd5449e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2f1 expref: 12 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.474354:0:17111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544c8 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.474406:0:17111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd5449e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2f1 expref: 12 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.474421:0:17111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd5449e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2f1 expref: 12 pid: 18639 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891136.474433:0:17111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17111:1875787997426944:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891136.474508:0:17111:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82263780 going to sleep for 11 seconds 00000100:00100000:3.0:1788891136.477263:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891136.477282:0:17111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17111:1875787997426944:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891136.477311:0:17111:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544c8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891136.477389:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987936128 00000100:00100000:0.0:1788891136.477396:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987936128 00010000:00010000:0.0:1788891136.477426:0:17094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd5449e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2f1 expref: 13 pid: 18639 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891136.477456:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:0.0:1788891136.477465:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+13:2394:x1875787987936128:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891136.477477:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891136.477484:0:17094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd5449e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2f1 expref: 13 pid: 18639 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.477497:0:17094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd5449e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2f1 expref: 13 pid: 18639 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.477519:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd5449e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2f1 expref: 13 pid: 18639 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.477561:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:0.0:1788891136.477579:0:17094:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544c8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.477589:0:17094:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544c8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.477597:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544c8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.477613:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891136.477733:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+12:2394:x1875787987936128:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 268us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891136.477741:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 16 00010000:00010000:2.0:1788891136.477840:0:17111:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544c8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.477847:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544c8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.477870:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd544cf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.477879:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd544cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.477887:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd544cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.478374:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd544d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.478390:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd544d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.478398:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd544d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891136.478410:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788891136.478433:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544c8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.478439:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544c8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.478447:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544c8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.478453:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891136.478457:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544c8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.478464:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544c8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.478472:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:2.0:1788891136.478475:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891136.478478:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544c8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.478485:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544c8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788891136.478495:0:17111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003237110 reply state 00000000e2aac75c transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd544cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.478510:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd544cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.478516:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff924f82e37f00) 00010000:00010000:2.0:1788891136.478519:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788891136.478575:0:17111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788891136.478606:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd544c1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2ff expref: 15 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.478620:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd544d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2ff expref: 14 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.478628:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:2.0:1788891136.478630:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788891136.478632:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813eda00, rc 0) 00000100:00100000:2.0:1788891136.478663:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+15:15557:x1875787987936000:12345-192.168.204.26@tcp:101:bash.0 Request processed in 4510us (4662us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788891136.478670:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:0.0:1788891136.498148:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891136.498245:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987936256 00000100:00100000:2.0:1788891136.498255:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987936256 00000100:00100000:2.0:1788891136.498351:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:2.0:1788891136.498362:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+15:15557:x1875787987936256:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788891136.498386:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891136.498406:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd544e4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de306 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.498475:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544eb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.498513:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.498562:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891136.498614:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788891136.498619:0:17110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788891136.498641:0:17110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.498652:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.498676:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd544e4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de306 expref: 17 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.498707:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de306 expref: 16 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.498716:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:2.0:1788891136.498719:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891136.498723:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ed200, rc 0) 00000100:00100000:2.0:1788891136.498798:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+16:15557:x1875787987936256:12345-192.168.204.26@tcp:101:bash.0 Request processed in 438us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891136.498805:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:1.0:1788891136.501553:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891136.501755:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987936512 00000100:00100000:2.0:1788891136.501767:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987936512 00000100:00100000:2.0:1788891136.501822:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:2.0:1788891136.501843:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+16:15557:x1875787987936512:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:2.0:1788891136.502120:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+17:15557:x1875787987936512:12345-192.168.204.26@tcp:35:bash.0 Request processed in 278us (596us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788891136.502127:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:3.0:1788891136.557513:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891136.557725:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987936768 00000100:00100000:1.0:1788891136.557736:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987936768 00000100:00100000:1.0:1788891136.557809:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:1.0:1788891136.557821:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+17:15567:x1875787987936768:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788891136.557851:0:18639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891136.557875:0:18639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd544f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de30d expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891136.558076:0:18639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788891136.558192:0:18639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd544f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de30d expref: 19 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.558207:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e37a00) 00010000:00010000:1.0:1788891136.558211:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788891136.558217:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd544f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de30d expref: 19 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.558231:0:18639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857de000, rc 0) 00000100:00100000:1.0:1788891136.558366:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+18:15567:x1875787987936768:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 546us (861us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788891136.558373:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:0.0:1788891136.564616:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891136.564842:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987937024 00000100:00100000:1.0:1788891136.564852:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987937024 00000100:00100000:1.0:1788891136.564912:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:1.0:1788891136.564922:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+18:15567:x1875787987937024:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:1.0:1788891136.565151:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+19:15567:x1875787987937024:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 230us (543us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788891136.565159:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 6 00010000:00010000:2.0:1788891136.571939:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891136.594908:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891136.595012:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987937280 00000100:00100000:1.0:1788891136.595022:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987937280 00000100:00100000:1.0:1788891136.595146:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00100000:1.0:1788891136.595159:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+19:15570:x1875787987937280:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788891136.595188:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891136.595223:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd54500 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de314 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.595340:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd54507 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.595354:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd54507 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.595366:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd54507 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891136.595379:0:17109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788891136.596319:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd54500 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de314 expref: 22 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.596343:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd54507 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de314 expref: 21 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.596352:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:1.0:1788891136.596355:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788891136.596358:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857df000, rc 0) 00000100:00100000:1.0:1788891136.596598:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+21:15570:x1875787987937280:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1436us (1691us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788891136.596612:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00100000:3.0:1788891136.600630:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891136.600728:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987937408 00000100:00100000:1.0:1788891136.600738:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987937408 00000100:00100000:1.0:1788891136.600879:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 41 00000100:00100000:1.0:1788891136.600890:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+21:15570:x1875787987937408:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:1.0:1788891136.600970:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd54515 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.600985:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd54515 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.600996:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd54515 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.601032:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd54515 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.601038:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd54515 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.601045:0:18639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd54515 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.601220:0:18639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857dfe00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891136.601225:0:18639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd54515 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.601233:0:18639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd54515 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.601246:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:1.0:1788891136.601248:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788891136.601253:0:18639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd54515 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.601259:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd54515 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891136.601392:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+21:15570:x1875787987937408:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 502us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891136.601400:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 41 00000100:00100000:0.0:1788891136.835933:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891136.836128:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987937664 00000100:00100000:2.0:1788891136.836139:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987937664 00000100:00100000:2.0:1788891136.836277:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:2.0:1788891136.836288:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+21:15607:x1875787987937664:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:2.0:1788891136.836308:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891136.836497:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd5451c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de31b expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.836872:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54523 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.837007:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd544d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2ff expref: 22 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.837017:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544eb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de306 expref: 22 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.837026:0:17110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54523 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.837143:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de306 expref: 22 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.837181:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544eb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de306 expref: 22 pid: 17110 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891136.837197:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997427072:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891136.837293:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd544d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2ff expref: 22 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.837303:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd544d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2ff expref: 22 pid: 17111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891136.837319:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4886d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997427200:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891136.837342:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82263240 going to sleep for 11 seconds 00000100:00100000:3.0:1788891136.840973:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891136.841272:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987937792 00000100:00100000:1.0:1788891136.841281:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987937792 00000100:00100000:0.0:1788891136.841294:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997427072:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891136.841307:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4886d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997427200:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891136.841328:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544eb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de306 expref: 23 pid: 17110 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891136.841342:0:17110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54523 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891136.841379:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:1.0:1788891136.841390:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+23:2393:x1875787987937792:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891136.841406:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891136.841412:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544eb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de306 expref: 23 pid: 17110 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.841425:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de306 expref: 23 pid: 17110 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.841449:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd544eb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de306 expref: 23 pid: 17110 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.841466:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:1.0:1788891136.841471:0:17095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54523 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.841481:0:17095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54523 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.841506:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891136.841621:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+22:2393:x1875787987937792:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 232us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891136.841628:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:2.0:1788891136.844440:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891136.844514:0:20136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987937920 00000100:00100000:3.0:1788891136.844553:0:20136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987937920 00010000:00010000:3.0:1788891136.844594:0:20136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd544d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2ff expref: 22 pid: 17111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891136.844621:0:20136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:3.0:1788891136.844629:0:20136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+22:2394:x1875787987937920:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891136.844642:0:20136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891136.844648:0:20136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd544d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2ff expref: 22 pid: 17111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.844661:0:20136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd544d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2ff expref: 22 pid: 17111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.844714:0:20136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd544d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2ff expref: 22 pid: 17111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.844729:0:20136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:3.0:1788891136.844734:0:20136:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54523 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.844748:0:20136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54523 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.844756:0:20136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54523 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.844788:0:20136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891136.844849:0:20136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4886680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+21:2394:x1875787987937920:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 221us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891136.844863:0:20136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 18 00010000:00010000:2.0:1788891136.845119:0:17110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54523 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.845127:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54523 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891136.845146:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788891136.845280:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd5451c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de31b expref: 22 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.845301:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54523 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de31b expref: 21 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891136.845321:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:2.0:1788891136.845323:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788891136.845326:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ed800, rc 0) 00000100:00100000:2.0:1788891136.845356:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+21:15607:x1875787987937664:12345-192.168.204.26@tcp:101:dd.0 Request processed in 9071us (9434us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788891136.845363:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:2.0:1788891136.847126:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891136.847193:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987938048 00000100:00100000:3.0:1788891136.847202:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987938048 00000100:00100000:3.0:1788891136.847258:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:3.0:1788891136.847268:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+21:15607:x1875787987938048:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:3.0:1788891136.847292:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891136.847311:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd54531 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de322 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.847344:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54538 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.847372:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54538 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.847384:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54538 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.847502:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd54531 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de322 expref: 23 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.847636:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54538 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de322 expref: 22 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891136.847646:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:3.0:1788891136.847649:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788891136.847652:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8be00, rc 0) 00000100:00100000:3.0:1788891136.847751:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+22:15607:x1875787987938048:12345-192.168.204.26@tcp:101:dd.0 Request processed in 484us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891136.847758:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:3.0:1788891136.853614:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891136.853762:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987938304 00000100:00100000:1.0:1788891136.853774:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987938304 00000100:00100000:1.0:1788891136.853837:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 44 00000100:00100000:1.0:1788891136.853849:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+22:15607:x1875787987938304:12345-192.168.204.26@tcp:36:dd.0 00010000:00010000:1.0:1788891136.854100:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5453f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.854117:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5453f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.854127:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5453f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788891136.854170:0:17109:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934606 00000004:00010000:1.0:1788891136.854206:0:17109:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfedb328 reply state 0000000064b8551d transno 8589934607 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5453f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.854219:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5453f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891136.854227:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:1.0:1788891136.854230:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788891136.854233:0:17109:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788891136.854327:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+25:15607:x1875787987938304:12345-192.168.204.26@tcp:36:dd.0 Request processed in 480us (722us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788891136.854343:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 44 00000020:00080000:1.0:1788891136.854349:0:17109:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1788891136.892339:0:17147:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788891137.024941:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891137.025046:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987938432 00000100:00100000:3.0:1788891137.025058:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987938432 00000100:00100000:3.0:1788891137.025131:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00100000:3.0:1788891137.025143:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+25:15621:x1875787987938432:12345-192.168.204.26@tcp:101:stat.0 00010000:00010000:3.0:1788891137.025169:0:18639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891137.025196:0:18639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd54546 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de329 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.025289:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd5454d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.025304:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd5454d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.025314:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd5454d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.025325:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd54554 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.025333:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd54554 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.025340:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd54554 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.025418:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5455b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.025430:0:18639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54523 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de31b expref: 26 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.025437:0:18639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5455b lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.025472:0:18639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54523 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de31b expref: 26 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.025497:0:18639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54523 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de31b expref: 26 pid: 17110 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891137.025512:0:18639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84290000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18639:1875787997427328:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788891137.025636:0:18639:0:(client.c:2715:ptlrpc_set_wait()) set ffff925082d22000 going to sleep for 11 seconds 00000100:00100000:3.0:1788891137.029202:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891137.029578:0:18639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84290000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18639:1875787997427328:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891137.029606:0:18639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5455b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891137.029843:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987938688 00000100:00100000:2.0:1788891137.029851:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987938688 00000100:00100000:2.0:1788891137.029905:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:2.0:1788891137.029914:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+27:14868:x1875787987938688:12345-192.168.204.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788891137.030167:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+28:14868:x1875787987938688:12345-192.168.204.26@tcp:35:ldlm_bl.0 Request processed in 254us (973us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788891137.030176:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:0.0:1788891137.038269:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891137.038424:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987938816 00000100:00100000:1.0:1788891137.038435:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987938816 00010000:00010000:1.0:1788891137.038484:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54523 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de31b expref: 28 pid: 17110 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891137.038609:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:1.0:1788891137.038620:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+28:2394:x1875787987938816:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891137.038638:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891137.038646:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54523 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de31b expref: 28 pid: 17110 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.038661:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54523 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de31b expref: 28 pid: 17110 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.038696:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54523 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de31b expref: 28 pid: 17110 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.038713:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:1.0:1788891137.038718:0:17095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5455b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.038742:0:17095:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5455b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.038751:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5455b lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.038788:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891137.038917:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+27:2394:x1875787987938816:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 297us (659us total) trans 0 rc 0/0 00010000:00010000:3.0:1788891137.038926:0:18639:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5455b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891137.038926:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 19 00010000:00010000:3.0:1788891137.038938:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5455b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891137.038999:0:18639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788891137.039005:0:18639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891137.039048:0:18639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5455b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.039109:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5455b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.039121:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd5454d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.039128:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd5454d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.039135:0:18639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd5454d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.039141:0:18639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8ac00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891137.039154:0:18639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd5454d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.039161:0:18639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd5454d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.039173:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:3.0:1788891137.039176:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891137.039241:0:18639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd5454d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.039249:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd5454d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.039263:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd54554 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.039270:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd54554 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.039275:0:18639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd54554 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.039280:0:18639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8bc00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891137.039284:0:18639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd54554 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.039289:0:18639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd54554 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.039298:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff924f82e37f00) 00010000:00010000:3.0:1788891137.039301:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891137.039313:0:18639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd54554 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.039319:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd54554 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.039368:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd54546 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de329 expref: 27 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.039385:0:18639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5455b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de329 expref: 26 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.039399:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:3.0:1788891137.039402:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788891137.039404:0:18639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8a200, rc 0) 00000100:00100000:3.0:1788891137.039448:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+26:15621:x1875787987938432:12345-192.168.204.26@tcp:101:stat.0 Request processed in 14308us (14516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891137.039456:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 45 00000040:00080000:1.0:1788891137.085450:0:17861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788891137.089638:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891137.090128:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987939072 00000100:00100000:1.0:1788891137.090139:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987939072 00000100:00100000:1.0:1788891137.090252:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 46 00000100:00100000:1.0:1788891137.090263:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+26:15627:x1875787987939072:12345-192.168.204.26@tcp:36:truncate.0 00010000:00010000:1.0:1788891137.090318:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891137.090345:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5455b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de329 expref: 26 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.090365:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:1.0:1788891137.090369:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788891137.090602:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd54562 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.090616:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd54562 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.090626:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd54562 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788891137.090694:0:17109:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788891137.090716:0:17109:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005975f8d8 reply state 0000000046c8d6b0 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd54562 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.090729:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd54562 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.090736:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:1.0:1788891137.090738:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788891137.090741:0:17109:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788891137.090855:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+28:15627:x1875787987939072:12345-192.168.204.26@tcp:36:truncate.0 Request processed in 593us (1226us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788891137.090862:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 46 00000020:00080000:1.0:1788891137.090867:0:17109:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788891137.147935:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788891137.147957:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997427456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788891137.148033:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891137.148233:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997427584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788891137.148268:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891137.148294:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997428096:0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.148324:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891137.148349:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997428608:0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.148380:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891137.148397:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997427712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788891137.148413:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997429120:0@lo:400:kworker.0 00000100:00100000:3.0:1788891137.148438:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891137.148449:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891137.148465:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997428224:0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.148474:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788891137.148483:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997427968:0@lo:400:kworker.0 00000100:00100000:3.0:1788891137.148495:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891137.148515:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891137.148518:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997428736:0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.148559:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997428480:0@lo:400:kworker.0 00000100:00100000:3.0:1788891137.148571:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891137.148589:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891137.148594:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788891137.148603:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997427840:0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.148612:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1875787997428992:0@lo:400:kworker.0 00000100:00100000:0.0:1788891137.148692:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997427456 00000100:00100000:1.0:1788891137.148697:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997428608 00000100:00100000:0.0:1788891137.148701:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997427456 00000100:00100000:1.0:1788891137.148705:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997428608 00000100:00100000:0.0:1788891137.148744:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997427584 00000100:00100000:1.0:1788891137.148746:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997429120 00000100:00100000:0.0:1788891137.148749:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997427584 00000100:00100000:1.0:1788891137.148751:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997429120 00000100:00100000:1.0:1788891137.148769:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997428224 00000100:00100000:1.0:1788891137.148772:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997428224 00000100:00100000:0.0:1788891137.148787:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788891137.148792:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997428736 00000100:00100000:1.0:1788891137.148796:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997428736 00000100:00100000:0.0:1788891137.148799:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997427456:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788891137.148813:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788891137.148823:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997428608:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788891137.148829:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788891137.149281:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891137.149312:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997428096 00000100:00100000:2.0:1788891137.149322:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997428096 00000100:00100000:3.0:1788891137.149333:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891137.149353:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997428480 00000100:00100000:2.0:1788891137.149357:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997428480 00000100:00100000:3.0:1788891137.149380:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997428352:0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.149401:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788891137.149410:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891137.149413:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997428096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891137.149432:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997428864:0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.149461:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997428096:12345-0@lo:400:kworker.0 Request processed in 52us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891137.149462:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891137.149472:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788891137.149492:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788891137.149495:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997427712 00000100:00100000:2.0:1788891137.149500:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997428480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891137.149501:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997427712 00000100:00100000:3.0:1788891137.149552:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997427968 00000100:00100000:3.0:1788891137.149555:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997427968 00000100:00100000:3.0:1788891137.149569:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997428352 00000100:00100000:2.0:1788891137.149570:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997428480:12345-0@lo:400:kworker.0 Request processed in 70us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891137.149573:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997428352 00000100:00100000:2.0:1788891137.149580:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788891137.149589:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788891137.149597:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3627:x1875787997427712:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788891137.149604:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788891137.149612:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997427968:12345-0@lo:400:kworker.0 00000004:00000024:3.0:1788891137.149621:0:17934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788891137.149647:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997427968:12345-0@lo:400:kworker.0 Request processed in 36us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891137.149660:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788891137.149666:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3627:x1875787997427712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891137.149685:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788891137.149693:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788891137.149701:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997428352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891137.149733:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997427712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788891137.149741:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997428352:12345-0@lo:400:kworker.0 Request processed in 40us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891137.149749:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788891137.149764:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997428352:0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.149787:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997427968:0@lo:400:kworker.0 00000100:00100000:3.0:1788891137.149789:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997428992 00000100:00100000:3.0:1788891137.149795:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997428992 00000100:00100000:2.0:1788891137.149802:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997428480:0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.149813:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997428096:0@lo:400:kworker.0 00000100:00100000:3.0:1788891137.149820:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997428864 00000100:00100000:3.0:1788891137.149824:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997428864 00000100:00100000:2.0:1788891137.149936:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788891137.149944:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875787997429120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.149975:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875787997429120:12345-0@lo:400:kworker.0 Request processed in 34us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891137.149981:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788891137.150005:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84293800 x1875787997429120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891137.150016:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997429120:0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.150030:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788891137.150036:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997428224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.150067:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997428224:12345-0@lo:400:kworker.0 Request processed in 31us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891137.150073:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788891137.150090:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788891137.150095:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997428736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.150118:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997428736:12345-0@lo:400:kworker.0 Request processed in 24us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891137.150124:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788891137.150132:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788891137.150136:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875787997428992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.150158:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1875787997428992:12345-0@lo:400:kworker.0 Request processed in 21us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891137.150163:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788891137.150180:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1875787997428992:0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.150193:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788891137.150198:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997428864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.150220:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997428864:12345-0@lo:400:kworker.0 Request processed in 22us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891137.150225:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788891137.150257:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84292680 x1875787997428864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891137.150266:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997428864:0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.150275:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997428224:0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.150282:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997428736:0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.150329:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997427840 00000100:00100000:2.0:1788891137.150333:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997427840 00000100:00100000:2.0:1788891137.150356:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788891137.150366:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+24:3627:x1875787997427840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891137.150397:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+24:3627:x1875787997427840:12345-0@lo:400:kworker.0 Request processed in 31us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891137.150403:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788891137.150431:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997427840:0@lo:400:kworker.0 00000100:00080000:2.0:1788891137.150452:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788891137.150456:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788891137.150458:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788891137.150461:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788891137.153718:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997427456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4913us (5675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891137.153734:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788891137.153764:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788891137.153777:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997427584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788891137.153801:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788891137.153874:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997427584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (5608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891137.153880:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788891137.154038:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997427456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788891137.154062:0:3630:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788891137.154076:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997427584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788891137.154698:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997428608:12345-0@lo:400:kworker.0 Request processed in 5873us (6314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891137.154709:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788891137.155081:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997428608:0@lo:400:kworker.0 00000100:00100000:1.0:1788891137.229625:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891137.229743:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987939200 00000100:00100000:2.0:1788891137.229755:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987939200 00000100:00100000:2.0:1788891137.229826:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:2.0:1788891137.229837:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+28:15641:x1875787987939200:12345-192.168.204.26@tcp:101:stat.0 00010000:00010000:2.0:1788891137.229873:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891137.229894:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd54569 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de330 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.229971:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54570 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.229985:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54570 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230016:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54570 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230030:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54577 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230037:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54577 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230044:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54577 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230133:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5457e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230143:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5457e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230151:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5457e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891137.230200:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1788891137.230204:0:17111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788891137.230227:0:17111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5457e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230240:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5457e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230248:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54570 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230268:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54570 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230276:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54570 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230282:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ec600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891137.230287:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54570 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230295:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54570 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230308:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:2.0:1788891137.230312:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891137.230316:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54570 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230323:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54570 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230338:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54577 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230345:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54577 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230352:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54577 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230357:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891137.230367:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54577 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230374:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54577 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230383:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff924f82e37f00) 00010000:00010000:2.0:1788891137.230386:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891137.230389:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54577 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230396:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54577 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230425:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd54569 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de330 expref: 30 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230439:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5457e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de330 expref: 29 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.230448:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:2.0:1788891137.230450:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891137.230453:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813eda00, rc 0) 00000100:00100000:2.0:1788891137.230580:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+29:15641:x1875787987939200:12345-192.168.204.26@tcp:101:stat.0 Request processed in 687us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891137.230587:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:3.0:1788891137.302972:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891137.303427:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987939456 00000100:00100000:0.0:1788891137.303437:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987939456 00000100:00100000:1.0:1788891137.303730:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 48 00000100:00100000:1.0:1788891137.303810:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+29:15651:x1875787987939456:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788891137.303834:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891137.303903:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd54585 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de337 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891137.303997:0:17109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788891137.304078:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd54585 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de337 expref: 31 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.304093:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e37a00) 00010000:00010000:1.0:1788891137.304096:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788891137.304101:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd54585 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de337 expref: 31 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.304114:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250857de000, rc 0) 00000100:00100000:1.0:1788891137.304216:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+30:15651:x1875787987939456:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 458us (1251us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788891137.304224:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 48 00000100:00100000:3.0:1788891137.308828:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891137.308922:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987939712 00000100:00100000:2.0:1788891137.308931:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987939712 00000100:00100000:2.0:1788891137.308993:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:2.0:1788891137.309004:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+30:15651:x1875787987939712:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788891137.309243:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+31:15651:x1875787987939712:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 240us (425us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788891137.309252:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:3.0:1788891137.364932:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891137.365086:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987939968 00000100:00100000:2.0:1788891137.365097:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987939968 00000100:00100000:2.0:1788891137.365162:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 49 00000100:00100000:2.0:1788891137.365180:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+31:15657:x1875787987939968:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788891137.365205:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891137.365227:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd54593 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de33e expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.365919:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd5459a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.365938:0:17111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5457e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de330 expref: 32 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.365947:0:17111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd5459a lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.365982:0:17111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5457e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de330 expref: 32 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.365997:0:17111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5457e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de330 expref: 32 pid: 17111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891137.366010:0:17111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090312300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17111:1875787997429248:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891137.366110:0:17111:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8215b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788891137.369006:0:17111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090312300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17111:1875787997429248:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891137.369034:0:17111:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd5459a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891137.369556:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891137.370294:0:20136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987940096 00000100:00100000:0.0:1788891137.370304:0:20136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987940096 00010000:00010000:0.0:1788891137.370346:0:20136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5457e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de330 expref: 33 pid: 17111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891137.370386:0:20136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:0.0:1788891137.370396:0:20136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b660e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+33:2393:x1875787987940096:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891137.370416:0:20136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891137.370425:0:20136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5457e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de330 expref: 33 pid: 17111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.370439:0:20136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5457e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de330 expref: 33 pid: 17111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.370481:0:20136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5457e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de330 expref: 33 pid: 17111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.370499:0:20136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:0.0:1788891137.370505:0:20136:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd5459a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.370515:0:20136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd5459a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.370567:0:20136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd5459a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.370595:0:20136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891137.370680:0:17111:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd5459a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.370689:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd5459a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891137.370708:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000100:00100000:0.0:1788891137.370709:0:20136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b660e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+32:2393:x1875787987940096:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 312us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891137.370723:0:20136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 20 00010000:00010000:2.0:1788891137.370906:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd54593 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de33e expref: 33 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.370921:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd5459a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de33e expref: 32 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.370940:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:2.0:1788891137.370942:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788891137.370945:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ed800, rc 0) 00000100:00100000:2.0:1788891137.370975:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+32:15657:x1875787987939968:12345-192.168.204.26@tcp:101:bash.0 Request processed in 5805us (6053us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788891137.370983:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 49 00000100:00100000:3.0:1788891137.373128:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891137.373386:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987940352 00000100:00100000:0.0:1788891137.373394:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987940352 00000100:00100000:0.0:1788891137.373456:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 50 00000100:00100000:0.0:1788891137.373465:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+32:15657:x1875787987940352:12345-192.168.204.26@tcp:36:bash.0 00010000:00010000:0.0:1788891137.373728:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd545a8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.373745:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd545a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.373754:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd545a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788891137.373809:0:18639:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934614 00000004:00010000:0.0:1788891137.373831:0:18639:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006796694a reply state 00000000f61ba27b transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd545a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.373843:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd545a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.373851:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:0.0:1788891137.373853:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788891137.373863:0:18639:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788891137.373955:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+35:15657:x1875787987940352:12345-192.168.204.26@tcp:36:bash.0 Request processed in 491us (835us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788891137.373962:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 50 00000020:00080000:0.0:1788891137.373968:0:18639:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788891137.380178:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891137.380726:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987940480 00000100:00100000:0.0:1788891137.380736:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987940480 00000100:00100000:0.0:1788891137.380894:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:0.0:1788891137.380905:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+35:15657:x1875787987940480:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788891137.380930:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891137.380960:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd545af lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de345 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.381061:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd545b6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.381076:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd5459a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de33e expref: 36 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.381097:0:17110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd545b6 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.381129:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd5459a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de33e expref: 36 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.381143:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd5459a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de33e expref: 36 pid: 17111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891137.381156:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83891880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997429376:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891137.381235:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8324d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788891137.383179:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891137.383301:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987940608 00000100:00100000:2.0:1788891137.383309:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987940608 00010000:00010000:2.0:1788891137.383342:0:17096:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd5459a lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de33e expref: 37 pid: 17111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891137.383404:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:2.0:1788891137.383413:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+37:2394:x1875787987940608:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891137.383427:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891137.383434:0:17096:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd5459a lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de33e expref: 37 pid: 17111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.383447:0:17096:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd5459a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de33e expref: 37 pid: 17111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.383468:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:2.0:1788891137.383473:0:17096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd545b6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.383483:0:17096:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd545b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.383490:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd545b6 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.383509:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891137.383583:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+37:2394:x1875787987940608:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 170us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891137.383591:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 21 00010000:00010000:0.0:1788891137.383911:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd5459a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de33e expref: 36 pid: 17111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891137.383929:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83891880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997429376:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788891137.383951:0:17110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd545b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.383959:0:17110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd545b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.383965:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd545b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891137.384014:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788891137.384018:0:17110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788891137.384047:0:17110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd545b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.384085:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd545af lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de345 expref: 36 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.384099:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd545b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de345 expref: 35 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.384107:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:0.0:1788891137.384109:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788891137.384112:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5400, rc 0) 00000100:00100000:0.0:1788891137.384147:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+35:15657:x1875787987940480:12345-192.168.204.26@tcp:101:bash.0 Request processed in 3245us (3981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891137.384154:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:3.0:1788891137.386783:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891137.386910:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987940864 00000100:00100000:2.0:1788891137.386920:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987940864 00000100:00100000:2.0:1788891137.387025:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:2.0:1788891137.387035:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+35:15657:x1875787987940864:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:2.0:1788891137.387283:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+36:15657:x1875787987940864:12345-192.168.204.26@tcp:35:bash.0 Request processed in 248us (508us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1788891137.387291:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:3.0:1788891137.458032:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891137.458157:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987941120 00000100:00100000:0.0:1788891137.458166:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987941120 00000100:00100000:0.0:1788891137.458233:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:0.0:1788891137.458245:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+36:15667:x1875787987941120:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891137.458269:0:18639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891137.458288:0:18639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd545bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de34c expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891137.458380:0:18639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788891137.458479:0:18639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd545bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de34c expref: 38 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.458493:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e37a00) 00010000:00010000:0.0:1788891137.458497:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788891137.458512:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd545bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de34c expref: 38 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.458555:0:18639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5a00, rc 0) 00000100:00100000:0.0:1788891137.458617:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+37:15667:x1875787987941120:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 375us (594us total) trans 8589934617 rc 301/301 00000100:00100000:0.0:1788891137.458625:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:3.0:1788891137.463610:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891137.463720:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987941248 00000100:00100000:2.0:1788891137.463729:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987941248 00000100:00100000:2.0:1788891137.463788:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 53 00000100:00100000:2.0:1788891137.463798:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+37:15667:x1875787987941248:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:2.0:1788891137.463882:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd545cb lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.463977:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd545cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.463993:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd545cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464005:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd545d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464011:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd545d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464017:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd545d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464083:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd545d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464092:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd545d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464123:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd545d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788891137.464167:0:17111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd545d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464180:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd545cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464186:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd545cb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464193:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd545cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464198:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891137.464201:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd545cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464207:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd545cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464217:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:2.0:1788891137.464219:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891137.464222:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd545cb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464228:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd545cb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464238:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd545d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464250:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd545d2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464256:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd545d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464260:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ec600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891137.464262:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd545d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464267:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd545d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464273:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff924f82e37f00) 00010000:00010000:2.0:1788891137.464275:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891137.464277:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd545d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464281:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd545d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464289:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd545d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464294:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd545d9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464299:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd545d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464304:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891137.464309:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd545d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464315:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd545d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464322:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:2.0:1788891137.464324:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891137.464326:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd545d9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.464331:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd545d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891137.464440:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+37:15667:x1875787987941248:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 643us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891137.464448:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 53 00000100:00100000:3.0:1788891137.466429:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891137.466519:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987941504 00000100:00100000:1.0:1788891137.466596:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987941504 00000100:00100000:1.0:1788891137.466689:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:1.0:1788891137.466700:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f81fde850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+37:15667:x1875787987941504:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:1.0:1788891137.466908:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f81fde850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+38:15667:x1875787987941504:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 209us (485us total) trans 8589934618 rc 0/0 00000100:00100000:1.0:1788891137.466916:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:3.0:1788891137.501030:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891137.501176:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987941760 00000100:00100000:1.0:1788891137.501196:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987941760 00000100:00100000:1.0:1788891137.501250:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 54 00000100:00100000:1.0:1788891137.501258:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+38:15670:x1875787987941760:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788891137.501278:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891137.501293:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd545e0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de353 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501352:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd545e7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501362:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd545e7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501370:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd545e7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501377:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd545ee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501382:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd545ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501386:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd545ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501472:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd545f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501478:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd545f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501481:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd545f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891137.501493:0:17109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788891137.501590:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd545e7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501598:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd545e7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501605:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd545e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501611:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857dfe00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891137.501615:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd545e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501622:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd545e7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501633:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:1.0:1788891137.501637:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891137.501641:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd545e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501647:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfe00/0xa66601b03fd545e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501659:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd545ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501676:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd545ee lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501691:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd545ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501697:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891137.501700:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd545ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501707:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd545ee lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501715:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff924f82e37f00) 00010000:00010000:1.0:1788891137.501718:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891137.501721:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd545ee lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501731:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd545ee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501766:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857de000/0xa66601b03fd545e0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de353 expref: 41 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501779:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd545f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de353 expref: 40 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.501786:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:1.0:1788891137.501788:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788891137.501791:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7c00, rc 0) 00000100:00100000:1.0:1788891137.502011:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+40:15670:x1875787987941760:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 751us (990us total) trans 8589934619 rc 0/0 00000100:00100000:1.0:1788891137.502026:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 54 00000100:00100000:3.0:1788891137.504328:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891137.504435:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987942016 00000100:00100000:2.0:1788891137.504446:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987942016 00000100:00100000:2.0:1788891137.504552:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:2.0:1788891137.504563:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+40:15670:x1875787987942016:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788891137.504821:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+41:15670:x1875787987942016:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 259us (502us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788891137.504830:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:3.0:1788891137.506201:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891137.506275:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987942144 00000100:00100000:2.0:1788891137.506284:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987942144 00000100:00100000:2.0:1788891137.506372:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:2.0:1788891137.506381:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+41:2393:x1875787987942144:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891137.506395:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891137.506431:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd545f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de353 expref: 41 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.506449:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:2.0:1788891137.506454:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891137.506500:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+40:2393:x1875787987942144:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 120us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891137.506507:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:3.0:1788891137.507233:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891137.507302:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987942272 00000100:00100000:1.0:1788891137.507308:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987942272 00000100:00100000:1.0:1788891137.507350:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00100000:1.0:1788891137.507358:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+40:15670:x1875787987942272:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:1.0:1788891137.507409:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54603 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.507426:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54603 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.507436:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54603 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.507470:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54603 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.507477:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54603 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.507484:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54603 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.507490:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891137.507494:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54603 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.507501:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54603 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.507510:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:1.0:1788891137.507539:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788891137.507545:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54603 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.507551:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54603 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891137.507598:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+40:15670:x1875787987942272:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 241us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891137.507605:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 55 00010000:00010000:2.0:1788891137.595714:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891137.648649:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891137.648735:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987942400 00000100:00100000:0.0:1788891137.648746:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987942400 00000100:00100000:0.0:1788891137.648811:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 56 00000100:00100000:0.0:1788891137.648822:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+40:15689:x1875787987942400:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891137.648841:0:18639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891137.648862:0:18639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd5460a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de35a expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.648926:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd54611 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.648940:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd54611 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.648950:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd54611 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891137.648995:0:18639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788891137.649000:0:18639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788891137.649019:0:18639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd54611 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.649044:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd5460a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de35a expref: 42 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.649079:0:18639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd54611 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de35a expref: 41 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.649088:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:0.0:1788891137.649091:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788891137.649095:0:18639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4c00, rc 0) 00000100:00100000:0.0:1788891137.649152:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+41:15689:x1875787987942400:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 332us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891137.649160:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 56 00000100:00100000:3.0:1788891137.653334:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891137.653437:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987942784 00000100:00100000:1.0:1788891137.653447:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987942784 00000100:00100000:1.0:1788891137.653511:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:1.0:1788891137.653551:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+41:15689:x1875787987942784:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:1.0:1788891137.653862:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+42:15689:x1875787987942784:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 341us (537us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1788891137.653870:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:3.0:1788891137.655952:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891137.656169:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987942912 00000100:00100000:2.0:1788891137.656178:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987942912 00000100:00100000:2.0:1788891137.656239:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:2.0:1788891137.656249:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+42:15689:x1875787987942912:12345-192.168.204.26@tcp:103:lfs.0 00010000:00010000:2.0:1788891137.656263:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788891137.656286:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd545b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de345 expref: 42 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.656307:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df000/0xa66601b03fd54507 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de314 expref: 41 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.656316:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:2.0:1788891137.656320:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891137.656408:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+40:15689:x1875787987942912:12345-192.168.204.26@tcp:103:lfs.0 Request processed in 160us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891137.656416:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:3.0:1788891137.658602:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891137.658813:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987943040 00000100:00100000:1.0:1788891137.658822:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987943040 00000100:00100000:1.0:1788891137.658877:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 57 00000100:00100000:1.0:1788891137.658887:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+40:15689:x1875787987943040:12345-192.168.204.26@tcp:58:lfs.0 00010000:00010000:1.0:1788891137.658994:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54618 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.659011:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54618 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.659023:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54618 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788891137.660372:0:17110:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788891137.660404:0:17110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788891137.660698:0:17110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788891137.660844:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+40:15689:x1875787987943040:12345-192.168.204.26@tcp:58:lfs.0 Request processed in 1945us (2236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891137.660855:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 57 00000100:00100000:3.0:1788891137.679163:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891137.679379:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987943168 00000100:00100000:0.0:1788891137.679389:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987943168 00000100:00100000:0.0:1788891137.679488:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 58 00000100:00100000:0.0:1788891137.679499:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+40:15691:x1875787987943168:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891137.679519:0:18639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891137.679560:0:18639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd5461f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de361 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.679624:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd54626 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.679638:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd54626 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.679650:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd54626 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.679674:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5c00/0xa66601b03fd5462d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.679695:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5c00/0xa66601b03fd5462d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.679702:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5c00/0xa66601b03fd5462d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.679919:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54634 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.679931:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54634 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.679938:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54634 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891137.679979:0:18639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788891137.679984:0:18639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788891137.680044:0:18639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54634 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.680056:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54634 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.680064:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd54626 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.680071:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd54626 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.680077:0:18639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd54626 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.680094:0:18639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891137.680098:0:18639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd54626 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.680105:0:18639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd54626 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.680116:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:0.0:1788891137.680119:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891137.680123:0:18639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd54626 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.680128:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd54626 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.680142:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5c00/0xa66601b03fd5462d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.680147:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5c00/0xa66601b03fd5462d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.680153:0:18639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5c00/0xa66601b03fd5462d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.680158:0:18639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891137.680161:0:18639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5c00/0xa66601b03fd5462d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.680166:0:18639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5c00/0xa66601b03fd5462d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.680357:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff924f82e37f00) 00010000:00010000:0.0:1788891137.680360:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891137.680364:0:18639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5c00/0xa66601b03fd5462d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.680369:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5c00/0xa66601b03fd5462d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.680399:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd5461f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de361 expref: 42 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.680418:0:18639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54634 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de361 expref: 41 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.680425:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:0.0:1788891137.680427:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788891137.680430:0:18639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5200, rc 0) 00000100:00100000:0.0:1788891137.680861:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+41:15691:x1875787987943168:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1360us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891137.680869:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 58 00000040:00080000:3.0:1788891137.917968:0:17147:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788891137.917977:0:17147:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788891137.918012:0:17147:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788891137.918019:0:17147:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788891137.918150:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84291500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17147:1875787997429504:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788891137.918240:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8221c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788891137.923810:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84291500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17147:1875787997429504:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788891137.924203:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891137.924516:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987943296 00000100:00100000:2.0:1788891137.924554:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987943296 00000100:00100000:2.0:1788891137.924625:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:2.0:1788891137.924635:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+41:15702:x1875787987943296:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788891137.924679:0:17111:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788891137.924800:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+41:15702:x1875787987943296:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 166us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891137.924809:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:3.0:1788891137.928113:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891137.928211:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987943424 00000100:00100000:1.0:1788891137.928221:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987943424 00000100:00100000:1.0:1788891137.928280:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:1.0:1788891137.928290:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+41:15702:x1875787987943424:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788891137.928364:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5463b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928382:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5463b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928395:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5463b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928451:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54642 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928460:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54642 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928468:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54642 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928495:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd54649 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928518:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd54649 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928566:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd54649 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891137.928620:0:17109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788891137.928625:0:17109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788891137.928640:0:17109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd54649 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928652:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5463b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928670:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5463b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928677:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5463b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928682:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891137.928685:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5463b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928691:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5463b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928703:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff924f82e37d00) 00010000:00010000:1.0:1788891137.928705:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891137.928709:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5463b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928723:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5463b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928743:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54642 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928749:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54642 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928753:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54642 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928757:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891137.928760:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54642 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928764:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54642 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928771:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9250b65fda00) 00010000:00010000:1.0:1788891137.928773:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891137.928775:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54642 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928780:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54642 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928793:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd54649 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928797:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd54649 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928808:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd54649 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928812:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891137.928814:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd54649 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928820:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd54649 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928825:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:1.0:1788891137.928837:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891137.928840:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd54649 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.928846:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd54649 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891137.928919:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+41:15702:x1875787987943424:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 Request processed in 629us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891137.928928:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:0.0:1788891137.934731:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891137.934838:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987943680 00000100:00100000:2.0:1788891137.934850:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987943680 00000100:00100000:2.0:1788891137.934947:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:2.0:1788891137.934959:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+41:15702:x1875787987943680:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891137.934981:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891137.935001:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54650 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de368 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.935106:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54657 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.935121:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.935133:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891137.935145:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788891137.935219:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.935227:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54657 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.935254:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54657 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.935261:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ec600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891137.935265:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54657 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.935273:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54657 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.935286:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:2.0:1788891137.935289:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788891137.935294:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54657 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.935301:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54657 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.935343:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54650 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de368 expref: 43 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.935365:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff924f82e37d00) 00010000:00010000:2.0:1788891137.935368:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788891137.935372:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54650 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de368 expref: 43 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.935383:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ede00, rc 0) 00000100:00100000:2.0:1788891137.935450:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+42:15702:x1875787987943680:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 493us (729us total) trans 8589934622 rc 301/301 00000100:00100000:2.0:1788891137.935466:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:1.0:1788891137.941648:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891137.941762:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987943808 00000100:00100000:2.0:1788891137.941771:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987943808 00000100:00100000:2.0:1788891137.941827:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:2.0:1788891137.941837:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+42:15702:x1875787987943808:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788891137.941874:0:17109:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788891137.941996:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+42:15702:x1875787987943808:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 160us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891137.942004:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:0.0:1788891137.949555:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891137.949623:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987944064 00000100:00100000:1.0:1788891137.949634:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987944064 00000100:00100000:1.0:1788891137.949699:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:1.0:1788891137.949709:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+42:15702:x1875787987944064:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788891137.949730:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891137.949733:0:17110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788891137.949769:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd54611 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de35a expref: 42 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.949785:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:1.0:1788891137.949789:0:17110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788891137.949804:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd54665 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de36f expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788891137.950184:0:17110:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:1.0:1788891137.950196:0:17110:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:1.0:1788891137.950215:0:17110:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:1.0:1788891137.950358:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd5466c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.950372:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd5466c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.950381:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd5466c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.950436:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd54665 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de36f expref: 44 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.950451:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd5466c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de36f expref: 43 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891137.950458:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9250b65fda00) 00010000:00010000:1.0:1788891137.950461:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788891137.950464:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6400, rc 0) 00000100:00100000:1.0:1788891137.950554:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+43:15702:x1875787987944064:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 845us (1031us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1788891137.950569:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:0.0:1788891137.962473:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891137.962566:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987944320 00000100:00100000:3.0:1788891137.962576:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987944320 00000100:00100000:3.0:1788891137.962708:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:3.0:1788891137.962719:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+43:15702:x1875787987944320:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788891137.962788:0:18639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891137.962827:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd5466c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de36f expref: 43 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.962844:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9250b65fda00) 00010000:00010000:3.0:1788891137.962854:0:18639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788891137.962876:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5467a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.962888:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5467a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.962898:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5467a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.962911:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd54681 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xff2ee616 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.963147:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd54681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xff2ee616 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.963157:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd54681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xff2ee616 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.963202:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5467a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.963209:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5467a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.963215:0:18639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5467a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.963221:0:18639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8bc00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891137.963230:0:18639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5467a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.963238:0:18639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5467a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.963246:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:3.0:1788891137.963249:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891137.963253:0:18639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5467a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.963259:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5467a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.963268:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd54681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xff2ee616 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.963273:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd54681 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xff2ee616 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.963279:0:18639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd54681 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xff2ee616 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.963284:0:18639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891137.963286:0:18639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd54681 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xff2ee616 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.963292:0:18639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd54681 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xff2ee616 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.963299:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xff2ee616 (ffff9250905a3900) 00010000:00010000:3.0:1788891137.963302:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891137.963311:0:18639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd54681 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xff2ee616 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891137.963316:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd54681 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xff2ee616 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891137.963699:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+42:15702:x1875787987944320:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 980us (1235us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788891137.963707:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:1.0:1788891137.970397:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891137.970477:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987944448 00000100:00100000:0.0:1788891137.970487:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987944448 00000100:00100000:0.0:1788891137.970571:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:0.0:1788891137.970595:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+42:15702:x1875787987944448:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788891137.970617:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891137.970650:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd54688 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de376 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.970696:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5468f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.970707:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5468f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.970717:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5468f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.970826:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd54688 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de376 expref: 44 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.970854:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5468f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de376 expref: 43 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.970862:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff925085363300) 00010000:00010000:0.0:1788891137.970865:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788891137.970869:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4a00, rc 0) 00000100:00100000:0.0:1788891137.970940:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+43:15702:x1875787987944448:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 348us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891137.970948:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 65 00000100:00100000:0.0:1788891137.975691:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891137.975771:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987944704 00000100:00100000:2.0:1788891137.975781:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987944704 00000100:00100000:2.0:1788891137.975852:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:2.0:1788891137.975863:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+43:15702:x1875787987944704:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788891137.976096:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54696 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.976113:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54696 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.976124:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54696 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788891137.976291:0:17109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1788891137.976302:0:17109:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360220778431ns, next at 361220775858ns, rc = 0 00000004:00010000:2.0:1788891137.976349:0:17109:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2fc29c5 reply state 0000000060882a8a transno 8589934624 ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54696 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.976382:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54696 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891137.976389:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff925085363300) 00010000:00010000:2.0:1788891137.976391:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788891137.976395:0:17109:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788891137.981401:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+45:15702:x1875787987944704:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 5529us (5709us total) trans 8589934624 rc 0/0 00000100:00100000:2.0:1788891137.981414:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 66 00000100:00100000:3.0:1788891137.983621:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891137.985804:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987944832 00000100:00100000:0.0:1788891137.985824:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987944832 00000100:00100000:0.0:1788891137.985959:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:0.0:1788891137.985970:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+45:15702:x1875787987944832:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788891137.985993:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891137.986012:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd5469d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de37d expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.986542:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd5469d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de37d expref: 46 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.986559:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd5469d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de37d expref: 46 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891137.986579:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff925085363300) 00010000:00010000:0.0:1788891137.986583:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788891137.986586:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4600, rc 0) 00000100:00100000:1.0:1788891137.986718:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+46:15702:x1875787987944832:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 744us (3095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891137.986727:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 67 00000100:00100000:1.0:1788891137.991260:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891137.991344:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987944960 00000100:00100000:3.0:1788891137.991353:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987944960 00000100:00080000:0.0:1788891137.991509:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788891137.991652:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:3.0:1788891137.991675:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+5:2393:x1875787987944960:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788891137.991914:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2393:x1875787987944960:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 241us (662us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788891137.991922:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:1.0:1788891138.001387:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891138.001444:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987945216 00000100:00100000:2.0:1788891138.001455:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987945216 00000100:00100000:2.0:1788891138.001519:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:2.0:1788891138.001555:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+46:15702:x1875787987945216:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00080000:0.0:1788891138.001714:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788891138.001795:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+47:15702:x1875787987945216:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 243us (416us total) trans 8589934625 rc 0/0 00000100:00100000:2.0:1788891138.001804:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:0.0:1788891138.006096:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891138.008574:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987945472 00000100:00100000:3.0:1788891138.008587:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987945472 00000100:00100000:3.0:1788891138.008751:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:3.0:1788891138.008762:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+47:15702:x1875787987945472:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788891138.008893:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+47:15702:x1875787987945472:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 132us (2804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891138.008901:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 68 00000100:00100000:1.0:1788891138.012152:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891138.012231:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987945600 00000100:00100000:3.0:1788891138.012240:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987945600 00000100:00100000:3.0:1788891138.012323:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:3.0:1788891138.012333:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+47:15702:x1875787987945600:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788891138.012360:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891138.012380:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd546a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de384 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.012445:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd546ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.012458:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd546ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.012470:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd546ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891138.012511:0:17111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891138.012552:0:17111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd546ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.012577:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd546a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de384 expref: 49 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.012592:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd546ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de384 expref: 48 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.012600:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff925085363300) 00010000:00010000:3.0:1788891138.012603:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788891138.012606:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8bc00, rc 0) 00000100:00100000:3.0:1788891138.012677:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+48:15702:x1875787987945600:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 344us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891138.012685:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 69 00000100:00100000:3.0:1788891138.015580:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891138.015608:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987945728 00000100:00100000:3.0:1788891138.015616:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987945728 00000100:00100000:3.0:1788891138.015673:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:3.0:1788891138.015684:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2394:x1875787987945728:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788891138.015701:0:18616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891138.015723:0:18616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd546b2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de38b expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788891138.015749:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa05001, blocks: 0x0 00010000:00010000:3.0:1788891138.015768:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1788891138.015772:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891138.015782:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd546b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de38b expref: 7 pid: 18616 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.015801:0:18616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd546b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de38b expref: 7 pid: 18616 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.015813:0:18616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8ac00, rc 0) 00000100:00100000:3.0:1788891138.016045:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:2394:x1875787987945728:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 363us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891138.016053:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:1.0:1788891138.022738:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891138.022968:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987945984 00000100:00100000:2.0:1788891138.022988:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987945984 00000100:00100000:2.0:1788891138.023044:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:2.0:1788891138.023055:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+48:15702:x1875787987945984:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788891138.023509:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+48:15702:x1875787987945984:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 454us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891138.023517:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 70 00000100:00100000:3.0:1788891138.029128:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891138.029243:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987946112 00000100:00100000:1.0:1788891138.029253:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987946112 00000100:00100000:1.0:1788891138.029368:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:1.0:1788891138.029379:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:15702:x1875787987946112:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788891138.029396:0:18615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891138.029414:0:18615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030926442/0xa66601b03fd546b9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de392 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.029445:0:18615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd546b2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de38b expref: 8 pid: 18616 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.029455:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891138.029460:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891138.029465:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030926442/0xa66601b03fd546b9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de392 expref: 8 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.029497:0:18615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd546b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de38b expref: 8 pid: 18616 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.029544:0:18615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd546b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de38b expref: 8 pid: 18616 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891138.029560:0:18615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18615:1875787997429632:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891138.029638:0:18615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788891138.033991:0:18615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18615:1875787997429632:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891138.034030:0:18615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030926442/0xa66601b03fd546b9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de392 expref: 8 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.034052:0:18615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7200, rc 0) 00000100:00100000:1.0:1788891138.034114:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+8:15702:x1875787987946112:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 4735us (4995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891138.034123:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:1.0:1788891138.039488:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891138.039616:0:20136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987946240 00000100:00100000:1.0:1788891138.039626:0:20136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987946240 00010000:00010000:1.0:1788891138.039678:0:20136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd546b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de38b expref: 8 pid: 18616 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891138.039716:0:20136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:1.0:1788891138.039728:0:20136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+8:2393:x1875787987946240:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891138.039743:0:20136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891138.039767:0:20136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd546b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de38b expref: 8 pid: 18616 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.039792:0:20136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd546b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de38b expref: 8 pid: 18616 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.039815:0:20136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd546b2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de38b expref: 8 pid: 18616 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.039828:0:20136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891138.039832:0:20136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891138.039840:0:20136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030926442/0xa66601b03fd546b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de392 expref: 7 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.039850:0:20136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030926442/0xa66601b03fd546b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de392 expref: 7 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.039887:0:20136:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000030926442/0xa66601b03fd546b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de392 expref: 7 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891138.039902:0:20136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:20136:1875787997429760:192.168.204.26@tcp:105: 00000100:00100000:1.0:1788891138.039976:0:20136:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788891138.045994:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891138.046060:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987946368 00000100:00100000:0.0:1788891138.046069:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987946368 00002000:00100000:0.0:1788891138.046112:0:18619:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff924f84290e00 x1875787987946368/t0(0) o4->6f09a10f-9224-43a2-a8d4-25920b0f419e@192.168.204.26@tcp:189/0 lens 504/0 e 0 to 0 dl 1788891149 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788891138.046123:0:18619:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f84290e00 with x1875787987946368 ext(0->8) 00002000:00010000:0.0:1788891138.046129:0:18619:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff924f84290e00 00000100:00100000:0.0:1788891138.046152:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:0.0:1788891138.046159:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+8:2394:x1875787987946368:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788891138.046518:0:20136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:20136:1875787997429760:192.168.204.26@tcp:105: 00010000:00010000:1.0:1788891138.046733:0:20136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891138.047174:0:20136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+10:2393:x1875787987946240:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 7446us (7692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891138.047184:0:20136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:2.0:1788891138.047983:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+9:2394:x1875787987946368:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 Request processed in 1819us (1994us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788891138.048009:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00002000:00100000:2.0:1788891138.048127:0:18619:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff924f84290e00 x1875787987946368/t8589934596(0) o4->6f09a10f-9224-43a2-a8d4-25920b0f419e@192.168.204.26@tcp:189/0 lens 504/448 e 0 to 0 dl 1788891149 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788891138.048138:0:18619:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f84290e00 with x1875787987946368 ext(0->8) 00002000:00010000:2.0:1788891138.048145:0:18619:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff924f84290e00 00000100:00100000:3.0:1788891138.050077:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891138.051307:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987946496 00000100:00100000:1.0:1788891138.051318:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987946496 00000100:00100000:1.0:1788891138.051392:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 71 00000100:00100000:1.0:1788891138.051402:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+48:15702:x1875787987946496:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788891138.054312:0:17089:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934625 is committed 00000004:00080000:2.0:1788891138.054332:0:17089:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788891138.054410:0:17089:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1788891138.054648:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd54420 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.054680:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd54420 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.054690:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd54420 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.054697:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891138.054702:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd54420 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.054709:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd54420 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.054727:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9250905a3400) 00010000:00010000:3.0:1788891138.054730:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891138.054736:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd54420 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.054743:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd54420 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.054763:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd54427 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.054770:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd54427 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.054777:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd54427 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.054782:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891138.054791:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd54427 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.054798:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd54427 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.054807:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:3.0:1788891138.054810:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891138.054813:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd54427 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.054819:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311600/0xa66601b03fd54427 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.054832:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd544cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.054957:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd544cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.054965:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd544cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.054970:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ece00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891138.054972:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd544cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.054978:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd544cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.054987:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff924f82e37f00) 00010000:00010000:3.0:1788891138.054989:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891138.054998:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd544cf lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055003:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd544cf lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055019:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5453f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055025:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5453f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055030:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5453f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055035:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857dfc00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891138.055037:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5453f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055042:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5453f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055050:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:3.0:1788891138.055052:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891138.055054:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5453f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055059:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857dfc00/0xa66601b03fd5453f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055068:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd54562 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055084:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd54562 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055090:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd54562 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055094:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857df600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891138.055097:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd54562 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055104:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd54562 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055112:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:3.0:1788891138.055114:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891138.055116:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd54562 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055122:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250857df600/0xa66601b03fd54562 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055133:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd545a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055139:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd545a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055145:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd545a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055150:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4e00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891138.055159:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd545a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055165:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd545a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055175:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:3.0:1788891138.055177:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891138.055180:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd545a8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055186:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd545a8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055199:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54696 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055205:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54696 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055211:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54696 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055216:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ede00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891138.055219:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54696 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055224:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54696 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055232:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff925085363300) 00010000:00010000:3.0:1788891138.055233:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788891138.055241:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54696 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.055247:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54696 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891138.055349:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997429888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788891138.055408:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891138.055453:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997429888 00000100:00100000:3.0:1788891138.055459:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997429888 00000100:00100000:3.0:1788891138.055494:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788891138.055500:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997429888:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788891138.055638:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54474 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.055649:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54474 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.055667:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54474 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.055673:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891138.055676:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54474 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.055682:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54474 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.055692:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:1.0:1788891138.055694:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788891138.055698:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54474 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.055703:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd54474 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788891138.055771:0:18616:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788891138.055776:0:18616:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788891137 00002000:00010000:3.0:1788891138.055779:0:18616:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788891138.055781:0:18616:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788891137 -> 1788891137 00002000:00010000:3.0:1788891138.055788:0:18616:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788891138.055820:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+14:15702:x1875787987946496:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 Request processed in 4418us (5748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891138.055834:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3627:x1875787997429888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 330us (422us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788891138.055834:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 71 00000004:00080000:2.0:1788891138.055894:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff924f83148700/2, rc 0, transno 8589934597 00000100:00100000:2.0:1788891138.055901:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997429888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788891138.056006:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788891138.058147:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891138.058242:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987946624 00000100:00100000:2.0:1788891138.058250:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987946624 00000100:00100000:2.0:1788891138.058299:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:2.0:1788891138.058308:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bac37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+9:2393:x1875787987946624:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788891138.063205:0:19431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:3.0:1788891138.063218:0:19431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000100:00100000:2.0:1788891138.065342:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bac37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2393:x1875787987946624:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 Request processed in 7024us (7192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891138.065356:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:3.0:1788891138.070274:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891138.070504:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987946880 00000100:00100000:0.0:1788891138.070516:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987946880 00000100:00100000:0.0:1788891138.070594:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 72 00000100:00100000:0.0:1788891138.070606:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+14:15702:x1875787987946880:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788891138.070667:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891138.070695:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd546ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de384 expref: 14 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.070712:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff925085363300) 00010000:00010000:0.0:1788891138.070716:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788891138.070746:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd546c0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.070759:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd546c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.070769:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd546c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788891138.070898:0:17109:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a1dd1fa reply state 000000006348d332 transno 8589934626 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd546c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.070910:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd546c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.070915:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff925085363300) 00010000:00010000:0.0:1788891138.070917:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788891138.070920:0:17109:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788891138.071020:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+15:15702:x1875787987946880:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 415us (753us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1788891138.071039:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 72 00000100:00100000:0.0:1788891138.073904:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891138.073995:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987947008 00000100:00100000:1.0:1788891138.074004:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987947008 00000100:00100000:1.0:1788891138.074060:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:1.0:1788891138.074070:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2393:x1875787987947008:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788891138.074215:0:18616:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788891138.074218:0:18616:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788891137 -> 1788891136 00002000:00010000:1.0:1788891138.074221:0:18616:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788891135 00002000:00010000:1.0:1788891138.074223:0:18616:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788891137 -> 1788891136 00002000:00010000:1.0:1788891138.074226:0:18616:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788891138.074280:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:2393:x1875787987947008:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 211us (384us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788891138.074288:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:1.0:1788891138.078631:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891138.078691:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987947264 00000100:00100000:0.0:1788891138.078701:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987947264 00000100:00100000:1.0:1788891138.078781:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00100000:1.0:1788891138.078793:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+15:15702:x1875787987947264:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788891138.078859:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd546c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.078876:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5468f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de376 expref: 15 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.078886:0:17110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd546c7 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.078921:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5468f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de376 expref: 15 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.078947:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5468f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de376 expref: 15 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891138.078961:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997430016:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891138.079039:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788891138.084197:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891138.084407:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997430016:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788891138.084442:0:17110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd546c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891138.085669:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987947392 00000100:00100000:2.0:1788891138.085681:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987947392 00010000:00010000:2.0:1788891138.085720:0:17096:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5468f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de376 expref: 16 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891138.085763:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:2.0:1788891138.085774:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84292300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+16:2394:x1875787987947392:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891138.085797:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891138.085804:0:17096:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5468f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de376 expref: 16 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.085818:0:17096:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5468f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de376 expref: 16 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.085839:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5468f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de376 expref: 16 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.085853:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff925085363300) 00010000:00010000:2.0:1788891138.085858:0:17096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd546c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.085867:0:17096:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd546c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.085875:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd546c7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.085899:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891138.085955:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84292300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+15:2394:x1875787987947392:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 183us (1767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891138.085963:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 23 00010000:00010000:2.0:1788891138.085985:0:17110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd546c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.085992:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd546c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.086037:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd546c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.086044:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd546c7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.086049:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd546c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.086056:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891138.086060:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd546c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.086067:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd546c7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.086077:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff925085363300) 00010000:00010000:2.0:1788891138.086080:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788891138.086084:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd546c7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.086089:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd546c7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891138.086128:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+14:15702:x1875787987947264:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 Request processed in 7337us (7506us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788891138.086136:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 73 00000100:00100000:3.0:1788891138.089117:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891138.089462:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987947520 00000100:00100000:1.0:1788891138.089472:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987947520 00000100:00100000:1.0:1788891138.089576:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:1.0:1788891138.089587:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:2393:x1875787987947520:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788891138.089626:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd546ce lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.089647:0:18615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030926442/0xa66601b03fd546b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de392 expref: 7 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.089668:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891138.089672:0:18615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788891138.089677:0:18615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd546ce lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.089772:0:18615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030926442/0xa66601b03fd546b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de392 expref: 7 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.089787:0:18615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030926442/0xa66601b03fd546b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de392 expref: 7 pid: 18615 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891138.089812:0:18615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18615:1875787997430144:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891138.089892:0:18615:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788891138.097225:0:18615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18615:1875787997430144:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891138.097253:0:18615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd546ce lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891138.097307:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891138.097367:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987947648 00000100:00100000:3.0:1788891138.097373:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987947648 00010000:00010000:3.0:1788891138.097407:0:17094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030926442/0xa66601b03fd546b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de392 expref: 8 pid: 18615 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891138.097478:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:3.0:1788891138.097497:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090312300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+8:2393:x1875787987947648:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891138.097513:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891138.097551:0:17094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030926442/0xa66601b03fd546b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de392 expref: 8 pid: 18615 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.097564:0:17094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030926442/0xa66601b03fd546b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de392 expref: 8 pid: 18615 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.097587:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030926442/0xa66601b03fd546b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de392 expref: 8 pid: 18615 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.097601:0:17094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788891138.097606:0:17094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788891138.097611:0:17094:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd546ce lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.097619:0:17094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd546ce lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.097664:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891138.097720:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090312300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:2393:x1875787987947648:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 233us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891138.097728:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 24 00010000:00010000:3.0:1788891138.098212:0:18615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd546ce lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.098224:0:18615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd546ce lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.098247:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd546ce lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.098255:0:18615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd546ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.098264:0:18615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd546ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.098272:0:18615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6000 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891138.098276:0:18615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd546ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.098286:0:18615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd546ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.098312:0:18615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd546ce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.098320:0:18615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd546ce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891138.098370:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2393:x1875787987947520:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 Request processed in 8784us (9261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891138.098379:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:0.0:1788891138.101461:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891138.102024:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987947904 00000100:00100000:3.0:1788891138.102035:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987947904 00000100:00100000:3.0:1788891138.102137:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 74 00000100:00100000:3.0:1788891138.102148:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+14:15702:x1875787987947904:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788891138.102230:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546d5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.102247:0:18639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54538 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de322 expref: 14 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.102256:0:18639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546d5 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.102431:0:18639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54538 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de322 expref: 14 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.102447:0:18639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54538 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de322 expref: 14 pid: 17111 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891138.102474:0:18639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84291f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18639:1875787997430272:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788891138.102752:0:18639:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8221c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788891138.105317:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891138.105414:0:18639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84291f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18639:1875787997430272:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891138.105440:0:18639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546d5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891138.105509:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987948032 00000100:00100000:1.0:1788891138.105516:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987948032 00010000:00010000:1.0:1788891138.105586:0:17096:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54538 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de322 expref: 15 pid: 17111 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891138.105618:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:1.0:1788891138.105631:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b660d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+15:2394:x1875787987948032:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891138.105643:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891138.105650:0:17096:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54538 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de322 expref: 15 pid: 17111 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.105673:0:17096:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54538 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de322 expref: 15 pid: 17111 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.105959:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54538 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de322 expref: 15 pid: 17111 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.105977:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:1.0:1788891138.105982:0:17096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546d5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.105991:0:17096:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.106016:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546d5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.106353:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891138.106415:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b660d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+14:2394:x1875787987948032:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 785us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891138.106424:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 25 00010000:00010000:3.0:1788891138.107118:0:18639:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.107128:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.107328:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd546dc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.107342:0:18639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd5469d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de37d expref: 14 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.107350:0:18639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd546dc lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.107381:0:18639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd5469d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de37d expref: 14 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.107393:0:18639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd5469d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de37d expref: 14 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891138.107407:0:18639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84291f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18639:1875787997430400:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788891138.107607:0:18639:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8221c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788891138.110994:0:18639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84291f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18639:1875787997430400:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891138.110994:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891138.111089:0:20136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987948160 00000100:00100000:1.0:1788891138.111097:0:20136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987948160 00010000:00010000:1.0:1788891138.111134:0:20136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd5469d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de37d expref: 15 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891138.111175:0:20136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 26 00000100:00100000:1.0:1788891138.111185:0:20136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090311c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+15:2394:x1875787987948160:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891138.111200:0:20136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891138.111207:0:20136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd5469d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de37d expref: 15 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.111221:0:20136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd5469d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de37d expref: 15 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.111243:0:20136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd5469d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de37d expref: 15 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.111258:0:20136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff925085363300) 00010000:00010000:1.0:1788891138.111263:0:20136:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd546dc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.111272:0:20136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd546dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.111279:0:20136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd546dc lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.111304:0:20136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891138.111358:0:20136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090311c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+14:2394:x1875787987948160:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 173us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891138.111366:0:20136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 26 00010000:00010000:3.0:1788891138.111397:0:18639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd546dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.111407:0:18639:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd546dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.111413:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd546dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788891138.112268:0:18639:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000001:00080000:2.0:1788891138.112472:0:18639:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934628 00000001:00080000:2.0:1788891138.112503:0:18639:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000100:00100000:2.0:1788891138.112627:0:18639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090310380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18639:1875787997430528:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788891138.112693:0:18639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891138.112760:0:18639:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c0a18180 going to sleep for 11 seconds 00000100:00100000:3.0:1788891138.112920:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997430528 00000100:00100000:3.0:1788891138.112927:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997430528 00000100:00100000:2.0:1788891138.113001:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788891138.113011:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:18639:x1875787997430528:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788891138.113108:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:18639:x1875787997430528:12345-0@lo:1000:mdt00_003.0 Request processed in 98us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891138.113116:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788891138.113180:0:18639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1788891138.113184:0:18639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff924f83148700, transno 8589934597 00000100:00100000:0.0:1788891138.113198:0:18639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090310380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18639:1875787997430528:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788891138.113395:0:18639:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00000100:00100000:0.0:1788891138.113444:0:18639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18639:1875787997430656:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788891138.113465:0:18639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891138.113514:0:18639:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508167a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788891138.113711:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997430656 00000100:00100000:2.0:1788891138.113716:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997430656 00000100:00100000:2.0:1788891138.113752:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788891138.113759:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:18639:x1875787997430656:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788891138.114272:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18639:x1875787997430656:12345-0@lo:1000:mdt00_003.0 Request processed in 512us (803us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788891138.114280:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788891138.114339:0:18639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18639:1875787997430656:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788891138.114376:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd546dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.114385:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd546dc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.114404:0:18639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd546dc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.114411:0:18639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891138.114415:0:18639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd546dc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.114423:0:18639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd546dc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.114438:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff925085363300) 00010000:00010000:0.0:1788891138.114441:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788891138.114445:0:18639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd546dc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.114452:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd546dc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.114483:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54618 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.114489:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54618 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.114494:0:18639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54618 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.114500:0:18639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891138.114502:0:18639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54618 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.114518:0:18639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54618 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.114599:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:0.0:1788891138.114602:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788891138.114605:0:18639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54618 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.114611:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd54618 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.114635:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd546e3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.114648:0:18639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54634 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de361 expref: 17 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.114668:0:18639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd546e3 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.114697:0:18639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54634 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de361 expref: 17 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.114711:0:18639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54634 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de361 expref: 17 pid: 18639 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891138.114723:0:18639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18639:1875787997430784:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891138.114962:0:18639:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c0a18d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788891138.118037:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891138.118104:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987948288 00000100:00100000:3.0:1788891138.118114:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987948288 00010000:00010000:3.0:1788891138.118153:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54634 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de361 expref: 18 pid: 18639 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891138.118229:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:3.0:1788891138.118240:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090313800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+18:2393:x1875787987948288:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891138.118255:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891138.118262:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54634 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de361 expref: 18 pid: 18639 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.118276:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54634 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de361 expref: 18 pid: 18639 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.118296:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:3.0:1788891138.118316:0:17095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd546e3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.118327:0:17095:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd546e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.118334:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd546e3 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.118354:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891138.118411:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090313800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+18:2393:x1875787987948288:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 173us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891138.118419:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 27 00010000:00010000:0.0:1788891138.118617:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54634 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de361 expref: 17 pid: 18639 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891138.118639:0:18639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18639:1875787997430784:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788891138.118674:0:18639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd546e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.118684:0:18639:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd546e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.118690:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd546e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.118702:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd546e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.118708:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd546e3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.118715:0:18639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd546e3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.118721:0:18639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891138.118725:0:18639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd546e3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.118731:0:18639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd546e3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.118741:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:0.0:1788891138.118744:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891138.118748:0:18639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd546e3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.118760:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd546e3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.118784:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.118790:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546d5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.118795:0:18639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.118800:0:18639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891138.118803:0:18639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.118808:0:18639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546d5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.118816:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff924f82e37900) 00010000:00010000:0.0:1788891138.118819:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788891138.118822:0:18639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546d5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.118828:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546d5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891138.118986:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+16:15702:x1875787987947904:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 16840us (17532us total) trans 8589934631 rc 0/0 00000100:00100000:0.0:1788891138.118995:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 74 00000020:00080000:0.0:1788891138.119003:0:18639:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788891138.119059:0:17147:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788891138.119064:0:17147:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788891138.119086:0:17147:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788891138.119093:0:17147:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788891138.125973:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891138.126101:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987948544 00000100:00100000:1.0:1788891138.126112:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987948544 00000100:00100000:1.0:1788891138.126211:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:1.0:1788891138.126224:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+16:15702:x1875787987948544:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788891138.126501:0:17112:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788891138.126568:0:17112:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00010000:00010000:1.0:1788891138.126605:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd546ea lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.126621:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd546ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.126631:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd546ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.126639:0:17112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd546ea lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.126646:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd546ea lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.126680:0:17112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd546ea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.126754:0:17112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788891138.126856:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+18:15702:x1875787987948544:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 634us (892us total) trans 8589934633 rc 0/0 00000100:00100000:1.0:1788891138.126865:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 14 00000020:00080000:1.0:1788891138.126870:0:17112:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788891138.127327:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891138.127335:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd546ea lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.127343:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7000 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891138.127348:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd546ea lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.127356:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd546ea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.127370:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff925085363300) 00010000:00010000:3.0:1788891138.127372:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788891138.127377:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd546ea lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.127382:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd546ea lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.127405:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891138.127407:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891138.127408:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891138.171789:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997430912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788891138.171864:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891138.171961:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997430912 00000100:00100000:1.0:1788891138.171968:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997430912 00000100:00100000:1.0:1788891138.172025:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788891138.172034:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997430912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788891138.172063:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788891138.172123:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997430912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891138.172130:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788891138.172237:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997430912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788891138.172436:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788891138.172447:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997431040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788891138.172476:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891138.172564:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997431040 00000100:00100000:0.0:1788891138.172569:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997431040 00000100:00100000:0.0:1788891138.172596:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788891138.172603:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997431040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788891138.172615:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788891138.172645:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997431040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891138.172662:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788891138.172739:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997431168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788891138.172766:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891138.172802:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997431040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788891138.172860:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997431168 00000100:00100000:0.0:1788891138.172864:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997431168 00000100:00100000:0.0:1788891138.172894:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788891138.172901:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997431168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788891138.172923:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788891138.172957:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997431168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891138.172962:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788891138.173028:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997431168:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788891138.274396:0:20286:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788891138.274407:0:20286:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788891138.274429:0:20286:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788891138.274437:0:20286:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788891138.369639:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891138.369778:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987948800 00000100:00100000:3.0:1788891138.369789:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987948800 00000100:00100000:3.0:1788891138.369864:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 75 00000100:00100000:3.0:1788891138.369876:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+18:15712:x1875787987948800:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891138.369903:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891138.369934:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd546f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de399 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891138.370036:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788891138.370139:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd546f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de399 expref: 20 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.370154:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e37a00) 00010000:00010000:3.0:1788891138.370165:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891138.370171:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd546f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de399 expref: 20 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.370187:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8b200, rc 0) 00000100:00100000:3.0:1788891138.370254:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+19:15712:x1875787987948800:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 380us (623us total) trans 8589934634 rc 301/301 00000100:00100000:3.0:1788891138.370261:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 75 00000100:00100000:0.0:1788891138.375689:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891138.376065:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987948928 00000100:00100000:3.0:1788891138.376077:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987948928 00000100:00100000:3.0:1788891138.376130:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 76 00000100:00100000:3.0:1788891138.376140:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+19:15712:x1875787987948928:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:3.0:1788891138.376212:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546ff lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376227:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546ff lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376239:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546ff lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376255:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd54706 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376261:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd54706 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376267:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd54706 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376334:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5470d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376349:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5470d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376356:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5470d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788891138.376401:0:17109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5470d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376414:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546ff lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376420:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546ff lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376427:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546ff lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376432:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891138.376436:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546ff lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376443:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546ff lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376455:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:3.0:1788891138.376458:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891138.376462:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546ff lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376468:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a400/0xa66601b03fd546ff lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376485:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd54706 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376491:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd54706 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376497:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd54706 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376502:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891138.376505:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd54706 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376511:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd54706 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376519:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9250905a3900) 00010000:00010000:3.0:1788891138.376556:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891138.376560:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd54706 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376566:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd54706 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376581:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5470d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376586:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5470d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376591:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5470d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376602:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8be00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891138.376605:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5470d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376610:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5470d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376618:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9250905a3e00) 00010000:00010000:3.0:1788891138.376620:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891138.376622:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5470d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.376627:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5470d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891138.376759:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+19:15712:x1875787987948928:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 618us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891138.376768:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 76 00000100:00100000:2.0:1788891138.381972:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891138.382004:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987949184 00000100:00100000:2.0:1788891138.382069:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987949184 00000100:00100000:2.0:1788891138.382129:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:2.0:1788891138.382141:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+19:15712:x1875787987949184:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:2.0:1788891138.382357:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+20:15712:x1875787987949184:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 218us (391us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1788891138.382366:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:2.0:1788891138.409854:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891138.410030:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987949440 00000100:00100000:0.0:1788891138.410040:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987949440 00000100:00100000:0.0:1788891138.410101:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00100000:0.0:1788891138.410124:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+20:15715:x1875787987949440:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:0.0:1788891138.410148:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891138.410167:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5c00/0xa66601b03fd54714 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de3a0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.410239:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5471b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.410252:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5471b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.410263:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5471b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.410277:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd54722 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.410283:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd54722 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.410289:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd54722 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.410395:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54729 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.410404:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54729 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.410411:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54729 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891138.410429:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:0.0:1788891138.410505:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5471b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.410513:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5471b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.410519:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5471b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.410995:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891138.410999:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5471b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.411060:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5471b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.411075:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:0.0:1788891138.411078:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891138.411081:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5471b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.411088:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5471b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.411101:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd54722 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.411107:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd54722 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.411126:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd54722 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.411131:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891138.411134:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd54722 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.411141:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd54722 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.411149:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff925085363900) 00010000:00010000:0.0:1788891138.411151:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891138.411154:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd54722 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.411160:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd54722 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.411217:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5c00/0xa66601b03fd54714 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3a0 expref: 23 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.411232:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54729 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3a0 expref: 22 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.411240:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925085363800) 00010000:00010000:0.0:1788891138.411242:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788891138.411245:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5200, rc 0) 00000100:00100000:0.0:1788891138.411312:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+22:15715:x1875787987949440:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1189us (1465us total) trans 8589934636 rc 0/0 00000100:00100000:0.0:1788891138.411329:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 77 00000100:00100000:3.0:1788891138.414324:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891138.414398:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987949568 00000100:00100000:0.0:1788891138.414408:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987949568 00000100:00100000:0.0:1788891138.414465:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00100000:0.0:1788891138.414475:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+22:15715:x1875787987949568:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:0.0:1788891138.414664:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54737 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.414679:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54737 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.414691:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54737 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.414725:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54737 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.414733:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54737 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.414739:0:18639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54737 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.414744:0:18639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891138.414749:0:18639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54737 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.414756:0:18639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54737 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.414767:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925085363800) 00010000:00010000:0.0:1788891138.414783:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788891138.414788:0:18639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54737 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.414795:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd54737 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891138.414867:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+22:15715:x1875787987949568:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 393us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891138.414874:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 78 00000100:00100000:2.0:1788891138.417055:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891138.418704:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987949824 00000100:00100000:3.0:1788891138.418717:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987949824 00000100:00100000:3.0:1788891138.418785:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:3.0:1788891138.418796:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f81fdc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+22:15715:x1875787987949824:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:3.0:1788891138.419137:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f81fdc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+23:15715:x1875787987949824:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 342us (2088us total) trans 8589934637 rc 0/0 00000100:00100000:3.0:1788891138.419146:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:2.0:1788891138.446995:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891138.450201:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987950080 00000100:00100000:0.0:1788891138.450218:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987950080 00000100:00100000:1.0:1788891138.450393:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 79 00000100:00100000:1.0:1788891138.450405:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+23:12950:x1875787987950080:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1788891138.450432:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891138.450453:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6600/0xa66601b03fd5473e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de3a7 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.450594:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54745 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.450619:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54729 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3a0 expref: 24 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.450656:0:17110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54745 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.450694:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54729 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3a0 expref: 24 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.450709:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54729 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3a0 expref: 24 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891138.450723:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997431296:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891138.450815:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250908f9840 going to sleep for 11 seconds 00000100:00100000:1.0:1788891138.454595:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997431296:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891138.454626:0:17110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54745 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891138.454781:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891138.455312:0:20136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987950208 00000100:00100000:1.0:1788891138.455319:0:20136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987950208 00010000:00010000:1.0:1788891138.455355:0:20136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54729 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3a0 expref: 25 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891138.455430:0:20136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:1.0:1788891138.455440:0:20136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090310000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+25:2393:x1875787987950208:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891138.455454:0:20136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891138.455462:0:20136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54729 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3a0 expref: 25 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.455493:0:20136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54729 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3a0 expref: 25 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.455514:0:20136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54729 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3a0 expref: 25 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.455565:0:20136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925085363800) 00010000:00010000:1.0:1788891138.455571:0:20136:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54745 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.455580:0:20136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54745 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.455587:0:20136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54745 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.455621:0:20136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891138.455688:0:20136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090310000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+24:2393:x1875787987950208:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 249us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891138.455696:0:20136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 28 00010000:00010000:3.0:1788891138.455813:0:17110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54745 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.455832:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54745 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891138.455852:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:3.0:1788891138.456266:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6600/0xa66601b03fd5473e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3a7 expref: 25 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.456282:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54745 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3a7 expref: 24 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.456291:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925085363800) 00010000:00010000:3.0:1788891138.456293:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788891138.456296:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7000, rc 0) 00000100:00100000:3.0:1788891138.456342:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+24:12950:x1875787987950080:12345-192.168.204.26@tcp:101:bash.0 Request processed in 5940us (9358us total) trans 8589934638 rc 0/0 00000100:00100000:3.0:1788891138.456350:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 79 00000100:00100000:2.0:1788891138.460665:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891138.460758:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987950336 00000100:00100000:0.0:1788891138.460768:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987950336 00000100:00100000:0.0:1788891138.460826:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 80 00000100:00100000:0.0:1788891138.460836:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+24:12950:x1875787987950336:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788891138.460860:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891138.460880:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd54753 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de3ae expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.460911:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5475a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.460925:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5475a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.460937:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5475a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.461068:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd54753 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3ae expref: 26 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.461096:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5475a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3ae expref: 25 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.461105:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925085363800) 00010000:00010000:0.0:1788891138.461108:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788891138.461111:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5800, rc 0) 00000100:00100000:0.0:1788891138.461176:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+25:12950:x1875787987950336:12345-192.168.204.26@tcp:101:bash.0 Request processed in 341us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891138.461183:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 80 00000100:00100000:0.0:1788891138.464199:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891138.464322:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987950592 00000100:00100000:3.0:1788891138.464331:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987950592 00000100:00100000:3.0:1788891138.464406:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 81 00000100:00100000:3.0:1788891138.464417:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+25:12950:x1875787987950592:12345-192.168.204.26@tcp:36:bash.0 00010000:00010000:2.0:1788891138.464835:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54761 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.464854:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54761 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.464865:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54761 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788891138.464912:0:17111:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934639 00000004:00010000:2.0:1788891138.464935:0:17111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a374bf8 reply state 000000003c29ff02 transno 8589934640 ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54761 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.464947:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54761 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.464955:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925085363800) 00010000:00010000:2.0:1788891138.464957:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788891138.464961:0:17111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788891138.465046:0:17111:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934640 00000100:00100000:2.0:1788891138.465979:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+29:12950:x1875787987950592:12345-192.168.204.26@tcp:36:bash.0 Request processed in 1558us (1786us total) trans 8589934641 rc 0/0 00000100:00100000:2.0:1788891138.465989:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 81 00000020:00080000:2.0:1788891138.465995:0:17111:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788891138.469085:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891138.470308:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987950720 00000100:00100000:0.0:1788891138.470320:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987950720 00000100:00100000:0.0:1788891138.470399:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 82 00000100:00100000:0.0:1788891138.470410:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+29:12950:x1875787987950720:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788891138.470436:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891138.470456:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd54768 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de3b5 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.470512:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd54768 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3b5 expref: 30 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.470556:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd54768 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3b5 expref: 30 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.470963:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925085363800) 00010000:00010000:1.0:1788891138.470967:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788891138.470971:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4600, rc 0) 00000100:00100000:1.0:1788891138.471038:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+30:12950:x1875787987950720:12345-192.168.204.26@tcp:101:bash.0 Request processed in 629us (1962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891138.471045:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 82 00000100:00100000:1.0:1788891138.476713:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891138.477333:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987950848 00000100:00100000:3.0:1788891138.477343:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987950848 00000100:00100000:3.0:1788891138.477392:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:3.0:1788891138.477414:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:12950:x1875787987950848:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:3.0:1788891138.477433:0:18616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891138.477452:0:18616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e46b80dd/0xa66601b03fd5476f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de3bc expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788891138.477492:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 9, mtime: 0x6aa05000, atime: 0x6aa04fff, ctime: 0x6aa05000, blocks: 0x8 00010000:00010000:3.0:1788891138.477513:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1788891138.477518:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891138.477557:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e46b80dd/0xa66601b03fd5476f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3bc expref: 7 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.477575:0:18616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e46b80dd/0xa66601b03fd5476f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3bc expref: 7 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.477588:0:18616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8a400, rc 0) 00000100:00100000:3.0:1788891138.477640:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:12950:x1875787987950848:12345-192.168.204.26@tcp:101:bash.0 Request processed in 239us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891138.477658:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:0.0:1788891138.480668:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891138.480888:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987950976 00000100:00100000:2.0:1788891138.480897:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987950976 00002000:00010000:2.0:1788891138.480932:0:18621:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/34 (0->18446744073709551615) 00002000:00100000:2.0:1788891138.480943:0:18621:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9250c12a4380 with x1875787987950976 ext(0->18446744073709551615) 00002000:00010000:2.0:1788891138.480955:0:18621:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9250c12a4380. 00000100:00100000:2.0:1788891138.481022:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:2.0:1788891138.481034:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:2393:x1875787987950976:12345-192.168.204.26@tcp:10:bash.0 00002000:00010000:2.0:1788891138.481290:0:18621:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788891138.481294:0:18621:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788891136 -> 1788891137 00002000:00010000:2.0:1788891138.481297:0:18621:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 1788891135 -> 1788891135 00002000:00010000:2.0:1788891138.481299:0:18621:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788891136 -> 1788891137 00002000:00010000:2.0:1788891138.481302:0:18621:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788891138.481368:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+8:2393:x1875787987950976:12345-192.168.204.26@tcp:10:bash.0 Request processed in 336us (844us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788891138.481375:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1 00002000:00010000:2.0:1788891138.481380:0:18621:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/34 (0->18446744073709551615) 00002000:00100000:2.0:1788891138.481383:0:18621:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9250c12a4380 with x1875787987950976 ext(0->18446744073709551615) 00002000:00010000:2.0:1788891138.481387:0:18621:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9250c12a4380. 00000100:00100000:1.0:1788891138.539803:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891138.540440:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987951232 00000100:00100000:3.0:1788891138.540450:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987951232 00000100:00100000:3.0:1788891138.540518:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 83 00000100:00100000:3.0:1788891138.540552:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+30:15730:x1875787987951232:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891138.541125:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891138.541151:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54776 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de3c3 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.541261:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd5477d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.541278:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd5477d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.541305:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd5477d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891138.541318:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788891138.541424:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54776 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3c3 expref: 33 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.541443:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd5477d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3c3 expref: 32 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.541451:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:3.0:1788891138.541454:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788891138.541457:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8a800, rc 0) 00000100:00100000:3.0:1788891138.541830:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+32:15730:x1875787987951232:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1279us (2035us total) trans 8589934642 rc 0/0 00000100:00100000:3.0:1788891138.541838:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 83 00000100:00100000:3.0:1788891138.547091:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891138.547221:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987951360 00000100:00100000:2.0:1788891138.547232:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987951360 00000100:00100000:2.0:1788891138.547295:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 84 00000100:00100000:2.0:1788891138.547305:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+32:15730:x1875787987951360:12345-192.168.204.26@tcp:34:lfs.0 00010000:00010000:2.0:1788891138.547377:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd5478b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.547393:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd5478b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.547404:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd5478b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.547437:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd54792 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.547445:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd54792 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.547452:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd54792 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548137:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54799 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548149:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54799 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548157:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54799 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788891138.548205:0:18639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54799 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548217:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd5478b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548223:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd5478b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548230:0:18639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd5478b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548236:0:18639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891138.548240:0:18639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd5478b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548257:0:18639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd5478b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548269:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:2.0:1788891138.548272:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891138.548277:0:18639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd5478b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548283:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd5478b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548296:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd54792 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548302:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd54792 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548308:0:18639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd54792 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548313:0:18639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ece00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891138.548316:0:18639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd54792 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548323:0:18639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd54792 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548329:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff924f82e39700) 00010000:00010000:2.0:1788891138.548331:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891138.548334:0:18639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd54792 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548350:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd54792 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548365:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54799 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548371:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54799 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548377:0:18639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54799 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548382:0:18639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ede00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891138.548385:0:18639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54799 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548392:0:18639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54799 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548400:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925085363800) 00010000:00010000:2.0:1788891138.548402:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891138.548405:0:18639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54799 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.548411:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54799 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891138.549274:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+32:15730:x1875787987951360:12345-192.168.204.26@tcp:34:lfs.0 Request processed in 1966us (2187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891138.549283:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 84 00000100:00100000:1.0:1788891138.578945:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891138.579274:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987951616 00000100:00100000:2.0:1788891138.579284:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987951616 00000100:00100000:2.0:1788891138.579345:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 85 00000100:00100000:2.0:1788891138.579357:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+32:15733:x1875787987951616:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788891138.579378:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891138.579410:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd547a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de3ca expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579484:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547a7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579498:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579510:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579553:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547ae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579561:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579567:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579681:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd547b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579691:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd547b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579716:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd547b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891138.579727:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788891138.579800:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579807:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547a7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579813:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579830:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ece00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891138.579835:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579841:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579852:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:2.0:1788891138.579854:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891138.579859:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579864:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579878:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579883:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547ae lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579895:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579900:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891138.579903:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579909:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547ae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579916:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff924f82e39700) 00010000:00010000:2.0:1788891138.579919:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891138.579922:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547ae lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.579927:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.580166:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd547a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3ca expref: 35 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.580183:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd547b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3ca expref: 34 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.580189:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925085363800) 00010000:00010000:2.0:1788891138.580191:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788891138.580194:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ed800, rc 0) 00000100:00100000:2.0:1788891138.580259:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+34:15733:x1875787987951616:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 903us (1321us total) trans 8589934643 rc 0/0 00000100:00100000:2.0:1788891138.580276:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 85 00000100:00100000:0.0:1788891138.583421:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891138.583788:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987951744 00000100:00100000:1.0:1788891138.583798:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987951744 00000100:00100000:0.0:1788891138.584039:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 86 00000100:00100000:0.0:1788891138.584052:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+34:15733:x1875787987951744:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:0.0:1788891138.584138:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd547c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.584154:0:17109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54745 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3a7 expref: 34 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.584163:0:17109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd547c3 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.584197:0:17109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54745 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3a7 expref: 34 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.584210:0:17109:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54745 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3a7 expref: 34 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891138.584224:0:17109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17109:1875787997431424:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891138.584315:0:17109:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fb000 going to sleep for 11 seconds 00000100:00100000:0.0:1788891138.587081:0:17109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17109:1875787997431424:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788891138.587112:0:17109:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd547c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891138.588270:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891138.588475:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987952000 00000100:00100000:2.0:1788891138.588484:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987952000 00000100:00100000:2.0:1788891138.588625:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:2.0:1788891138.588637:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+35:14868:x1875787987952000:12345-192.168.204.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788891138.588950:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+36:14868:x1875787987952000:12345-192.168.204.26@tcp:35:ldlm_bl.0 Request processed in 315us (683us total) trans 8589934644 rc 0/0 00000100:00100000:2.0:1788891138.588959:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:3.0:1788891138.591561:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891138.591722:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987952128 00000100:00100000:2.0:1788891138.591731:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987952128 00010000:00010000:2.0:1788891138.591765:0:17096:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54745 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3a7 expref: 36 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891138.591806:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:2.0:1788891138.591815:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+36:2394:x1875787987952128:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891138.591939:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891138.591947:0:17096:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54745 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3a7 expref: 36 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.591961:0:17096:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54745 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3a7 expref: 36 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.591988:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54745 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3a7 expref: 36 pid: 17110 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.592004:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925085363800) 00010000:00010000:2.0:1788891138.592082:0:17096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd547c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.592093:0:17096:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd547c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.592100:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd547c3 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.592277:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891138.592337:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+35:2394:x1875787987952128:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 523us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891138.592346:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 29 00010000:00010000:0.0:1788891138.592943:0:17109:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd547c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.592965:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd547c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.593003:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd547c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.593432:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd547c3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.593441:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd547c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.593447:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891138.593451:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd547c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.593458:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd547c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.593472:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925085363800) 00010000:00010000:0.0:1788891138.593475:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788891138.593479:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd547c3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.593484:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd547c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891138.593669:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+34:15733:x1875787987951744:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 9616us (10254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891138.593678:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 86 00000100:00100000:3.0:1788891138.596071:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891138.597393:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987952384 00000100:00100000:1.0:1788891138.597406:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987952384 00000100:00100000:1.0:1788891138.597503:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:1.0:1788891138.597515:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+34:15733:x1875787987952384:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:1.0:1788891138.597843:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+35:15733:x1875787987952384:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 330us (1780us total) trans 8589934645 rc 0/0 00000100:00100000:1.0:1788891138.597852:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 18 00010000:00010000:2.0:1788891138.621722:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891138.673299:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891138.673678:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987952640 00000100:00100000:3.0:1788891138.673690:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987952640 00000100:00100000:2.0:1788891138.674008:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 87 00000100:00100000:2.0:1788891138.674033:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+35:15744:x1875787987952640:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:2.0:1788891138.674059:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891138.674080:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd547ca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de3d1 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674151:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547d1 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674166:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674178:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674192:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674212:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674220:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674328:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd547df lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674338:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd547df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674345:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd547df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891138.674355:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 8 00010000:00010000:2.0:1788891138.674446:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674454:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547d1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674461:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674467:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891138.674471:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674478:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547d1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674515:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:2.0:1788891138.674518:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891138.674554:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674561:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674576:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674583:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674589:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674594:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ece00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891138.674597:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674603:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674611:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff924f82e39700) 00010000:00010000:2.0:1788891138.674614:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891138.674616:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547d8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674622:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674709:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd547ca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3d1 expref: 38 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674724:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd547df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3d1 expref: 37 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.674731:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925085363800) 00010000:00010000:2.0:1788891138.674734:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891138.674736:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813eda00, rc 0) 00000100:00100000:2.0:1788891138.675208:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+37:15744:x1875787987952640:12345-192.168.204.26@tcp:101:cat.0 Request processed in 1188us (1919us total) trans 8589934646 rc 0/0 00000100:00100000:2.0:1788891138.675217:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 87 00000100:00100000:0.0:1788891138.681510:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891138.681875:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987952896 00000100:00100000:2.0:1788891138.681885:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987952896 00000100:00100000:1.0:1788891138.682038:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:1.0:1788891138.682051:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+37:15744:x1875787987952896:12345-192.168.204.26@tcp:35:cat.0 00000100:00100000:1.0:1788891138.682557:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+38:15744:x1875787987952896:12345-192.168.204.26@tcp:35:cat.0 Request processed in 475us (1022us total) trans 8589934647 rc 0/0 00000100:00100000:1.0:1788891138.682566:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:3.0:1788891138.704258:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891138.704338:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987953152 00000100:00100000:2.0:1788891138.704348:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987953152 00000100:00100000:2.0:1788891138.704421:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 88 00000100:00100000:2.0:1788891138.704432:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+38:15745:x1875787987953152:12345-192.168.204.26@tcp:36:rm.0 00010000:00010000:2.0:1788891138.704487:0:18639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788891138.704517:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd54768 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3b5 expref: 38 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.704569:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd547df lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3d1 expref: 37 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.704583:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd547b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3ca expref: 36 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.704613:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5475a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3ae expref: 35 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.704622:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925085363800) 00010000:00010000:2.0:1788891138.704627:0:18639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891138.704660:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd547ed lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.704673:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd547ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.704682:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd547ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.704697:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547f4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.704704:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.704710:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.704802:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547fb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.704811:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.704818:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788891138.705157:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].3, 64 off8408 00010000:00010000:2.0:1788891138.705207:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd54802 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705217:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd54802 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705225:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd54802 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705232:0:18639:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd54802 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705238:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd54802 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705244:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd54802 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705269:0:18639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891138.705309:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705316:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547fb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705322:0:18639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547fb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705328:0:18639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891138.705333:0:18639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547fb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705353:0:18639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547fb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705365:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925085363800) 00010000:00010000:2.0:1788891138.705368:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788891138.705371:0:18639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547fb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705377:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd547fb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705395:0:18639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd547ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705401:0:18639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd547ed lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705406:0:18639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd547ed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705410:0:18639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ede00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891138.705413:0:18639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd547ed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705418:0:18639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd547ed lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.705418:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891138.705424:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd54802 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705426:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:2.0:1788891138.705428:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891138.705431:0:18639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd547ed lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.705431:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891138.705434:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd54802 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.705440:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd54802 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705446:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd547ed lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.705454:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925085363800) 00000004:00010000:2.0:1788891138.705456:0:18639:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026e7d424 reply state 000000007f0fd85b transno 8589934648 ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.705456:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788891138.705459:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd54802 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.705465:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd54802 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705468:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.705474:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff924f82e39700) 00010000:00010000:1.0:1788891138.705475:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891138.705477:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891138.705477:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891138.705478:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891138.705479:0:18639:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788891138.705579:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+36:15745:x1875787987953152:12345-192.168.204.26@tcp:36:rm.0 Request processed in 1146us (1327us total) trans 8589934648 rc 0/0 00000100:00100000:2.0:1788891138.705587:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 88 00000100:00100000:0.0:1788891138.761916:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891138.762021:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987953408 00000100:00100000:2.0:1788891138.762031:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987953408 00000100:00100000:2.0:1788891138.762096:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 89 00000100:00100000:2.0:1788891138.762108:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+36:15751:x1875787987953408:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788891138.762130:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891138.762149:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54809 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de3d8 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.762275:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54810 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.762289:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54810 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.762313:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54810 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.762326:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54817 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.762333:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54817 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.762339:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54817 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.762791:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5481e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.762802:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5481e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.762809:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5481e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891138.762818:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788891138.762844:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54810 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.762850:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54810 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.762857:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54810 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.762864:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891138.762875:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54810 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.762883:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54810 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.762896:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:2.0:1788891138.762899:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891138.762904:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54810 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.762910:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54810 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788891138.762923:0:17111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd7bc831 reply state 000000008bd79bdf transno 8589934649 ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54817 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.762933:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54817 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.762940:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff924f82e39700) 00010000:00010000:2.0:1788891138.762942:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788891138.762945:0:17111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788891138.762971:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54809 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3d8 expref: 39 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.762984:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5481e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3d8 expref: 38 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.762992:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:2.0:1788891138.762994:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788891138.763002:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813eda00, rc 0) 00000100:00100000:2.0:1788891138.763071:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+39:15751:x1875787987953408:12345-192.168.204.26@tcp:101:bash.0 Request processed in 965us (1164us total) trans 8589934649 rc 0/0 00000100:00100000:2.0:1788891138.763079:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 89 00000100:00100000:1.0:1788891138.770405:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891138.770562:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987953536 00000100:00100000:2.0:1788891138.770571:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987953536 00000100:00100000:2.0:1788891138.770680:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 90 00000100:00100000:2.0:1788891138.770688:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+39:15751:x1875787987953536:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788891138.770711:0:18639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891138.770730:0:18639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5482c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de3df expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.770797:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54833 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.770812:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54833 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.770892:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54833 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891138.770942:0:18639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788891138.770947:0:18639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788891138.770965:0:18639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54833 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.770976:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54833 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.770997:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd5482c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3df expref: 41 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.771102:0:18639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54833 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3df expref: 40 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.771111:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:2.0:1788891138.771114:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891138.771118:0:18639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ed200, rc 0) 00000100:00100000:2.0:1788891138.771183:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+40:15751:x1875787987953536:12345-192.168.204.26@tcp:101:bash.0 Request processed in 495us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891138.771190:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 90 00000100:00100000:3.0:1788891138.775110:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891138.775477:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987953792 00000100:00100000:2.0:1788891138.775487:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987953792 00000100:00100000:2.0:1788891138.775885:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:2.0:1788891138.775897:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+40:15751:x1875787987953792:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:2.0:1788891138.776418:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+41:15751:x1875787987953792:12345-192.168.204.26@tcp:35:bash.0 Request processed in 521us (1315us total) trans 8589934650 rc 0/0 00000100:00100000:2.0:1788891138.776426:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:0.0:1788891138.867837:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891138.867933:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987954048 00000100:00100000:1.0:1788891138.867942:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987954048 00000100:00100000:1.0:1788891138.867992:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 91 00000100:00100000:1.0:1788891138.868000:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+41:15764:x1875787987954048:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788891138.868021:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891138.868038:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd5483a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de3e6 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.868173:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54841 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.868188:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54841 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.868199:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54841 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891138.868210:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788891138.868321:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd5483a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3e6 expref: 44 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.868338:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54841 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3e6 expref: 43 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.868347:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:1.0:1788891138.868349:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788891138.868352:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7a00, rc 0) 00000100:00100000:1.0:1788891138.868426:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+43:15764:x1875787987954048:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 426us (599us total) trans 8589934651 rc 0/0 00000100:00100000:1.0:1788891138.868433:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 91 00000100:00100000:0.0:1788891138.872819:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891138.872914:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987954176 00000100:00100000:3.0:1788891138.872924:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987954176 00000100:00100000:3.0:1788891138.872986:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 92 00000100:00100000:3.0:1788891138.872996:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+43:15764:x1875787987954176:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:3.0:1788891138.873081:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5484f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.873098:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5484f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.873111:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5484f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.873150:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5484f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.873157:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5484f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.873165:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5484f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.873172:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8be00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891138.873177:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5484f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.873185:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5484f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.873197:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:3.0:1788891138.873200:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891138.873205:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5484f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.873212:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5484f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891138.873294:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+43:15764:x1875787987954176:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 299us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891138.873302:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 92 00000100:00100000:0.0:1788891138.939975:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891138.940254:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987954432 00000100:00100000:1.0:1788891138.940264:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987954432 00000100:00100000:1.0:1788891138.940730:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 93 00000100:00100000:1.0:1788891138.940742:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+43:15774:x1875787987954432:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1788891138.940761:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891138.940783:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54856 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de3ed expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.940895:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd5485d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.940910:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5481e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3d8 expref: 44 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.940918:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54833 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3df expref: 44 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.940943:0:17110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd5485d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.940975:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54833 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3df expref: 44 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.940987:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54833 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3df expref: 44 pid: 18639 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891138.941000:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83148700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997431552:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891138.941085:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5481e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3d8 expref: 44 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.941097:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5481e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3d8 expref: 44 pid: 17111 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891138.941107:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997431680:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891138.941132:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250908f9480 going to sleep for 11 seconds 00000100:00100000:1.0:1788891138.943580:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997431680:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891138.944226:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891138.944280:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891138.944361:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987954560 00000100:00100000:3.0:1788891138.944366:0:20136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987954688 00000100:00100000:2.0:1788891138.944369:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987954560 00000100:00100000:3.0:1788891138.944373:0:20136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987954688 00010000:00010000:2.0:1788891138.944408:0:17094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5481e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3d8 expref: 46 pid: 17111 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891138.944449:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:2.0:1788891138.944458:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+46:2394:x1875787987954560:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891138.944472:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891138.944479:0:17094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5481e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3d8 expref: 46 pid: 17111 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.944501:0:17094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5481e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3d8 expref: 46 pid: 17111 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.944510:0:20136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54833 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3df expref: 46 pid: 18639 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891138.944565:0:20136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:3.0:1788891138.944573:0:20136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+46:2391:x1875787987954688:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891138.944583:0:20136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891138.944588:0:20136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54833 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3df expref: 46 pid: 18639 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.944599:0:20136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54833 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3df expref: 46 pid: 18639 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.944618:0:20136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:3.0:1788891138.944623:0:20136:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd5485d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.944631:0:20136:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd5485d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891138.944649:0:20136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891138.944696:0:20136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+46:2391:x1875787987954688:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 124us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891138.944714:0:20136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 31 00010000:00010000:1.0:1788891138.944913:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54833 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3df expref: 45 pid: 18639 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891138.944931:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83148700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997431552:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891138.944952:0:17110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd5485d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.945078:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd5481e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3d8 expref: 44 pid: 17111 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.945090:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:2.0:1788891138.945094:0:17094:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd5485d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.945102:0:17094:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd5485d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.945109:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd5485d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.945126:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891138.945156:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+43:2394:x1875787987954560:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 698us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891138.945164:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 30 00010000:00010000:1.0:1788891138.945476:0:17110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd5485d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.945485:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd5485d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891138.945502:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788891138.945669:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54856 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3ed expref: 44 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.945685:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd5485d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3ed expref: 43 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891138.945693:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:1.0:1788891138.945696:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788891138.945699:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7c00, rc 0) 00000100:00100000:1.0:1788891138.945739:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+43:15774:x1875787987954432:12345-192.168.204.26@tcp:101:bash.0 Request processed in 5000us (5772us total) trans 8589934652 rc 0/0 00000100:00100000:1.0:1788891138.945747:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 93 00000100:00100000:3.0:1788891138.948178:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891138.948433:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987954816 00000100:00100000:0.0:1788891138.948443:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987954816 00000100:00100000:0.0:1788891138.948573:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 94 00000100:00100000:0.0:1788891138.948584:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+43:15774:x1875787987954816:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788891138.948609:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891138.948628:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5486b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de3f4 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.948673:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd54872 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.948687:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd54872 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.948697:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd54872 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.948822:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5486b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3f4 expref: 45 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.948842:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd54872 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3f4 expref: 44 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.948862:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:0.0:1788891138.948865:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788891138.948868:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4600, rc 0) 00000100:00100000:0.0:1788891138.948922:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+44:15774:x1875787987954816:12345-192.168.204.26@tcp:101:bash.0 Request processed in 339us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891138.948929:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 94 00000100:00100000:0.0:1788891138.951660:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891138.952102:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987955072 00000100:00100000:2.0:1788891138.952114:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987955072 00000100:00100000:2.0:1788891138.952211:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 95 00000100:00100000:2.0:1788891138.952221:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+44:15774:x1875787987955072:12345-192.168.204.26@tcp:36:bash.0 00010000:00010000:2.0:1788891138.952429:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd54879 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.952445:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd54879 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.952469:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd54879 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788891138.952514:0:17111:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934653 00000004:00010000:2.0:1788891138.952564:0:17111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002706e399 reply state 000000004cb0d334 transno 8589934654 ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd54879 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.952578:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd54879 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.952586:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:2.0:1788891138.952588:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788891138.952592:0:17111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788891138.952683:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+47:15774:x1875787987955072:12345-192.168.204.26@tcp:36:bash.0 Request processed in 462us (1044us total) trans 8589934654 rc 0/0 00000100:00100000:2.0:1788891138.952690:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 95 00000020:00080000:2.0:1788891138.952696:0:17111:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788891138.955114:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891138.955179:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987955200 00000100:00100000:2.0:1788891138.955187:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987955200 00000100:00100000:2.0:1788891138.955228:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 96 00000100:00100000:2.0:1788891138.955236:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+47:15774:x1875787987955200:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:2.0:1788891138.955256:0:18639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891138.955273:0:18639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54880 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de3fb expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.955347:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54887 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.955361:0:18639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd5485d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3ed expref: 48 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.955382:0:18639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54887 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.955414:0:18639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd5485d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3ed expref: 48 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.955426:0:18639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd5485d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3ed expref: 48 pid: 17110 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891138.955440:0:18639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090311f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18639:1875787997431808:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891138.955509:0:18639:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c5780 going to sleep for 11 seconds 00000100:00100000:1.0:1788891138.959092:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891138.959251:0:18639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090311f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18639:1875787997431808:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891138.959277:0:18639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54887 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891138.960184:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987955328 00000100:00100000:0.0:1788891138.960193:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987955328 00010000:00010000:0.0:1788891138.960229:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd5485d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3ed expref: 49 pid: 17110 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891138.960266:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:0.0:1788891138.960275:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925088664c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+49:2393:x1875787987955328:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891138.960288:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891138.960295:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd5485d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3ed expref: 49 pid: 17110 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.960307:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd5485d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3ed expref: 49 pid: 17110 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.960327:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd5485d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3ed expref: 49 pid: 17110 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.960340:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:0.0:1788891138.960356:0:17095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54887 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.960365:0:17095:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54887 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.960372:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54887 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891138.960400:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891138.960452:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925088664c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+48:2393:x1875787987955328:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 178us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891138.960459:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 32 00010000:00010000:2.0:1788891138.960517:0:18639:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54887 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.960543:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54887 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891138.960622:0:18639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788891138.960627:0:18639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788891138.960660:0:18639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54887 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.960692:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd54880 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3fb expref: 48 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.960721:0:18639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54887 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3fb expref: 47 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891138.960729:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:2.0:1788891138.960731:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891138.960734:0:18639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ed200, rc 0) 00000100:00100000:2.0:1788891138.960778:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+47:15774:x1875787987955200:12345-192.168.204.26@tcp:101:bash.0 Request processed in 5542us (5671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891138.960786:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 96 00000100:00100000:1.0:1788891138.965291:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891138.965376:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987955584 00000100:00100000:3.0:1788891138.965386:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987955584 00000100:00100000:3.0:1788891138.965443:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:3.0:1788891138.965453:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+47:15774:x1875787987955584:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:3.0:1788891138.965705:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+48:15774:x1875787987955584:12345-192.168.204.26@tcp:35:bash.0 Request processed in 251us (422us total) trans 8589934655 rc 0/0 00000100:00100000:3.0:1788891138.965713:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:0.0:1788891139.013781:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891139.014597:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987955712 00000100:00100000:1.0:1788891139.014607:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987955712 00000100:00100000:1.0:1788891139.014741:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 97 00000100:00100000:1.0:1788891139.014753:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+48:15780:x1875787987955712:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788891139.014777:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891139.014810:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd5488e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de402 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.014877:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54895 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.014890:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54895 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.014901:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54895 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891139.014949:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788891139.014953:0:17110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788891139.014973:0:17110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54895 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.015019:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd5488e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de402 expref: 50 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.015036:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54895 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de402 expref: 49 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.015044:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:1.0:1788891139.015047:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788891139.015050:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7000, rc 0) 00000100:00100000:1.0:1788891139.015123:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+49:15780:x1875787987955712:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 372us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891139.015130:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 97 00000100:00100000:0.0:1788891139.018259:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891139.018375:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987955840 00000100:00100000:3.0:1788891139.018385:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987955840 00000100:00100000:3.0:1788891139.018439:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 98 00000100:00100000:3.0:1788891139.018450:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+49:15780:x1875787987955840:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891139.018468:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891139.018487:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5489c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de409 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.018805:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd548a3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.018818:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd548a3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.018829:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd548a3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.018850:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548aa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.018870:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.018878:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.018941:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd548b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.018951:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd548b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.018958:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd548b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891139.019001:0:17109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788891139.019005:0:17109:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891139.019022:0:17109:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd548b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.019032:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd548b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.019040:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd548a3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.019047:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd548a3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.019053:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd548a3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.019069:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891139.019073:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd548a3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.019078:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd548a3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.019087:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:3.0:1788891139.019089:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891139.019092:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd548a3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.019096:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd548a3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.019105:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.019109:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548aa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.019112:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.019115:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8bc00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891139.019117:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.019120:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548aa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.019131:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff924f82e39700) 00010000:00010000:3.0:1788891139.019132:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891139.019134:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548aa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.019138:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548aa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.019156:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd5489c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de409 expref: 51 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.019165:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd548b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de409 expref: 50 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.019170:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:3.0:1788891139.019171:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788891139.019173:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8ac00, rc 0) 00000100:00100000:3.0:1788891139.019279:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+50:15780:x1875787987955840:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 830us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891139.019286:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 98 00000100:00100000:0.0:1788891139.022591:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891139.022632:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891139.022673:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987955968 00000100:00100000:2.0:1788891139.022683:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987955968 00000100:00100000:3.0:1788891139.022704:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987956224 00000100:00100000:3.0:1788891139.022708:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987956224 00000100:00100000:2.0:1788891139.022745:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:2.0:1788891139.022756:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+51:2393:x1875787987955968:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891139.022770:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891139.022793:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd548b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de409 expref: 51 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.022809:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:2.0:1788891139.022813:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891139.022829:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 99 00000100:00100000:3.0:1788891139.022837:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+50:15780:x1875787987956224:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891139.022852:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1788891139.022860:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+50:2393:x1875787987955968:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 108us (337us total) trans 0 rc 0/0 00010000:00010000:3.0:1788891139.022865:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd548b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de410 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891139.022867:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2 00010000:00010000:3.0:1788891139.022993:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd548bf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.023007:0:17111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54887 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3fb expref: 50 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.023015:0:17111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd548bf lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.023042:0:17111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54887 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3fb expref: 50 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.023052:0:17111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54887 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3fb expref: 50 pid: 18639 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891139.023062:0:17111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17111:1875787997431936:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788891139.023160:0:17111:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8221c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788891139.026698:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891139.026858:0:17111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17111:1875787997431936:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891139.026883:0:17111:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd548bf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891139.027321:0:20136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987956352 00000100:00100000:1.0:1788891139.027349:0:20136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987956352 00010000:00010000:1.0:1788891139.027383:0:20136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54887 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3fb expref: 51 pid: 18639 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891139.027417:0:20136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:1.0:1788891139.027426:0:20136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+51:2394:x1875787987956352:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891139.027439:0:20136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891139.027447:0:20136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54887 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3fb expref: 51 pid: 18639 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.027459:0:20136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54887 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3fb expref: 51 pid: 18639 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.027481:0:20136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54887 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3fb expref: 51 pid: 18639 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.027497:0:20136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:1.0:1788891139.027502:0:20136:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd548bf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.027511:0:20136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd548bf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.027519:0:20136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd548bf lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.027582:0:20136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891139.027647:0:20136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+50:2394:x1875787987956352:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 211us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891139.027665:0:20136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 33 00010000:00010000:3.0:1788891139.027940:0:17111:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd548bf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.027949:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd548bf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891139.027966:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788891139.028146:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd548b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de410 expref: 51 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.028164:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd548bf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de410 expref: 50 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.028171:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:3.0:1788891139.028174:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788891139.028177:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8b800, rc 0) 00000100:00100000:3.0:1788891139.028219:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+50:15780:x1875787987956224:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 5382us (5586us total) trans 8589934656 rc 0/0 00000100:00100000:3.0:1788891139.028227:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 99 00000100:00100000:0.0:1788891139.031435:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891139.033035:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987956736 00000100:00100000:3.0:1788891139.033048:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987956736 00000100:00100000:3.0:1788891139.033116:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:3.0:1788891139.033127:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f81fdf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+50:15780:x1875787987956736:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:3.0:1788891139.033486:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f81fdf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+51:15780:x1875787987956736:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 360us (2056us total) trans 8589934657 rc 0/0 00000100:00100000:3.0:1788891139.033494:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:0.0:1788891139.040627:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891139.040753:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987956864 00000100:00100000:2.0:1788891139.040764:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987956864 00000100:00100000:2.0:1788891139.040950:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:2.0:1788891139.040973:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+51:15780:x1875787987956864:12345-192.168.204.26@tcp:103:lfs.0 00010000:00010000:2.0:1788891139.040989:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891139.041025:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54841 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3e6 expref: 51 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.041041:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:2.0:1788891139.041046:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891139.041105:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+50:15780:x1875787987956864:12345-192.168.204.26@tcp:103:lfs.0 Request processed in 134us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891139.041113:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:2.0:1788891139.044445:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891139.044655:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987956992 00000100:00100000:0.0:1788891139.044665:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987956992 00000100:00100000:0.0:1788891139.044719:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 100 00000100:00100000:0.0:1788891139.044730:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+50:15780:x1875787987956992:12345-192.168.204.26@tcp:58:lfs.0 00010000:00010000:0.0:1788891139.044856:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd548cd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.044870:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd548cd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.044889:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd548cd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788891139.044987:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].2, 136 off8464 00000100:00100000:0.0:1788891139.045253:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+50:15780:x1875787987956992:12345-192.168.204.26@tcp:58:lfs.0 Request processed in 524us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891139.045261:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 100 00000100:00100000:1.0:1788891139.047709:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891139.049100:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987957120 00000100:00100000:2.0:1788891139.049112:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987957120 00000100:00100000:2.0:1788891139.049183:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 101 00000100:00100000:2.0:1788891139.049193:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+50:15780:x1875787987957120:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788891139.049212:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891139.049232:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd548d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de417 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.049335:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd548cd lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.049674:0:17110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd548d4 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de417 expref: 51 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.049699:0:17110:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd548cd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.049730:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd548d4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de417 expref: 51 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.049744:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:2.0:1788891139.049747:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788891139.049751:0:17110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd548d4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de417 expref: 51 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.049759:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ede00, rc 0) 00000100:00100000:2.0:1788891139.049892:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+51:15780:x1875787987957120:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 699us (2192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891139.049899:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 101 00000040:00080000:1.0:1788891139.133247:0:17147:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788891139.133257:0:17147:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788891139.133283:0:17147:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788891139.133292:0:17147:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788891139.134460:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17147:1875787997432064:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788891139.134988:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250908f9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788891139.141083:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891139.141210:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987957248 00000100:00100000:3.0:1788891139.141220:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987957248 00000100:00100000:0.0:1788891139.141701:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17147:1875787997432064:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788891139.142053:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 102 00000100:00100000:3.0:1788891139.142065:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+51:15781:x1875787987957248:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788891139.142097:0:17109:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788891139.142217:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+51:15781:x1875787987957248:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 154us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891139.142241:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 102 00000100:00100000:0.0:1788891139.145892:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891139.146799:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987957376 00000100:00100000:3.0:1788891139.146811:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987957376 00000100:00100000:3.0:1788891139.147023:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 103 00000100:00100000:3.0:1788891139.147040:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+51:15781:x1875787987957376:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788891139.147271:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd548db lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147287:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd548db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147299:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd548db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147313:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd548e2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147331:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd548e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147346:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd548e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147370:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147379:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147385:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891139.147446:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788891139.147451:0:17111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891139.147464:0:17111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147475:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd548db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147482:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd548db lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147489:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd548db lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147494:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891139.147499:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd548db lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147506:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd548db lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147517:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff924f82e37d00) 00010000:00010000:3.0:1788891139.147542:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891139.147548:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd548db lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147554:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd548db lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147568:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd548e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147584:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd548e2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147590:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd548e2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147595:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8be00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891139.147598:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd548e2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147605:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd548e2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147613:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdfbec3e4 (ffff9250905a3200) 00010000:00010000:3.0:1788891139.147616:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891139.147618:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd548e2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147624:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd548e2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147650:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147657:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147663:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147667:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8bc00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891139.147677:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147683:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147691:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:3.0:1788891139.147693:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891139.147696:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548e9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.147701:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd548e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891139.147782:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+51:15781:x1875787987957376:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 Request processed in 748us (1897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891139.147790:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 103 00000100:00100000:2.0:1788891139.152628:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891139.152754:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987957632 00000100:00100000:0.0:1788891139.152764:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987957632 00000100:00100000:0.0:1788891139.152927:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 104 00000100:00100000:0.0:1788891139.152938:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+51:15781:x1875787987957632:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788891139.152960:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891139.152980:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd548f0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de41e expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.153086:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd548f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.153101:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd548f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.153113:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd548f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891139.153125:0:17109:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788891139.153204:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd548f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.153225:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd548f7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.153232:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd548f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.153238:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891139.153243:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd548f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.153249:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd548f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.153261:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:0.0:1788891139.153264:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788891139.153269:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd548f7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.153275:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd548f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.153314:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd548f0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de41e expref: 53 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.153325:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff924f82e37d00) 00010000:00010000:0.0:1788891139.153327:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788891139.153331:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd548f0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de41e expref: 53 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.153341:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4e00, rc 0) 00000100:00100000:0.0:1788891139.153598:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+52:15781:x1875787987957632:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 660us (978us total) trans 8589934658 rc 301/301 00000100:00100000:0.0:1788891139.153607:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 104 00000100:00100000:1.0:1788891139.158145:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891139.158228:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987957760 00000100:00100000:2.0:1788891139.158238:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987957760 00000100:00100000:2.0:1788891139.158302:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 105 00000100:00100000:2.0:1788891139.158314:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+52:15781:x1875787987957760:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788891139.158349:0:17110:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788891139.159045:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+52:15781:x1875787987957760:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 731us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891139.159053:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 105 00000100:00100000:1.0:1788891139.162498:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891139.162775:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987958016 00000100:00100000:2.0:1788891139.162785:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987958016 00000100:00100000:2.0:1788891139.162849:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 106 00000100:00100000:2.0:1788891139.162859:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+52:15781:x1875787987958016:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891139.162894:0:18639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891139.162897:0:18639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788891139.162922:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7000/0xa66601b03fd54895 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de402 expref: 52 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.162940:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:2.0:1788891139.162944:0:18639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891139.162958:0:18639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54905 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de425 expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788891139.163334:0:18639:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:2.0:1788891139.163341:0:18639:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788891139.163360:0:18639:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788891139.164077:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd5490c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.164092:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd5490c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.164103:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd5490c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.164162:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54905 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de425 expref: 54 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.164178:0:18639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd5490c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de425 expref: 53 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.164186:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff924f82e39600) 00010000:00010000:2.0:1788891139.164197:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891139.164199:0:18639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ed600, rc 0) 00000100:00100000:2.0:1788891139.164317:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+53:15781:x1875787987958016:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 1458us (1827us total) trans 8589934659 rc 0/0 00000100:00100000:2.0:1788891139.164325:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 106 00000100:00100000:0.0:1788891139.168086:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891139.168415:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987958272 00000100:00100000:3.0:1788891139.168425:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987958272 00000100:00100000:3.0:1788891139.168490:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 107 00000100:00100000:3.0:1788891139.168502:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+53:15781:x1875787987958272:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788891139.168593:0:17111:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891139.168618:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd5490c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de425 expref: 53 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168648:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff924f82e39600) 00010000:00010000:3.0:1788891139.168660:0:17111:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788891139.168692:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5491a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168723:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5491a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168734:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5491a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168750:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54921 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x95424433 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168758:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54921 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x95424433 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168764:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54921 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x95424433 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168830:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5491a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168837:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5491a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168844:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5491a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168849:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8bc00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891139.168853:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5491a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168861:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5491a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168869:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:3.0:1788891139.168877:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891139.168881:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5491a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168887:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8bc00/0xa66601b03fd5491a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168899:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54921 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x95424433 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168909:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54921 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x95424433 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168915:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54921 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x95424433 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168920:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8be00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891139.168923:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54921 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x95424433 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168929:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54921 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x95424433 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168936:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x95424433 (ffff9250905a3200) 00010000:00010000:3.0:1788891139.168938:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891139.168941:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54921 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x95424433 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.168947:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8be00/0xa66601b03fd54921 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x95424433 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891139.169977:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+52:15781:x1875787987958272:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 1471us (1896us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788891139.169987:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 107 00000100:00100000:1.0:1788891139.172770:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891139.172933:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987958400 00000100:00100000:0.0:1788891139.172943:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987958400 00000100:00100000:0.0:1788891139.173015:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 108 00000100:00100000:0.0:1788891139.173026:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+52:15781:x1875787987958400:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788891139.173044:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891139.173067:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd54928 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de42c expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.173103:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd5492f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.173114:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd5492f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.173124:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd5492f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.173232:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd54928 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de42c expref: 54 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.173249:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd5492f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de42c expref: 53 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.173257:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff925085363900) 00010000:00010000:0.0:1788891139.173260:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788891139.173271:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5400, rc 0) 00000100:00100000:0.0:1788891139.173330:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+53:15781:x1875787987958400:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 306us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891139.173337:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 108 00000100:00100000:1.0:1788891139.178216:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891139.178292:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987958656 00000100:00100000:2.0:1788891139.178304:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987958656 00000100:00100000:2.0:1788891139.178372:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 109 00000100:00100000:2.0:1788891139.178382:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+53:15781:x1875787987958656:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788891139.178462:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54936 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.178479:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54936 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.178490:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54936 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788891139.178701:0:17110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788891139.178711:0:17110:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361423187720ns, next at 362423185190ns, rc = 0 00000004:00010000:2.0:1788891139.178761:0:17110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da0b86d3 reply state 000000004b76d868 transno 8589934660 ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54936 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.178789:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54936 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.178898:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff925085363900) 00010000:00010000:2.0:1788891139.178901:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788891139.178905:0:17110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788891139.179006:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+55:15781:x1875787987958656:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 624us (799us total) trans 8589934660 rc 0/0 00000100:00100000:2.0:1788891139.179013:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 109 00000100:00100000:1.0:1788891139.181061:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891139.181278:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987958784 00000100:00100000:0.0:1788891139.181289:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987958784 00000100:00100000:0.0:1788891139.181349:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 110 00000100:00100000:0.0:1788891139.181371:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+55:15781:x1875787987958784:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788891139.181393:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891139.181411:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5493d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de433 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.181460:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5493d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de433 expref: 56 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.181488:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5493d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de433 expref: 56 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.181519:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff925085363900) 00010000:00010000:0.0:1788891139.181552:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788891139.181555:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5800, rc 0) 00000100:00100000:0.0:1788891139.181600:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+56:15781:x1875787987958784:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 242us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891139.181607:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 110 00000100:00100000:1.0:1788891139.187169:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891139.187372:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987958912 00000100:00100000:2.0:1788891139.187381:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987958912 00000100:00100000:2.0:1788891139.187564:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:2.0:1788891139.187575:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+5:2394:x1875787987958912:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788891139.187816:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2394:x1875787987958912:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 242us (653us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788891139.187823:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00080000:0.0:1788891139.188625:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788891139.198308:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891139.198378:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987959168 00000100:00100000:2.0:1788891139.198388:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987959168 00000100:00100000:2.0:1788891139.198443:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:2.0:1788891139.198452:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+56:15781:x1875787987959168:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788891139.198955:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+57:15781:x1875787987959168:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 502us (655us total) trans 8589934661 rc 0/0 00000100:00100000:2.0:1788891139.198965:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:1.0:1788891139.203617:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891139.203703:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987959424 00000100:00100000:2.0:1788891139.203713:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987959424 00000100:00100000:2.0:1788891139.203774:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 111 00000100:00100000:2.0:1788891139.203785:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+57:15781:x1875787987959424:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788891139.203898:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+57:15781:x1875787987959424:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 114us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891139.203923:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 111 00000100:00100000:1.0:1788891139.207332:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891139.207492:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987959552 00000100:00100000:2.0:1788891139.207501:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987959552 00000100:00100000:2.0:1788891139.207737:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 112 00000100:00100000:2.0:1788891139.207748:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+57:15781:x1875787987959552:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891139.207779:0:18639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891139.207802:0:18639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd54944 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de43a expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.207900:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd5494b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.207914:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd5494b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.207926:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd5494b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891139.207968:0:18639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788891139.207987:0:18639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd5494b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.208027:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed600/0xa66601b03fd54944 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de43a expref: 59 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.208045:0:18639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd5494b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de43a expref: 58 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.208052:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff925085363900) 00010000:00010000:2.0:1788891139.208061:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788891139.208065:0:18639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311c00, rc 0) 00000100:00100000:2.0:1788891139.208128:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+58:15781:x1875787987959552:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 382us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891139.208135:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 112 00000100:00100000:1.0:1788891139.212144:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891139.212219:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987959680 00000100:00100000:3.0:1788891139.212240:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987959680 00000100:00100000:3.0:1788891139.212294:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:3.0:1788891139.212305:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2391:x1875787987959680:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788891139.212325:0:18616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891139.212346:0:18616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081f603eb/0xa66601b03fd54952 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de441 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788891139.212370:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa05002, blocks: 0x0 00010000:00010000:3.0:1788891139.212388:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1788891139.212392:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891139.212402:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081f603eb/0xa66601b03fd54952 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de441 expref: 7 pid: 18616 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.212419:0:18616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000081f603eb/0xa66601b03fd54952 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de441 expref: 7 pid: 18616 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.212431:0:18616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8be00, rc 0) 00000100:00100000:3.0:1788891139.212481:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:2391:x1875787987959680:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 177us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891139.212488:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:1.0:1788891139.220477:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891139.220581:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987959936 00000100:00100000:2.0:1788891139.220591:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987959936 00000100:00100000:2.0:1788891139.220664:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 113 00000100:00100000:2.0:1788891139.220675:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+58:15781:x1875787987959936:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788891139.220782:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+58:15781:x1875787987959936:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 109us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891139.220790:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 113 00000100:00100000:1.0:1788891139.224215:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891139.224450:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987960064 00000100:00100000:2.0:1788891139.224461:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987960064 00000100:00100000:2.0:1788891139.224519:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:2.0:1788891139.224586:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:15781:x1875787987960064:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891139.224604:0:18613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891139.224623:0:18613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b1bfa/0xa66601b03fd54959 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de448 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.224797:0:18613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081f603eb/0xa66601b03fd54952 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de441 expref: 8 pid: 18616 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.224806:0:18613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891139.224811:0:18613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891139.224816:0:18613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b1bfa/0xa66601b03fd54959 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de448 expref: 8 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.224868:0:18613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081f603eb/0xa66601b03fd54952 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de441 expref: 8 pid: 18616 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.224883:0:18613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081f603eb/0xa66601b03fd54952 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de441 expref: 8 pid: 18616 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891139.224899:0:18613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18613:1875787997432192:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891139.225021:0:18613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c5480 going to sleep for 11 seconds 00000100:00100000:2.0:1788891139.227277:0:18613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18613:1875787997432192:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891139.227308:0:18613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000119b1bfa/0xa66601b03fd54959 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de448 expref: 8 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891139.227330:0:18613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311600, rc 0) 00000100:00100000:2.0:1788891139.227398:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+8:15781:x1875787987960064:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 2814us (3191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891139.227407:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:1.0:1788891139.227794:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891139.227900:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987960192 00000100:00100000:0.0:1788891139.227906:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987960192 00010000:00010000:0.0:1788891139.227938:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081f603eb/0xa66601b03fd54952 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de441 expref: 8 pid: 18616 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891139.228105:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:0.0:1788891139.228115:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+8:2393:x1875787987960192:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891139.228129:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891139.228159:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081f603eb/0xa66601b03fd54952 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de441 expref: 8 pid: 18616 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.228173:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081f603eb/0xa66601b03fd54952 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de441 expref: 8 pid: 18616 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.228196:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081f603eb/0xa66601b03fd54952 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de441 expref: 8 pid: 18616 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.228210:0:17095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891139.228215:0:17095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891139.228223:0:17095:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000119b1bfa/0xa66601b03fd54959 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de448 expref: 7 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.228235:0:17095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b1bfa/0xa66601b03fd54959 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de448 expref: 7 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.228270:0:17095:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000119b1bfa/0xa66601b03fd54959 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de448 expref: 7 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891139.228285:0:17095:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17095:1875787997432320:192.168.204.26@tcp:105: 00000100:00100000:0.0:1788891139.228614:0:17095:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fb540 going to sleep for 11 seconds 00000100:00100000:0.0:1788891139.230756:0:17095:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17095:1875787997432320:192.168.204.26@tcp:105: 00010000:00010000:0.0:1788891139.230885:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891139.230991:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:2393:x1875787987960192:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 2876us (3196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891139.231016:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:1.0:1788891139.233227:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891139.233509:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987960320 00000100:00100000:2.0:1788891139.233519:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987960320 00002000:00100000:2.0:1788891139.233594:0:18619:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->12) req@ffff924f8318c000 x1875787987960320/t0(0) o4->6f09a10f-9224-43a2-a8d4-25920b0f419e@192.168.204.26@tcp:190/0 lens 504/0 e 0 to 0 dl 1788891150 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788891139.233604:0:18619:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f8318c000 with x1875787987960320 ext(0->12) 00002000:00010000:2.0:1788891139.233609:0:18619:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924f8318c000 00000100:00100000:2.0:1788891139.233647:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:2.0:1788891139.233674:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:2394:x1875787987960320:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788891139.235245:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+9:2394:x1875787987960320:12345-192.168.204.26@tcp:4:lhsmtool_posix.0 Request processed in 1568us (2018us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788891139.235256:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2 00002000:00100000:2.0:1788891139.235265:0:18619:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->12) req@ffff924f8318c000 x1875787987960320/t8589934596(0) o4->6f09a10f-9224-43a2-a8d4-25920b0f419e@192.168.204.26@tcp:190/0 lens 504/448 e 0 to 0 dl 1788891150 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788891139.235275:0:18619:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f8318c000 with x1875787987960320 ext(0->12) 00002000:00010000:2.0:1788891139.235280:0:18619:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924f8318c000 00000100:00100000:3.0:1788891139.239352:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891139.239467:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987960448 00000100:00100000:2.0:1788891139.239477:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987960448 00000100:00100000:2.0:1788891139.239617:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 114 00000100:00100000:2.0:1788891139.239638:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+58:15781:x1875787987960448:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788891139.242295:0:17089:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934661 is committed 00000004:00080000:0.0:1788891139.242311:0:17089:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1788891139.242452:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd546c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242464:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd546c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242471:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd546c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242490:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891139.242495:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd546c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242504:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd546c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242542:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff925085363300) 00010000:00010000:3.0:1788891139.242546:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891139.242552:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd546c0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242558:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5a00/0xa66601b03fd546c0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242595:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54761 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242602:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54761 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242608:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54761 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242612:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ec600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891139.242615:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54761 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242620:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54761 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242654:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff925085363800) 00010000:00010000:3.0:1788891139.242657:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891139.242660:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54761 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242665:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ec600/0xa66601b03fd54761 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242684:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242690:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242695:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242699:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ece00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891139.242701:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242707:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242712:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff924f82e39700) 00010000:00010000:3.0:1788891139.242715:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891139.242717:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547f4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242721:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ece00/0xa66601b03fd547f4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242743:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54817 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242748:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54817 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242753:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54817 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242758:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891139.242761:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54817 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242766:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54817 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242774:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff924f82e39700) 00010000:00010000:3.0:1788891139.242776:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891139.242779:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54817 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242785:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed800/0xa66601b03fd54817 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242799:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd54879 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242803:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd54879 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242809:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd54879 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242820:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813eda00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891139.242823:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd54879 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242828:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd54879 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242836:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:3.0:1788891139.242843:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891139.242846:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd54879 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242851:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813eda00/0xa66601b03fd54879 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242862:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54936 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242868:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54936 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242874:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54936 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242878:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891139.242881:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54936 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242887:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54936 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242904:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff925085363900) 00010000:00010000:3.0:1788891139.242907:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788891139.242910:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54936 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.242916:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ed200/0xa66601b03fd54936 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891139.243249:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788891139.243269:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997432448:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788891139.243335:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788891139.243791:0:17089:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9250c0a18180 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:0.0:1788891139.243796:0:17089:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff925086ff9600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9250c0a18cc0 00000020:00080000:0.0:1788891139.243800:0:17089:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff925086ff9700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff925086f4ec00 00000020:00080000:1.0:1788891139.243914:0:17148:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:1.0:1788891139.243981:0:17148:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1788891139.244245:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997432448 00000100:00100000:2.0:1788891139.244253:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997432448 00000100:00100000:2.0:1788891139.244351:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788891139.244360:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997432448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788891139.244463:0:18616:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788891139.244466:0:18616:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788891138 00002000:00010000:2.0:1788891139.244469:0:18616:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788891139.244471:0:18616:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788891138 -> 1788891138 00002000:00010000:2.0:1788891139.244473:0:18616:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788891139.244566:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3628:x1875787997432448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 206us (1230us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788891139.244573:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788891139.244686:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+16:15781:x1875787987960448:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 Request processed in 5058us (5341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891139.244703:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 114 00000004:00080000:1.0:1788891139.244962:0:3628:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff925090313480/2, rc 0, transno 8589934597 00000100:00100000:1.0:1788891139.244968:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997432448:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1788891139.245424:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891139.248491:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891139.248726:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987960576 00000100:00100000:3.0:1788891139.248736:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987960576 00000100:00100000:2.0:1788891139.248958:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:2.0:1788891139.248969:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+9:2393:x1875787987960576:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788891139.250437:0:18610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1788891139.250455:0:18610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000100:00100000:2.0:1788891139.250914:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2393:x1875787987960576:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 Request processed in 1943us (2430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891139.250926:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:2.0:1788891139.253076:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891139.253335:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987960832 00000100:00100000:1.0:1788891139.253345:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987960832 00000100:00100000:0.0:1788891139.253647:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 115 00000100:00100000:0.0:1788891139.253661:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+16:15781:x1875787987960832:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788891139.253716:0:17111:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891139.253747:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311c00/0xa66601b03fd5494b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de43a expref: 16 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.253772:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff925085363900) 00010000:00010000:0.0:1788891139.253778:0:17111:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788891139.253811:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd54960 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.253835:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd54960 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.253865:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd54960 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788891139.253986:0:17111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025c3f3f5 reply state 00000000969340d8 transno 8589934662 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd54960 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.253999:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd54960 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.254005:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff925085363900) 00010000:00010000:0.0:1788891139.254008:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788891139.254010:0:17111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788891139.254118:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+17:15781:x1875787987960832:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 460us (1051us total) trans 8589934662 rc 0/0 00000100:00100000:0.0:1788891139.254126:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 115 00000100:00100000:3.0:1788891139.256203:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891139.256308:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987960960 00000100:00100000:2.0:1788891139.256318:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987960960 00000100:00100000:2.0:1788891139.256399:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:2.0:1788891139.256410:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2391:x1875787987960960:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788891139.256578:0:18616:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788891139.256583:0:18616:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1788891138 -> 1788891138 00002000:00010000:2.0:1788891139.256585:0:18616:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788891138 00002000:00010000:2.0:1788891139.256587:0:18616:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788891138 -> 1788891138 00002000:00010000:2.0:1788891139.256589:0:18616:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788891139.256653:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:2391:x1875787987960960:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 244us (458us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788891139.256660:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:2.0:1788891139.260078:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891139.260157:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987961216 00000100:00100000:0.0:1788891139.260168:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987961216 00000100:00100000:0.0:1788891139.260229:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 116 00000100:00100000:0.0:1788891139.260239:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+17:15781:x1875787987961216:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788891139.260305:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54967 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.260322:0:17109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd5492f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de42c expref: 17 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.260331:0:17109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54967 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.260364:0:17109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd5492f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de42c expref: 17 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.260391:0:17109:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd5492f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de42c expref: 17 pid: 17109 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891139.260405:0:17109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17109:1875787997432576:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891139.260493:0:17109:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891139.263347:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891139.263440:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987961344 00000100:00100000:3.0:1788891139.263449:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987961344 00010000:00010000:3.0:1788891139.263487:0:17096:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd5492f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de42c expref: 18 pid: 17109 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891139.263549:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:3.0:1788891139.263559:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+18:2393:x1875787987961344:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891139.263572:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891139.263579:0:17096:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd5492f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de42c expref: 18 pid: 17109 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.263590:0:17096:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd5492f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de42c expref: 18 pid: 17109 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.263610:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd5492f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de42c expref: 18 pid: 17109 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891139.263624:0:17109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17109:1875787997432576:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891139.263658:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff925085363900) 00010000:00010000:3.0:1788891139.263663:0:17096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54967 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.263689:0:17096:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54967 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.263696:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54967 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.263747:0:17109:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54967 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.264175:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788891139.264202:0:17109:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54967 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.264211:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54967 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.264258:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54967 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891139.264282:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+17:2393:x1875787987961344:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 722us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891139.264291:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 35 00010000:00010000:0.0:1788891139.264383:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54967 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.264390:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54967 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.264395:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891139.264400:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54967 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.264418:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54967 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.264429:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff925085363900) 00010000:00010000:0.0:1788891139.264432:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788891139.264436:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54967 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.264442:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5200/0xa66601b03fd54967 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891139.264574:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+16:15781:x1875787987961216:12345-192.168.204.26@tcp:55:lhsmtool_posix.0 Request processed in 4335us (4501us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788891139.264582:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 116 00000100:00100000:1.0:1788891139.267210:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891139.267314:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987961472 00000100:00100000:0.0:1788891139.267323:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987961472 00000100:00100000:0.0:1788891139.267431:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:0.0:1788891139.267442:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:2394:x1875787987961472:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788891139.267488:0:18613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5496e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.267510:0:18613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000119b1bfa/0xa66601b03fd54959 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de448 expref: 7 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.267519:0:18613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891139.267679:0:18613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788891139.267684:0:18613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5496e lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.267733:0:18613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000119b1bfa/0xa66601b03fd54959 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de448 expref: 7 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.267745:0:18613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000119b1bfa/0xa66601b03fd54959 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de448 expref: 7 pid: 18613 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891139.267760:0:18613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18613:1875787997432704:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891139.268078:0:18613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788891139.270837:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891139.270980:0:20136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987961600 00000100:00100000:1.0:1788891139.270988:0:20136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987961600 00000100:00100000:0.0:1788891139.271000:0:18613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18613:1875787997432704:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891139.271034:0:20136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000119b1bfa/0xa66601b03fd54959 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de448 expref: 8 pid: 18613 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.271039:0:18613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5496e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891139.271119:0:20136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:1.0:1788891139.271129:0:20136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090311180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+8:2393:x1875787987961600:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891139.271144:0:20136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891139.271166:0:20136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000119b1bfa/0xa66601b03fd54959 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de448 expref: 8 pid: 18613 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.271179:0:20136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000119b1bfa/0xa66601b03fd54959 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de448 expref: 8 pid: 18613 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.271201:0:20136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b1bfa/0xa66601b03fd54959 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de448 expref: 8 pid: 18613 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.271216:0:20136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788891139.271221:0:20136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788891139.271241:0:20136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5496e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.271251:0:20136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5496e lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.271273:0:20136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891139.271325:0:20136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090311180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:2393:x1875787987961600:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 197us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891139.271334:0:20136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 36 00010000:00010000:0.0:1788891139.271344:0:18613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5496e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.271355:0:18613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5496e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.271482:0:18613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5496e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.271499:0:18613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5496e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.271518:0:18613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5496e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.271560:0:18613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4a00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891139.271564:0:18613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5496e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.271584:0:18613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5496e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.271597:0:18613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5496e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.271605:0:18613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9cae02e/0xa66601b03fd5496e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891139.271683:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2394:x1875787987961472:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 Request processed in 4242us (4482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891139.271692:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:2.0:1788891139.273719:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891139.273760:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987961856 00000100:00100000:1.0:1788891139.273768:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987961856 00000100:00100000:1.0:1788891139.273825:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 117 00000100:00100000:1.0:1788891139.273835:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+16:15781:x1875787987961856:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788891139.273921:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54975 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.273939:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd54872 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3f4 expref: 16 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.273948:0:17110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54975 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.273981:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd54872 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3f4 expref: 16 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.273995:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd54872 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3f4 expref: 16 pid: 17109 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891139.274025:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997432832:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891139.274109:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250908f9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788891139.276641:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891139.276673:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997432832:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891139.276699:0:17110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54975 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891139.276743:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987961984 00000100:00100000:3.0:1788891139.276750:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987961984 00010000:00010000:3.0:1788891139.276793:0:17094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd54872 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3f4 expref: 17 pid: 17109 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891139.276841:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:3.0:1788891139.276850:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925088664850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+17:2394:x1875787987961984:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891139.276864:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891139.276871:0:17094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd54872 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3f4 expref: 17 pid: 17109 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.276884:0:17094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd54872 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3f4 expref: 17 pid: 17109 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.276924:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4600/0xa66601b03fd54872 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3f4 expref: 17 pid: 17109 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.276939:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:3.0:1788891139.276945:0:17094:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd548d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de417 expref: 16 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.276954:0:17094:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54975 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.276962:0:17094:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54975 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.276969:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54975 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.277007:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891139.277051:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925088664850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+16:2394:x1875787987961984:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 202us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891139.277059:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 37 00010000:00010000:1.0:1788891139.277397:0:17110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54975 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.277406:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54975 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.277761:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5497c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.277775:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5493d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de433 expref: 16 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.277784:0:17110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5497c lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.277812:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5493d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de433 expref: 16 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.277825:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5493d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de433 expref: 16 pid: 17109 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891139.277838:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997432960:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891139.278125:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250908f9180 going to sleep for 11 seconds 00000100:00100000:2.0:1788891139.280862:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891139.281029:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997432960:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891139.281056:0:17110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5497c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891139.281214:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987962112 00000100:00100000:3.0:1788891139.281222:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987962112 00010000:00010000:3.0:1788891139.281324:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5493d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de433 expref: 17 pid: 17109 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891139.281384:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:3.0:1788891139.281395:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090313800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+17:2393:x1875787987962112:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891139.281422:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891139.281429:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5493d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de433 expref: 17 pid: 17109 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.281438:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5493d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de433 expref: 17 pid: 17109 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.281454:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5800/0xa66601b03fd5493d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de433 expref: 17 pid: 17109 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.281466:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff925085363900) 00010000:00010000:3.0:1788891139.281469:0:17095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5497c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.281476:0:17095:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5497c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.281480:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5497c lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.281498:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788891139.281518:0:17110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5497c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.281605:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5497c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788891139.281721:0:17110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934663 00000100:00100000:2.0:1788891139.281952:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090313800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+17:2393:x1875787987962112:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 557us (1097us total) trans 0 rc 0/0 00000001:00080000:1.0:1788891139.281956:0:17110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934664 00000100:00100000:2.0:1788891139.281960:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 38 00000001:00080000:1.0:1788891139.281990:0:17110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934665 00000100:00100000:1.0:1788891139.282070:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17110:1875787997433088:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788891139.282114:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891139.282145:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250908f9000 going to sleep for 11 seconds 00000100:00100000:2.0:1788891139.282288:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997433088 00000100:00100000:2.0:1788891139.283309:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997433088 00000100:00100000:2.0:1788891139.283420:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788891139.283429:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:17110:x1875787997433088:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788891139.283553:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:17110:x1875787997433088:12345-0@lo:1000:mdt00_001.0 Request processed in 125us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891139.283560:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788891139.283660:0:17110:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1788891139.283666:0:17110:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff925090313480, transno 8589934597 00000100:00100000:1.0:1788891139.283680:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17110:1875787997433088:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788891139.283851:0:17110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934666 00000100:00100000:1.0:1788891139.283912:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17110:1875787997433216:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788891139.284181:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891139.284211:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250908f9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788891139.284322:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997433216 00000100:00100000:3.0:1788891139.284328:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997433216 00000100:00100000:3.0:1788891139.284364:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788891139.284373:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:17110:x1875787997433216:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788891139.284489:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17110:x1875787997433216:12345-0@lo:1000:mdt00_001.0 Request processed in 117us (309us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788891139.284497:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788891139.285326:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17110:1875787997433216:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788891139.285369:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5497c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.285394:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5497c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.285401:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5497c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.285406:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891139.285410:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5497c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.285417:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5497c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.285432:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff925085363900) 00010000:00010000:1.0:1788891139.285435:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788891139.285439:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5497c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.285445:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5497c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.285472:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd548cd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.285477:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd548cd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.285482:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd548cd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.285487:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891139.285496:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd548cd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.285502:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd548cd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.285511:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:1.0:1788891139.285513:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788891139.285589:0:17110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd548d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de417 expref: 19 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.285602:0:17110:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd548d4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de417 expref: 19 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.285611:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd548d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de417 expref: 19 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.285655:0:17110:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd548d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de417 expref: 19 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891139.285669:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997433344:192.168.204.26@tcp:105: 00000100:00100000:1.0:1788891139.285741:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250908f9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788891139.288744:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17110:1875787997433344:192.168.204.26@tcp:105: 00010000:00010000:1.0:1788891139.288775:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd548cd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.288784:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd548cd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.288834:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54983 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.288848:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54983 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.288859:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54983 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.288936:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54983 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.288942:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54983 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.288948:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54983 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.288953:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891139.288957:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54983 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.288964:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54983 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.288976:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:1.0:1788891139.288979:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891139.288982:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54983 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.288993:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54983 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.289010:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54975 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.289015:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54975 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.289021:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54975 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.289026:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891139.289029:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54975 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.289035:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54975 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.289044:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:1.0:1788891139.289046:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788891139.289050:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54975 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.289055:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54975 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891139.289065:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891139.289251:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987962240 00000100:00100000:0.0:1788891139.289262:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987962240 00000100:00100000:0.0:1788891139.289314:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:0.0:1788891139.289323:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+20:15780:x1875787987962240:12345-192.168.204.26@tcp:49:lfs.0 00000100:00100000:0.0:1788891139.289442:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+20:15780:x1875787987962240:12345-192.168.204.26@tcp:49:lfs.0 Request processed in 120us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891139.289461:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:1.0:1788891139.289464:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+20:15781:x1875787987961856:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 15631us (15753us total) trans 8589934667 rc 0/0 00000100:00100000:1.0:1788891139.289470:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 117 00000020:00080000:1.0:1788891139.289473:0:17110:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788891139.290016:0:17147:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788891139.290022:0:17147:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788891139.290040:0:17147:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788891139.290047:0:17147:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788891139.292487:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891139.292653:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987962496 00000100:00100000:0.0:1788891139.292663:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987962496 00000100:00100000:0.0:1788891139.292722:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 118 00000100:00100000:0.0:1788891139.292732:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+19:15780:x1875787987962496:12345-192.168.204.26@tcp:58:lfs.0 00000040:00080000:0.0:1788891139.292902:0:18639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].3, 136 off8600 00000100:00100000:0.0:1788891139.292978:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+19:15780:x1875787987962496:12345-192.168.204.26@tcp:58:lfs.0 Request processed in 247us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891139.292986:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 118 00000100:00100000:3.0:1788891139.293401:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891139.293437:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987962752 00000100:00100000:0.0:1788891139.293442:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987962752 00000100:00100000:0.0:1788891139.293475:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:0.0:1788891139.293482:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+19:15781:x1875787987962752:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788891139.293705:0:17112:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788891139.293737:0:17112:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934668 00010000:00010000:0.0:1788891139.293771:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5498a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.293787:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5498a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.293798:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5498a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.293805:0:17112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5498a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.294442:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5498a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.294464:0:17112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5498a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.294490:0:17112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788891139.294593:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+21:15781:x1875787987962752:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 1110us (1298us total) trans 8589934669 rc 0/0 00000100:00100000:0.0:1788891139.294601:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 25 00000020:00080000:0.0:1788891139.294606:0:17112:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788891139.294684:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891139.294691:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5498a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.294698:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4a00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891139.294701:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5498a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.294710:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5498a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.294724:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff925085363900) 00010000:00010000:3.0:1788891139.294727:0:17098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788891139.294731:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5498a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.294737:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4a00/0xa66601b03fd5498a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891139.294749:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891139.294750:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891139.294752:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891139.321353:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891139.321456:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987962880 00000100:00100000:1.0:1788891139.321467:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987962880 00000100:00100000:1.0:1788891139.321617:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 119 00000100:00100000:1.0:1788891139.321640:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+21:15783:x1875787987962880:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788891139.321666:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891139.321686:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54991 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de44f expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.321753:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54998 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.321768:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54998 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.321778:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54998 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.321793:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5499f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.321801:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5499f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.321808:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5499f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.321901:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd549a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.321912:0:17111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd548bf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de410 expref: 22 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.321921:0:17111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd549a6 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.321960:0:17111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd548bf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de410 expref: 22 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.321974:0:17111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd548bf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de410 expref: 22 pid: 17111 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891139.322160:0:17111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17111:1875787997433472:192.168.204.26@tcp:104: 00000100:00100000:1.0:1788891139.322246:0:17111:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250908f9900 going to sleep for 11 seconds 00000100:00100000:2.0:1788891139.325068:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891139.325179:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987963136 00000100:00100000:0.0:1788891139.325188:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987963136 00000100:00100000:0.0:1788891139.325240:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 26 00000100:00100000:0.0:1788891139.325250:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+23:14867:x1875787987963136:12345-192.168.204.26@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788891139.325486:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+24:14867:x1875787987963136:12345-192.168.204.26@tcp:35:ldlm_bl.0 Request processed in 237us (426us total) trans 8589934670 rc 0/0 00000100:00100000:0.0:1788891139.325494:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 26 00000100:00100000:1.0:1788891139.326152:0:17111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17111:1875787997433472:192.168.204.26@tcp:104: 00010000:00010000:1.0:1788891139.326177:0:17111:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd549a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891139.326902:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891139.326973:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987963264 00000100:00100000:0.0:1788891139.326979:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987963264 00010000:00010000:0.0:1788891139.327009:0:17096:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd548bf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de410 expref: 24 pid: 17111 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891139.327089:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:0.0:1788891139.327098:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+24:2394:x1875787987963264:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891139.327111:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891139.327119:0:17096:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd548bf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de410 expref: 24 pid: 17111 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.327150:0:17096:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd548bf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de410 expref: 24 pid: 17111 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.327170:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd548bf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de410 expref: 24 pid: 17111 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.327198:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:0.0:1788891139.327203:0:17096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd549a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.327211:0:17096:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd549a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.327218:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd549a6 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891139.327247:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891139.327294:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+23:2394:x1875787987963264:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 196us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891139.327302:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 39 00010000:00010000:1.0:1788891139.327373:0:17111:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd549a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.327381:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd549a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891139.327429:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788891139.327434:0:17111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788891139.327457:0:17111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd549a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.327470:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd549a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.327480:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54998 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.327496:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54998 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.327502:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54998 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.327508:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891139.327512:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54998 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.327519:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54998 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.327576:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:1.0:1788891139.327579:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891139.327583:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54998 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.327598:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd54998 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.327609:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5499f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.327616:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5499f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.327621:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5499f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.327626:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891139.327648:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5499f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.327656:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5499f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.327665:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff925095f80900) 00010000:00010000:1.0:1788891139.327668:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891139.327671:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5499f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.327677:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6200/0xa66601b03fd5499f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.327711:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7a00/0xa66601b03fd54991 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de44f expref: 23 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.327723:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd549a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de44f expref: 22 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891139.327730:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:1.0:1788891139.327732:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788891139.327735:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7c00, rc 0) 00000100:00100000:1.0:1788891139.327781:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+22:15783:x1875787987962880:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 6155us (6439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891139.327788:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 119 00010000:00010000:0.0:1788891139.644144:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788891139.881889:0:20338:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788891139.881899:0:20338:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788891139.881931:0:20338:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:0.0:1788891139.881939:0:20338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788891140.049912:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891140.049962:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891140.050113:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987963392 00000100:00100000:2.0:1788891140.050124:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987963392 00000100:00100000:2.0:1788891140.050195:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 162 00000100:00100000:2.0:1788891140.050208:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+13:2392:x1875787987963392:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891140.050215:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891140.050245:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891140.050293:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+13:2392:x1875787987963392:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 89us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891140.050301:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 162 00000100:00100000:1.0:1788891140.050352:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987963520 00000100:00100000:1.0:1788891140.050358:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987963520 00000100:00100000:1.0:1788891140.050399:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987963648 00000100:00100000:1.0:1788891140.050403:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987963648 00000100:00100000:1.0:1788891140.050501:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 41 00000100:00100000:1.0:1788891140.050511:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+22:2391:x1875787987963520:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891140.050797:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:0.0:1788891140.050810:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+5:2392:x1875787987963648:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788891140.051785:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+22:2391:x1875787987963520:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 1270us (1815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891140.051796:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 41 00000100:00100000:3.0:1788891140.051805:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891140.051818:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987964032 00000100:00100000:1.0:1788891140.051823:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987964032 00000100:00100000:1.0:1788891140.051857:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:2.0:1788891140.051890:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891140.051917:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987963776 00000100:00100000:2.0:1788891140.051921:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891140.051924:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987963776 00000100:00100000:1.0:1788891140.051929:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:2391:x1875787987964032:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788891140.051948:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891140.051981:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:2391:x1875787987964032:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 115us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891140.051991:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:2.0:1788891140.051995:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891140.052002:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987963904 00000100:00100000:3.0:1788891140.052008:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987963904 00000100:00100000:1.0:1788891140.052011:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987964160 00000100:00100000:1.0:1788891140.052017:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987964160 00000100:00100000:3.0:1788891140.052030:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987964288 00000100:00100000:3.0:1788891140.052035:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987964288 00000100:00100000:1.0:1788891140.052048:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 44 00000100:00100000:1.0:1788891140.052058:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2392:x1875787987964160:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891140.052060:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987964416 00000100:00100000:3.0:1788891140.052065:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987964416 00000100:00100000:3.0:1788891140.052085:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:3.0:1788891140.052093:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2391:x1875787987963776:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788891140.052150:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:2.0:1788891140.052160:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090311500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+8:2392:x1875787987963904:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891140.052471:0:18613:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788891140.052480:0:18613:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1788891140.052605:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:0.0:1788891140.052622:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090312300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2391:x1875787987964288:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891140.052658:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090312300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2391:x1875787987964288:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 47us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891140.052664:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:0.0:1788891140.052677:0:18613:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788891140.053017:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:0.0:1788891140.053027:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2392:x1875787987964416:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891140.053058:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2392:x1875787987964416:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 33us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891140.053064:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:3.0:1788891140.053141:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2391:x1875787987963776:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 1047us (2925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891140.053150:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:2.0:1788891140.053157:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090311500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+8:2392:x1875787987963904:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 995us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891140.053174:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00080000:0.0:1788891140.053177:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788891140.053180:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+5:2392:x1875787987963648:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 2371us (2933us total) trans 0 rc 0/0 00000100:00080000:0.0:1788891140.053184:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788891140.053189:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788891140.053190:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00080000:0.0:1788891140.053193:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891140.058178:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2392:x1875787987964160:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 6112us (6249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891140.058190:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 44 00000040:00080000:3.0:1788891140.347903:0:17147:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788891140.347913:0:17147:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788891140.347940:0:17147:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:3.0:1788891140.347949:0:17147:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788891140.348093:0:17147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839cf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17147:1875787997433600:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788891140.348192:0:17147:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8215b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788891140.355723:0:17147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839cf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17147:1875787997433600:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788891140.357411:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891140.357898:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987964544 00000100:00100000:3.0:1788891140.357918:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987964544 00000100:00100000:3.0:1788891140.358032:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 120 00000100:00100000:3.0:1788891140.358044:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+22:15795:x1875787987964544:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788891140.358075:0:17110:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788891140.358188:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+22:15795:x1875787987964544:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 147us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891140.358196:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 120 00000100:00100000:0.0:1788891140.362241:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891140.362343:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987964800 00000100:00100000:1.0:1788891140.362353:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987964800 00000100:00100000:1.0:1788891140.362413:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 121 00000100:00100000:1.0:1788891140.362423:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+22:15795:x1875787987964800:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788891140.362444:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891140.362465:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd549ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de456 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891140.362624:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd549b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891140.362641:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd549b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891140.362655:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd549b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891140.362668:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788891140.362796:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd549ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de456 expref: 25 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891140.362816:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd549b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de456 expref: 24 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891140.362825:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:1.0:1788891140.362828:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788891140.362831:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6400, rc 0) 00000100:00100000:1.0:1788891140.363121:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+24:15795:x1875787987964800:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 698us (888us total) trans 8589934671 rc 0/0 00000100:00100000:1.0:1788891140.363130:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 121 00000100:00100000:2.0:1788891140.368492:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891140.368804:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891140.369147:0:20136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987965184 00000100:00100000:1.0:1788891140.369157:0:20136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987965184 00000100:00100000:1.0:1788891140.369223:0:20136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:1.0:1788891140.369234:0:20136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+24:2394:x1875787987965184:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891140.369251:0:20136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891140.369289:0:20136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd549b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de456 expref: 24 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891140.369304:0:20136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:1.0:1788891140.369309:0:20136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891140.369370:0:20136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+23:2394:x1875787987965184:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 138us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891140.369379:0:20136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:0.0:1788891140.371468:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987965056 00000100:00100000:0.0:1788891140.371485:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987965056 00000100:00100000:0.0:1788891140.371998:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 122 00000100:00100000:0.0:1788891140.372011:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+23:15795:x1875787987965056:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788891140.372098:0:17109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd549c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891140.372117:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd549c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891140.372145:0:17109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd549c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891140.374494:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd549c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891140.376159:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd549c2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891140.376175:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd549c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891140.376181:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891140.376185:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd549c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891140.376194:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd549c2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891140.376211:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:0.0:1788891140.376214:0:17109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788891140.376218:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd549c2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891140.376224:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4c00/0xa66601b03fd549c2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17109 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788891140.376594:0:17147:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788891140.376599:0:17147:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788891140.376968:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+24:15795:x1875787987965056:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 4953us (8480us total) trans 8589934672 rc 0/0 00000100:00100000:0.0:1788891140.376981:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 122 00000040:00080000:3.0:1788891140.377414:0:17147:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 4 00000040:00080000:3.0:1788891140.377426:0:17147:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788891140.381391:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891140.381695:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987965440 00000100:00100000:3.0:1788891140.381705:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987965440 00000100:00100000:3.0:1788891140.381798:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:3.0:1788891140.381809:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+24:15795:x1875787987965440:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788891140.382052:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+25:15795:x1875787987965440:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 244us (670us total) trans 8589934673 rc 0/0 00000100:00100000:3.0:1788891140.382061:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 27 00010000:00010000:1.0:1788891140.668453:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788891141.477464:0:20390:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788891141.477475:0:20390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788891141.477506:0:20390:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:1.0:1788891141.477513:0:20390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788891141.608609:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891141.608674:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987965696 00000100:00100000:0.0:1788891141.608685:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987965696 00000100:00100000:0.0:1788891141.608744:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 123 00000100:00100000:0.0:1788891141.608755:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+25:15815:x1875787987965696:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788891141.608994:0:18639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891141.609018:0:18639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7600/0xa66601b03fd549c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de45d expref: -99 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891141.609126:0:18639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd549d0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891141.609147:0:18639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd549d0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891141.609161:0:18639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd549d0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891141.609173:0:18639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788891141.609367:0:18639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7600/0xa66601b03fd549c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de45d expref: 28 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891141.609400:0:18639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd549d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de45d expref: 27 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891141.609409:0:18639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:1.0:1788891141.609411:0:18639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788891141.609415:0:18639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6a00, rc 0) 00000100:00100000:1.0:1788891141.609481:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+27:15815:x1875787987965696:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 727us (880us total) trans 8589934674 rc 0/0 00000100:00100000:1.0:1788891141.609487:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 123 00000100:00100000:1.0:1788891141.611901:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891141.611984:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987965824 00000100:00100000:3.0:1788891141.611993:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987965824 00000100:00100000:3.0:1788891141.612050:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 124 00000100:00100000:3.0:1788891141.612060:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+27:15815:x1875787987965824:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:3.0:1788891141.612122:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd549de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891141.612137:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd549de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891141.612164:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd549de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891141.612196:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd549de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891141.612203:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd549de lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891141.612211:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd549de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891141.612217:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891141.612222:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd549de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891141.612230:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd549de lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891141.612242:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:3.0:1788891141.612244:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891141.612248:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd549de lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891141.612254:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd549de lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891141.612318:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+27:15815:x1875787987965824:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 259us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891141.612326:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 124 00000100:00100000:0.0:1788891141.681026:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891141.681099:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987965952 00000100:00100000:2.0:1788891141.681110:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987965952 00000100:00080000:0.0:1788891141.681175:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788891141.681204:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:2.0:1788891141.681217:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2392:x1875787987965952:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:2.0:1788891141.681239:0:18613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891141.681262:0:18613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070dbd957/0xa66601b03fd549e5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de464 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891141.681288:0:18613:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 13, mtime: 0x6aa05002, atime: 0x6aa05002, ctime: 0x6aa05002, blocks: 0x8 00010000:00010000:2.0:1788891141.681308:0:18613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=363s v=(0 0) 00010000:00010000:2.0:1788891141.681313:0:18613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891141.681323:0:18613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070dbd957/0xa66601b03fd549e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de464 expref: 7 pid: 18613 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891141.681735:0:18613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000070dbd957/0xa66601b03fd549e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de464 expref: 7 pid: 18613 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891141.681751:0:18613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f82311c00, rc 0) 00000100:00100000:3.0:1788891141.682045:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:2392:x1875787987965952:12345-192.168.204.26@tcp:101:cat.0 Request processed in 829us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891141.682054:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:0.0:1788891141.693316:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891141.693401:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987966080 00000100:00100000:3.0:1788891141.693412:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987966080 00002000:00100000:3.0:1788891141.693465:0:18621:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x22:0x0] (0->4095) req@ffff924f8416fb80 x1875787987966080/t0(0) o3->6f09a10f-9224-43a2-a8d4-25920b0f419e@192.168.204.26@tcp:192/0 lens 488/0 e 0 to 0 dl 1788891152 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788891141.693476:0:18621:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f8416fb80 with x1875787987966080 ext(0->4095) 00002000:00010000:3.0:1788891141.693481:0:18621:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924f8416fb80 00000100:00100000:3.0:1788891141.693513:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:3.0:1788891141.693554:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:2394:x1875787987966080:12345-192.168.204.26@tcp:3:cat.0 00010000:00010000:2.0:1788891141.693714:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891141.693801:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+7:2394:x1875787987966080:12345-192.168.204.26@tcp:3:cat.0 Request processed in 279us (494us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788891141.693810:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 3 00002000:00100000:3.0:1788891141.693821:0:18621:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x22:0x0] (0->4095) req@ffff924f8416fb80 x1875787987966080/t0(0) o3->6f09a10f-9224-43a2-a8d4-25920b0f419e@192.168.204.26@tcp:192/0 lens 488/4536 e 0 to 0 dl 1788891152 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788891141.693829:0:18621:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff924f8416fb80 with x1875787987966080 ext(0->4095) 00002000:00010000:3.0:1788891141.693832:0:18621:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924f8416fb80 00000100:00100000:2.0:1788891142.267731:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:0.0:1788891142.267735:0:17136:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364512210258ns, next at 365512207665ns, rc = 0 00000100:00100000:2.0:1788891142.267754:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997433856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788891142.267760:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788891142.267771:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997433728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788891142.267843:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891142.267878:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997433856 00000100:00100000:0.0:1788891142.267886:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997433856 00000100:00080000:2.0:1788891142.267925:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788891142.267951:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788891142.267961:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997433856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788891142.267988:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788891142.268045:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997433856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891142.268052:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788891142.268077:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891142.268102:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997433728 00000100:00100000:0.0:1788891142.268106:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997433728 00000100:00100000:2.0:1788891142.268139:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997433856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788891142.268147:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788891142.268154:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1875787997433728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788891142.268168:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1788891142.268174:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788891142.268204:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1875787997433728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891142.268222:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788891142.268225:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997433728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788891142.268734:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788891142.269386:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997434112:0@lo:400:kworker.0 00000100:00100000:2.0:1788891142.269434:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891142.269469:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788891142.269475:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997434240:0@lo:400:kworker.0 00000100:00100000:2.0:1788891142.269501:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891142.269547:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997434112 00000100:00100000:2.0:1788891142.269554:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997434112 00000100:00100000:2.0:1788891142.269610:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788891142.269618:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+24:3627:x1875787997434112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891142.269657:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:189d2e4e-bf9f-4645-ba04-f80564b97077+24:3627:x1875787997434112:12345-0@lo:400:kworker.0 Request processed in 40us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891142.269664:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788891142.269695:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997434240 00000100:00100000:2.0:1788891142.269699:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997434240 00000100:00100000:2.0:1788891142.269725:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788891142.269731:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997434240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891142.269765:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997434240:12345-0@lo:400:kworker.0 Request processed in 35us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891142.269771:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788891142.269830:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997434240:0@lo:400:kworker.0 00000100:00100000:2.0:1788891142.269852:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997434112:0@lo:400:kworker.0 00000100:00100000:1.0:1788891142.272194:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997434368:0@lo:400:kworker.0 00000100:00100000:1.0:1788891142.272267:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891142.272363:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997433984:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788891142.272400:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891142.272466:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997433984 00000100:00100000:1.0:1788891142.272474:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997433984 00000100:00100000:1.0:1788891142.272547:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788891142.272560:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997433984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788891142.272608:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788891142.272664:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997433984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891142.272674:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788891142.272740:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997433984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788891142.273741:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997434368 00000100:00100000:0.0:1788891142.273749:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997434368 00000100:00100000:0.0:1788891142.273812:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788891142.273823:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3629:x1875787997434368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891142.273890:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3629:x1875787997434368:12345-0@lo:400:kworker.0 Request processed in 69us (1623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891142.273900:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788891142.273960:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997434368:0@lo:400:kworker.0 00000100:00080000:1.0:1788891142.276022:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891142.276702:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997434496:0@lo:400:kworker.0 00000100:00100000:0.0:1788891142.276831:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891142.276911:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997434496 00000100:00100000:1.0:1788891142.276917:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997434496 00000100:00100000:1.0:1788891142.277022:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788891142.277032:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997434496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891142.277182:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997434624:0@lo:400:kworker.0 00000100:00100000:2.0:1788891142.277207:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891142.277225:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788891142.277229:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997434752:0@lo:400:kworker.0 00000100:00100000:2.0:1788891142.277242:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891142.277258:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997434880:0@lo:400:kworker.0 00000100:00100000:2.0:1788891142.277270:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891142.277290:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997434752 00000100:00100000:2.0:1788891142.277294:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997434752 00000100:00100000:2.0:1788891142.277314:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997434880 00000100:00100000:2.0:1788891142.277316:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997434880 00000100:00100000:2.0:1788891142.277338:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788891142.277344:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997434752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891142.277378:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997434752:12345-0@lo:400:kworker.0 Request processed in 33us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891142.277384:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788891142.277402:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788891142.277408:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997434880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891142.277440:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997434880:12345-0@lo:400:kworker.0 Request processed in 33us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891142.277446:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788891142.277483:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997434752:0@lo:400:kworker.0 00000100:00100000:2.0:1788891142.277512:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997434880:0@lo:400:kworker.0 00000100:00100000:1.0:1788891142.277750:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997434496:12345-0@lo:400:kworker.0 Request processed in 718us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891142.277757:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788891142.277785:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891142.277816:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997434624 00000100:00100000:1.0:1788891142.277820:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997434624 00000100:00100000:0.0:1788891142.277832:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997434496:0@lo:400:kworker.0 00000100:00100000:1.0:1788891142.277866:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788891142.277874:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997434624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891142.277922:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997434624:12345-0@lo:400:kworker.0 Request processed in 45us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891142.277929:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788891142.278046:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788891142.278055:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997435008:0@lo:400:kworker.0 00000100:00100000:1.0:1788891142.278083:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788891142.278142:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891142.278182:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1875787997435264:0@lo:400:kworker.0 00000100:00100000:3.0:1788891142.278206:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997435008 00000100:00100000:3.0:1788891142.278212:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997435008 00000100:00100000:0.0:1788891142.278216:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891142.278251:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997435264 00000100:00100000:0.0:1788891142.278252:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788891142.278256:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997435264 00000100:00100000:2.0:1788891142.278260:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788891142.278262:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1875787997435136:0@lo:400:kworker.0 00000100:00100000:2.0:1788891142.278270:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997435008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891142.278279:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788891142.278287:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875787997435264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891142.278294:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891142.278318:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997435008:12345-0@lo:400:kworker.0 Request processed in 50us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891142.278320:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875787997435264:12345-0@lo:400:kworker.0 Request processed in 35us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891142.278324:0:17109:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788891142.278327:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788891142.278334:0:17109:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788891142.278339:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788891142.278343:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997435136 00000100:00100000:2.0:1788891142.278346:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997435136 00000100:00100000:2.0:1788891142.278373:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788891142.278379:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875787997435136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891142.278384:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997434624:0@lo:400:kworker.0 00000100:00100000:2.0:1788891142.278409:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1875787997435136:12345-0@lo:400:kworker.0 Request processed in 31us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891142.278416:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788891142.278451:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788891142.278455:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788891142.278488:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f839cfb80 x1875787997435008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891142.278496:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3628:1875787997435136:0@lo:400:kworker.0 00010000:00080000:0.0:1788891142.278508:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f839ce680 x1875787997435264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891142.278549:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1875787997435264:0@lo:400:kworker.0 00000100:00100000:1.0:1788891142.278704:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997435008:0@lo:400:kworker.0 00010000:00010000:0.0:1788891142.715742:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891143.291857:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997435520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788891143.291909:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997435392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788891143.291931:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891143.291956:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891143.292011:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997435392 00000100:00100000:2.0:1788891143.292018:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997435392 00000100:00100000:3.0:1788891143.292044:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997435520 00000100:00100000:3.0:1788891143.292051:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997435520 00000100:00100000:2.0:1788891143.292076:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788891143.292090:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788891143.292092:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997435392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788891143.292126:0:17114:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788891143.292176:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997435392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891143.292184:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788891143.292229:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788891143.292234:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997435392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788891143.292242:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997435648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788891143.292277:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891143.292349:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3630:x1875787997435520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788891143.292368:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788891143.292417:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3630:x1875787997435520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891143.292472:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997435520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788891143.292602:0:18618:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788891143.292694:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788891143.292713:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997435648 00000100:00100000:3.0:1788891143.292716:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997435648 00000100:00100000:3.0:1788891143.292733:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788891143.292739:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997435648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788891143.292750:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788891143.292788:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997435648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891143.292795:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788891143.292871:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997435648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788891143.292912:0:18618:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00010000:00010000:1.0:1788891143.741818:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788891143.808069:0:19431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000001:00080000:3.0:1788891143.808086:0:19431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000040:00080000:3.0:1788891144.255183:0:17861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788891144.510484:0:17147:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788891144.510493:0:17147:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788891144.510512:0:17147:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:0.0:1788891144.510520:0:17147:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788891144.763708:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788891144.834408:0:18610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:3.0:1788891144.834424:0:18610:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000004:00080000:2.0:1788891144.837616:0:17089:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788891144.837684:0:17089:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934674 is committed 00000020:00080000:2.0:1788891144.837709:0:17089:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9250908f9000 refcount 2 committed 0 result 0 batchid 4294967531 00000020:00080000:2.0:1788891144.837714:0:17089:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff925090867500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9250908f9480 00000020:00080000:2.0:1788891144.837718:0:17089:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9250c1c21b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9250b4ed1e00 00000020:00080000:2.0:1788891144.837742:0:17089:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00010000:00010000:3.0:1788891144.837887:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd54960 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891144.837894:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997435776:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788891144.837901:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd54960 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891144.837916:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd54960 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891144.837923:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4e00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891144.837928:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd54960 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891144.837936:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd54960 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891144.837952:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff925085363900) 00010000:00010000:3.0:1788891144.837956:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891144.837961:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd54960 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891144.837969:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4e00/0xa66601b03fd54960 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891144.837972:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891144.838066:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997435776 00000100:00100000:1.0:1788891144.838073:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997435776 00000100:00080000:3.0:1788891144.838140:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788891144.838148:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788891144.838158:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997435776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788891144.838187:0:18613:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:34 count 1 00000020:00080000:0.0:1788891144.838310:0:17148:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967531 committed batchid 4294967530 00000020:00080000:0.0:1788891144.838372:0:17148:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00010000:00010000:1.0:1788891144.838413:0:18613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf4dfed8/0xa66601b03fd549ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891144.838437:0:18613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e46b80dd/0xa66601b03fd5476f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3bc expref: 5 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891144.838446:0:18613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=7s v=(0 0) 00010000:00010000:1.0:1788891144.838451:0:18613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788891144.838455:0:18613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf4dfed8/0xa66601b03fd549ec lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891144.839362:0:18613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e46b80dd/0xa66601b03fd5476f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3bc expref: 5 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891144.839383:0:18613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e46b80dd/0xa66601b03fd5476f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3bc expref: 5 pid: 18616 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891144.839397:0:18613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18613:1875787997435904:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891144.839481:0:18613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250959c20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891144.843096:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891144.843311:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987966208 00000100:00100000:1.0:1788891144.843321:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987966208 00010000:00010000:1.0:1788891144.843387:0:17094:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e46b80dd/0xa66601b03fd5476f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3bc expref: 6 pid: 18616 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891144.843433:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00100000:1.0:1788891144.843455:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2391:x1875787987966208:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891144.843471:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891144.843478:0:17094:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e46b80dd/0xa66601b03fd5476f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3bc expref: 6 pid: 18616 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891144.843493:0:17094:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e46b80dd/0xa66601b03fd5476f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3bc expref: 6 pid: 18616 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891144.843517:0:17094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788891144.843560:0:17094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788891144.843565:0:17094:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf4dfed8/0xa66601b03fd549ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891144.843575:0:17094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf4dfed8/0xa66601b03fd549ec lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891144.843596:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891144.843648:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2391:x1875787987966208:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 195us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891144.843656:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00080000:2.0:1788891144.843900:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788891144.844827:0:18613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e46b80dd/0xa66601b03fd5476f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3bc expref: 5 pid: 18616 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891144.844845:0:18613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18613:1875787997435904:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891144.844867:0:18613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bf4dfed8/0xa66601b03fd549ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891144.845090:0:18613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bf4dfed8/0xa66601b03fd549ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891144.845100:0:18613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf4dfed8/0xa66601b03fd549ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891144.845110:0:18613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf4dfed8/0xa66601b03fd549ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891144.845117:0:18613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf4dfed8/0xa66601b03fd549ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891144.845144:0:18613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891144.845384:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891144.845393:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf4dfed8/0xa66601b03fd549ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891144.845403:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891144.845408:0:19132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf4dfed8/0xa66601b03fd549ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891144.845412:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3628:x1875787997435776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7253us (7440us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788891144.845424:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1788891144.845435:0:19132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf4dfed8/0xa66601b03fd549ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891144.845455:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf4dfed8/0xa66601b03fd549ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891144.845462:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf4dfed8/0xa66601b03fd549ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891144.845481:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891144.845483:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891144.845485:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891144.845639:0:3628:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934599 gen 2 00000004:00080000:3.0:1788891144.845645:0:3628:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934599 committed transno 8589934599 00000100:00100000:3.0:1788891144.845669:0:3628:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff924f833d0000 x1875787997435776/t8589934601(8589934601) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788891160 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788891144.845678:0:3628:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff924f833d0000/2, rc 0, transno 8589934601 00000100:00100000:3.0:1788891144.845681:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997435776:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788891144.894671:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891144.894863:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987966336 00000100:00100000:3.0:1788891144.894875:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987966336 00000100:00080000:2.0:1788891144.895010:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891144.895283:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 125 00000100:00100000:3.0:1788891144.895295:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+13:15536:x1875787987966336:12345-192.168.204.26@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788891144.895397:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+13:15536:x1875787987966336:12345-192.168.204.26@tcp:60:lhsmtool_posix.0 Request processed in 105us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891144.895404:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 125 00000100:00100000:2.0:1788891144.899597:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891144.900038:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987966464 00000100:00100000:1.0:1788891144.900047:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987966464 00000100:00100000:1.0:1788891144.900120:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 126 00000100:00100000:1.0:1788891144.900131:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+5:15536:x1875787987966464:12345-192.168.204.26@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788891144.900234:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f09a10f-9224-43a2-a8d4-25920b0f419e+5:15536:x1875787987966464:12345-192.168.204.26@tcp:60:lhsmtool_posix.0 Request processed in 105us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891144.900242:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 126 00000100:00080000:2.0:1788891144.900306:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788891144.903990:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891144.905569:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987966720 00000100:00100000:0.0:1788891144.905581:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987966720 00000100:00100000:0.0:1788891144.905647:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:0.0:1788891144.905657:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f81fdf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+13:15536:x1875787987966720:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788891144.906003:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f81fdf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+14:15536:x1875787987966720:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 346us (2023us total) trans 8589934675 rc 0/0 00000100:00100000:0.0:1788891144.906025:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:3.0:1788891145.168771:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891145.168818:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891145.168854:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891145.168905:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891145.168931:0:20411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987967104 00000100:00100000:3.0:1788891145.168937:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891145.168943:0:20411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987967104 00000100:00100000:3.0:1788891145.168971:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891145.169012:0:20411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987967232 00000100:00100000:0.0:1788891145.169016:0:20411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987967232 00000100:00100000:3.0:1788891145.169022:0:20352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987967360 00000100:00100000:3.0:1788891145.169029:0:20352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987967360 00000100:00100000:0.0:1788891145.169047:0:20411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:0.0:1788891145.169060:0:20411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:2391:x1875787987967104:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891145.169067:0:20352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987966976 00000100:00100000:3.0:1788891145.169072:0:20352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987966976 00000100:00100000:3.0:1788891145.169092:0:20352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987967488 00000100:00100000:3.0:1788891145.169096:0:20352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987967488 00000100:00100000:3.0:1788891145.169115:0:20352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:3.0:1788891145.169123:0:20352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2391:x1875787987967360:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891145.169140:0:20411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:2391:x1875787987967104:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 83us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891145.169149:0:20411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:0.0:1788891145.169165:0:20411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:0.0:1788891145.169172:0:20411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2391:x1875787987967232:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891145.169198:0:20411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2391:x1875787987967232:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 26us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891145.169205:0:20411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:2.0:1788891145.169224:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987966848 00000100:00080000:0.0:1788891145.169225:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788891145.169230:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788891145.169232:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788891145.169234:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788891145.169244:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987966848 00000100:00100000:2.0:1788891145.169281:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 164 00000100:00100000:2.0:1788891145.169290:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925083cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+13:2391:x1875787987966848:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788891145.169321:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925083cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+13:2391:x1875787987966848:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 33us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891145.169329:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 164 00000100:00100000:1.0:1788891145.169439:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:1.0:1788891145.169449:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2391:x1875787987966976:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788891145.169487:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2391:x1875787987966976:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 41us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891145.169493:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:1.0:1788891145.169554:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:1.0:1788891145.169562:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2391:x1875787987967488:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788891145.169588:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2391:x1875787987967488:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 28us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891145.169594:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:3.0:1788891145.171818:0:20352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2391:x1875787987967360:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 2551us (2818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891145.171852:0:20352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 19 00010000:00010000:1.0:1788891145.787777:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891146.812064:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788891147.185691:0:20589:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 14:12:25 (1788891145) 00000100:00100000:2.0:1788891147.388257:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997436032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788891147.388327:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891147.388429:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997436160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788891147.388443:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997436032 00000100:00100000:3.0:1788891147.388452:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997436032 00000100:00100000:2.0:1788891147.388461:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891147.388507:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997436160 00000100:00100000:3.0:1788891147.388537:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788891147.388549:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3629:x1875787997436032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788891147.388580:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788891147.388627:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3629:x1875787997436032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891147.388634:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788891147.388637:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997436160 00000100:00100000:2.0:1788891147.388675:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788891147.388687:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997436160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788891147.388699:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788891147.388732:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997436160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891147.388738:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788891147.388776:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997436160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788891147.388779:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997436032:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788891147.388804:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788891147.389423:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997436672:0@lo:400:kworker.0 00000100:00100000:0.0:1788891147.389457:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891147.389489:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1875787997437184:0@lo:400:kworker.0 00000100:00100000:0.0:1788891147.389508:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891147.389538:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788891147.389544:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997436544:0@lo:400:kworker.0 00000100:00100000:0.0:1788891147.389579:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891147.389594:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997437056:0@lo:400:kworker.0 00000100:00100000:0.0:1788891147.389611:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891147.389623:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997437568:0@lo:400:kworker.0 00000100:00100000:0.0:1788891147.389640:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891147.389674:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997436672 00000100:00100000:0.0:1788891147.389678:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997436672 00000100:00100000:0.0:1788891147.389721:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997437184 00000100:00100000:0.0:1788891147.389723:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997437184 00000100:00100000:2.0:1788891147.389743:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997437056 00000100:00100000:0.0:1788891147.389744:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997437568 00000100:00100000:0.0:1788891147.389748:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997437568 00000100:00100000:2.0:1788891147.389750:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997437056 00000100:00100000:0.0:1788891147.389764:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788891147.389773:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997436672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891147.389781:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788891147.389791:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875787997437184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891147.389815:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997436672:12345-0@lo:400:kworker.0 Request processed in 44us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891147.389823:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788891147.389839:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875787997437184:12345-0@lo:400:kworker.0 Request processed in 48us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891147.389843:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788891147.389852:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875787997437568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891147.389865:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788891147.389885:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788891147.389891:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875787997437568:12345-0@lo:400:kworker.0 Request processed in 40us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891147.389896:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997437056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891147.389902:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788891147.389934:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997436544 00000100:00100000:2.0:1788891147.389936:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997437056:12345-0@lo:400:kworker.0 Request processed in 43us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891147.389938:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997436544 00000100:00100000:2.0:1788891147.389947:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788891147.389977:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788891147.389985:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997436544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891147.390016:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997436544:12345-0@lo:400:kworker.0 Request processed in 33us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891147.390031:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788891147.390081:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997437696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788891147.390235:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997436288:0@lo:400:kworker.0 00000100:00100000:3.0:1788891147.390267:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891147.390411:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997436800:0@lo:400:kworker.0 00000100:00100000:3.0:1788891147.390434:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891147.390456:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997437312:0@lo:400:kworker.0 00000100:00100000:2.0:1788891147.390485:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997436800 00000100:00100000:3.0:1788891147.390490:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891147.390492:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997436800 00000100:00100000:3.0:1788891147.390513:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788891147.390519:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997436416:0@lo:400:kworker.0 00000100:00100000:3.0:1788891147.390556:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788891147.391616:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788891147.391623:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788891147.391627:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891147.394023:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997436928:0@lo:400:kworker.0 00000100:00100000:3.0:1788891147.394086:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891147.394111:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997437440:0@lo:400:kworker.0 00000100:00100000:2.0:1788891147.394132:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997436416 00000100:00100000:3.0:1788891147.394140:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891147.394143:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997436416 00000100:00100000:2.0:1788891147.394192:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788891147.394200:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997436288 00000100:00100000:2.0:1788891147.394204:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997436800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891147.394206:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997436288 00000100:00100000:3.0:1788891147.394245:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788891147.394254:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+24:3627:x1875787997436288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891147.394279:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997436800:12345-0@lo:400:kworker.0 Request processed in 76us (3841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891147.394287:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788891147.394306:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:189d2e4e-bf9f-4645-ba04-f80564b97077+24:3627:x1875787997436288:12345-0@lo:400:kworker.0 Request processed in 53us (4037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891147.394308:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788891147.394318:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788891147.394322:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997436416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891147.394361:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997436416:12345-0@lo:400:kworker.0 Request processed in 43us (3803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891147.394369:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788891147.394374:0:20411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997437312 00000100:00100000:3.0:1788891147.394380:0:20411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997437312 00000100:00100000:3.0:1788891147.394420:0:20411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997437440 00000100:00100000:3.0:1788891147.394423:0:20411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997437440 00000100:00100000:3.0:1788891147.394447:0:20411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788891147.394453:0:20411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997437312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891147.394498:0:20411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997437312:12345-0@lo:400:kworker.0 Request processed in 45us (4010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891147.394504:0:20411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788891147.394516:0:20411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788891147.394540:0:20411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997437440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891147.394568:0:20411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997437440:12345-0@lo:400:kworker.0 Request processed in 48us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891147.394574:0:20411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788891147.394589:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788891147.394593:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788891147.394607:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891147.394644:0:3630:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934599 gen 2 00000004:00080000:3.0:1788891147.394650:0:3630:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934599 committed transno 8589934599 00000100:00100000:3.0:1788891147.394676:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997436544:0@lo:400:kworker.0 00000100:00100000:3.0:1788891147.394750:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997437056:0@lo:400:kworker.0 00000100:00100000:0.0:1788891147.394773:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997437696 00000100:00100000:0.0:1788891147.394802:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997437696 00010000:00080000:3.0:1788891147.394847:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83a67800 x1875787997437568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891147.394884:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997437568:0@lo:400:kworker.0 00000100:00100000:3.0:1788891147.394941:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997436672:0@lo:400:kworker.0 00000100:00100000:0.0:1788891147.394953:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788891147.394977:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1875787997437184:0@lo:400:kworker.0 00000100:00100000:0.0:1788891147.394998:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf7fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997437696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788891147.395023:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788891147.395063:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf7fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997437696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891147.395070:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788891147.395148:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997437696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788891147.395180:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997436416:0@lo:400:kworker.0 00000100:00100000:3.0:1788891147.395191:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997437440:0@lo:400:kworker.0 00000100:00100000:3.0:1788891147.395200:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997436288:0@lo:400:kworker.0 00000100:00100000:3.0:1788891147.395208:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997436800:0@lo:400:kworker.0 00010000:00080000:3.0:1788891147.395218:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83a67480 x1875787997437312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891147.395227:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997437312:0@lo:400:kworker.0 00000100:00100000:3.0:1788891147.395385:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997436928 00000100:00100000:3.0:1788891147.395389:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997436928 00000100:00100000:3.0:1788891147.395438:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788891147.395445:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997436928:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788891147.395745:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788891147.395801:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997436928:12345-0@lo:400:kworker.0 Request processed in 357us (1715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891147.395814:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788891147.396108:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997436928:0@lo:400:kworker.0 00010000:00010000:2.0:1788891147.837840:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891148.413979:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997437952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788891148.414003:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788891148.414020:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8416ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997438080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788891148.414055:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891148.414101:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788891148.414102:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997437952 00000100:00100000:1.0:1788891148.414109:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997437824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788891148.414111:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997437952 00000100:00100000:1.0:1788891148.414146:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891148.414172:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788891148.414184:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997437952:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788891148.414204:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788891148.414227:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788891148.414427:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997437824 00000100:00100000:0.0:1788891148.414433:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997437824 00000100:00100000:0.0:1788891148.414477:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788891148.414486:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997437824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788891148.414510:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788891148.414587:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997437824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891148.414595:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788891148.414931:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997437824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788891148.415503:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997437952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1320us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891148.415511:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788891148.415552:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997438080 00000100:00100000:1.0:1788891148.415557:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997438080 00000100:00100000:1.0:1788891148.415600:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788891148.415609:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997438080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788891148.415625:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788891148.415667:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997438080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891148.415685:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788891148.415727:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8416ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997438080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788891148.418054:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997437952:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788891148.860236:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891149.448479:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891149.448561:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987967744 00000100:00100000:3.0:1788891149.448571:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987967744 00000100:00100000:3.0:1788891149.448653:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:3.0:1788891149.448664:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+14:16497:x1875787987967744:12345-192.168.204.26@tcp:35:umount.0 00000100:00100000:3.0:1788891149.448934:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+15:16497:x1875787987967744:12345-192.168.204.26@tcp:35:umount.0 Request processed in 273us (470us total) trans 8589934676 rc 0/0 00000100:00100000:3.0:1788891149.448942:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00080000:0.0:1788891149.449051:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788891149.453648:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891149.453911:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987968000 00000100:00100000:3.0:1788891149.453922:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987968000 00000100:00100000:3.0:1788891149.454024:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:3.0:1788891149.454035:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+15:16497:x1875787987968000:12345-192.168.204.26@tcp:35:umount.0 00000100:00100000:3.0:1788891149.454321:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+16:16497:x1875787987968000:12345-192.168.204.26@tcp:35:umount.0 Request processed in 287us (683us total) trans 8589934677 rc 0/0 00000100:00100000:3.0:1788891149.454329:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:1.0:1788891149.457480:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891149.457583:0:20352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987968256 00000100:00100000:3.0:1788891149.457594:0:20352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987968256 00000100:00100000:3.0:1788891149.457746:0:20352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00100000:3.0:1788891149.457771:0:20352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6f09a10f-9224-43a2-a8d4-25920b0f419e+5:2390:x1875787987968256:12345-192.168.204.26@tcp:9:umount.0 00000020:00000080:3.0:1788891149.457813:0:20352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd54324 00000100:00080000:3.0:1788891149.457831:0:20352:0:(import.c:65:import_set_state_nolock()) ffff924f823b2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788891149.457883:0:20352:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:3.0:1788891149.458030:0:20352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6f09a10f-9224-43a2-a8d4-25920b0f419e+2:2390:x1875787987968256:12345-192.168.204.26@tcp:9:umount.0 Request processed in 260us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891149.458039:0:20352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 40 00010000:00010000:2.0:1788891149.458051:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891149.459713:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891149.459783:0:20136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987968128 00000100:00100000:1.0:1788891149.459791:0:20136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987968128 00000100:00100000:1.0:1788891149.459843:0:20136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:1.0:1788891149.459851:0:20136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e08b9a10-102a-4021-bba3-9abf67ad4662+13:2391:x1875787987968128:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891149.459865:0:20136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891149.459883:0:20136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250857df800/0xa66601b03fd542fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de1cb expref: 13 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891149.459897:0:20136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891149.459940:0:20136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e08b9a10-102a-4021-bba3-9abf67ad4662+12:2391:x1875787987968128:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 90us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891149.459947:0:20136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00080000:0.0:1788891149.461617:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788891149.466713:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891149.466873:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891149.466942:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987968384 00000100:00100000:0.0:1788891149.466953:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987968384 00000100:00100000:2.0:1788891149.468800:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891149.468850:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987968512 00000100:00100000:2.0:1788891149.468856:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987968768 00000100:00100000:0.0:1788891149.468856:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987968512 00000100:00100000:2.0:1788891149.468864:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987968768 00000100:00100000:0.0:1788891149.468889:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:0.0:1788891149.468901:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e08b9a10-102a-4021-bba3-9abf67ad4662+13:2393:x1875787987968384:12345-192.168.204.26@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788891149.468913:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 41 00010000:00010000:0.0:1788891149.468921:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788891149.468924:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+6:2390:x1875787987968768:12345-192.168.204.26@tcp:9:umount.0 00010000:00010000:0.0:1788891149.468953:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae4000/0xa66601b03fd54301 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de1fc expref: 13 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788891149.468958:0:18720:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd5431d 00000100:00100000:1.0:1788891149.468963:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000020:00010000:2.0:1788891149.468974:0:18720:0:(genops.c:1921:obd_stale_export_put()) Put export ffff925087577800: total 0 00000100:00100000:1.0:1788891149.468977:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925088665c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e08b9a10-102a-4021-bba3-9abf67ad4662+12:2392:x1875787987968512:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891149.468979:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1788891149.468987:0:18720:0:(import.c:65:import_set_state_nolock()) ffff925087573800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788891149.469032:0:18720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1788891149.469039:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e08b9a10-102a-4021-bba3-9abf67ad4662+12:2393:x1875787987968384:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 140us (2336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891149.469047:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 6 00010000:00010000:1.0:1788891149.469065:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:0.0:1788891149.469074:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:0.0:1788891149.469202:0:19132:0:(genops.c:1907:obd_stale_export_get()) Get export ffff925087577800: total 0 00000100:00100000:2.0:1788891149.469244:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6f09a10f-9224-43a2-a8d4-25920b0f419e+4:2390:x1875787987968768:12345-192.168.204.26@tcp:9:umount.0 Request processed in 321us (446us total) trans 0 rc 0/0 00010000:00010000:0.0:1788891149.469246:0:19132:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff925087577800, canceled 0 locks, left on hash table 1. 00000100:00100000:2.0:1788891149.469257:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 41 00010000:00010000:1.0:1788891149.469257:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924f82310c00/0xa66601b03fd543be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2b2 expref: 11 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891149.469292:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070dbd957/0xa66601b03fd549e5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de464 expref: 3 pid: 18613 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891149.469317:0:19132:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff925087577800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788891149.469334:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788891149.469334:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891149.469338:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891149.469340:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891149.469458:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925088665c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e08b9a10-102a-4021-bba3-9abf67ad4662+10:2392:x1875787987968512:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 396us (2496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891149.469468:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:0.0:1788891149.476394:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891149.476465:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987969536 00000100:00100000:2.0:1788891149.476475:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987969536 00000100:00100000:2.0:1788891149.476556:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 127 00000100:00100000:2.0:1788891149.476566:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+16:2390:x1875787987969536:12345-192.168.204.26@tcp:39:umount.0 00000020:00000080:2.0:1788891149.476596:0:17110:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd5430f 00000020:00010000:2.0:1788891149.476621:0:17110:0:(genops.c:1921:obd_stale_export_put()) Put export ffff924f81ecd000: total 0 00000100:00080000:2.0:1788891149.476626:0:17110:0:(import.c:65:import_set_state_nolock()) ffff924f81ecf000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788891149.476874:0:17110:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934677 00000100:00100000:2.0:1788891149.477036:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f09a10f-9224-43a2-a8d4-25920b0f419e+15:2390:x1875787987969536:12345-192.168.204.26@tcp:39:umount.0 Request processed in 470us (651us total) trans 8589934678 rc 0/0 00000100:00100000:2.0:1788891149.477052:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 127 00000020:00010000:1.0:1788891149.477481:0:17097:0:(genops.c:1907:obd_stale_export_get()) Get export ffff924f81ecd000: total 0 00010000:00010000:1.0:1788891149.477549:0:17097:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff924f81ecd000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788891149.477586:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:1.0:1788891149.477590:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788891149.477599:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250813ede00/0xa66601b03fd548d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de417 expref: 14 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891149.477620:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9250905a3500) 00010000:00010000:1.0:1788891149.477623:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788891149.477627:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd543da lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2b9 expref: 13 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891149.477647:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:1.0:1788891149.477650:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788891149.477654:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5e00/0xa66601b03fd544ba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2f8 expref: 12 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891149.477666:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff924f82e37100) 00010000:00010000:1.0:1788891149.477668:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788891149.477672:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a800/0xa66601b03fd5477d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de3c3 expref: 11 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891149.477684:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:1.0:1788891149.477687:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788891149.477691:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6a00/0xa66601b03fd549d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de45d expref: 10 pid: 18639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891149.477702:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff924f82e37d00) 00010000:00010000:1.0:1788891149.477704:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891149.477721:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82311a00/0xa66601b03fd543f6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2c0 expref: 9 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891149.477738:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e37a00) 00010000:00010000:1.0:1788891149.477740:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788891149.477744:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f82310000/0xa66601b03fd54435 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2ce expref: 8 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891149.477755:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff924f82e39900) 00010000:00010000:1.0:1788891149.477758:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788891149.477761:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7c00/0xa66601b03fd549a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de44f expref: 7 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891149.477773:0:17097:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff924f81ecd000, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1788891149.477787:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891149.477789:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891149.477791:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891149.491173:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891149.491502:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987969664 00000100:00100000:3.0:1788891149.491513:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987969664 00000100:00100000:3.0:1788891149.491617:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 128 00000100:00100000:3.0:1788891149.491629:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+5:2390:x1875787987969664:12345-192.168.204.26@tcp:39:umount.0 00000020:00000080:3.0:1788891149.491674:0:17109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd54316 00000100:00080000:3.0:1788891149.491691:0:17109:0:(import.c:65:import_set_state_nolock()) ffff924f823b7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788891149.491720:0:17109:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1788891149.491986:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6f09a10f-9224-43a2-a8d4-25920b0f419e+3:2390:x1875787987969664:12345-192.168.204.26@tcp:39:umount.0 Request processed in 359us (822us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788891149.491995:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 128 00010000:00010000:2.0:1788891149.492410:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788891149.492481:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788891149.883771:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891150.289952:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891150.290003:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891150.290029:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987969792 00000100:00100000:2.0:1788891150.290041:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987969792 00000100:00100000:3.0:1788891150.290092:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891150.290108:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 166 00000100:00100000:2.0:1788891150.290121:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+10:2393:x1875787987969792:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891150.290123:0:20411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987970048 00000100:00100000:3.0:1788891150.290129:0:20411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987970048 00000100:00100000:3.0:1788891150.290171:0:20411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987969920 00000100:00100000:3.0:1788891150.290175:0:20411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987969920 00000100:00100000:3.0:1788891150.290198:0:20411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:2.0:1788891150.290209:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e08b9a10-102a-4021-bba3-9abf67ad4662+10:2393:x1875787987969792:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 90us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891150.290210:0:20411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2393:x1875787987970048:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788891150.290225:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 166 00000100:00100000:3.0:1788891150.290253:0:20411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2393:x1875787987970048:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 48us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891150.290269:0:20411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:3.0:1788891150.290290:0:20411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:3.0:1788891150.290300:0:20411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:2393:x1875787987969920:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891150.290347:0:20411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:2393:x1875787987969920:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 50us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891150.290354:0:20411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00080000:0.0:1788891150.291040:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788891150.291046:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788891150.294157:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891150.294216:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891150.294280:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987970176 00000100:00100000:2.0:1788891150.294294:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987970176 00000100:00100000:0.0:1788891150.294357:0:20352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987970304 00000100:00100000:0.0:1788891150.294367:0:20352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987970304 00000100:00100000:2.0:1788891150.294407:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:2.0:1788891150.294431:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2390:x1875787987970176:12345-192.168.204.26@tcp:9:kworker.0 00000100:00100000:0.0:1788891150.294459:0:20352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 43 00000020:00000080:2.0:1788891150.294474:0:18613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd5435c 00000100:00100000:0.0:1788891150.294475:0:20352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2390:x1875787987970304:12345-192.168.204.26@tcp:9:kworker.0 00000100:00080000:2.0:1788891150.294489:0:18613:0:(import.c:65:import_set_state_nolock()) ffff92509df78000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788891150.294517:0:20352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd54363 00000100:00080000:0.0:1788891150.294568:0:20352:0:(import.c:65:import_set_state_nolock()) ffff92509df7c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788891150.294581:0:18613:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000001:00000004:0.0:1788891150.294691:0:20352:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:2.0:1788891150.294736:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+2:2390:x1875787987970176:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 307us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891150.294747:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 42 00010000:00010000:1.0:1788891150.295070:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788891150.295080:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788891150.295085:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788891150.295113:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891150.295370:0:20352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+2:2390:x1875787987970304:12345-192.168.204.26@tcp:9:kworker.0 Request processed in 897us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891150.295382:0:20352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 43 00000001:00100000:1.0:1788891150.300245:0:19431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6db8dbfb-e84b-4eac-afbf-d489bcb0a680 00000020:00000080:1.0:1788891150.300255:0:19431:0:(genops.c:885:class_export_put()) final put ffff92509df7a800/6db8dbfb-e84b-4eac-afbf-d489bcb0a680 00000001:00100000:1.0:1788891150.300282:0:19431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6f09a10f-9224-43a2-a8d4-25920b0f419e 00000020:00000080:1.0:1788891150.300284:0:19431:0:(genops.c:885:class_export_put()) final put ffff924f823b7000/6f09a10f-9224-43a2-a8d4-25920b0f419e 00000001:00080000:1.0:1788891150.300293:0:19431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000020:00000080:0.0:1788891150.300347:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92509df7a800/6db8dbfb-e84b-4eac-afbf-d489bcb0a680 for lustre-OST0001 00000020:00000080:0.0:1788891150.300424:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f823b7000/6f09a10f-9224-43a2-a8d4-25920b0f419e for lustre-OST0001 00000020:00000080:0.0:1788891150.300447:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92509df7c000 for lustre-OST0001 00000020:00000080:0.0:1788891150.300452:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f823b2800 for lustre-OST0001 00000100:00100000:3.0:1788891150.434015:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891150.434066:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891150.434192:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987970560 00000100:00100000:0.0:1788891150.434203:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987970560 00000100:00100000:0.0:1788891150.434493:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987970432 00000100:00100000:0.0:1788891150.434499:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987970432 00000100:00100000:1.0:1788891150.436300:0:20136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:1.0:1788891150.436320:0:20136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e08b9a10-102a-4021-bba3-9abf67ad4662+11:2392:x1875787987970560:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891150.436341:0:20136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891150.436381:0:20136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250857dea00/0xa66601b03fd54340 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de26c expref: 11 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891150.436400:0:20136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891150.436479:0:20136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e08b9a10-102a-4021-bba3-9abf67ad4662+10:2392:x1875787987970560:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 168us (2476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891150.436487:0:20136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:1.0:1788891150.436514:0:20136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:1.0:1788891150.436546:0:20136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e08b9a10-102a-4021-bba3-9abf67ad4662+9:2392:x1875787987970432:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891150.436556:0:20136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891150.436567:0:20136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae5600/0xa66601b03fd54339 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de23b expref: 9 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891150.436576:0:20136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891150.436594:0:20136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e08b9a10-102a-4021-bba3-9abf67ad4662+8:2392:x1875787987970432:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 73us (2527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891150.436600:0:20136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:2.0:1788891150.438621:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891150.438862:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987970688 00000100:00100000:1.0:1788891150.438873:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987970688 00000100:00100000:1.0:1788891150.438934:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:1.0:1788891150.438945:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e08b9a10-102a-4021-bba3-9abf67ad4662+8:2394:x1875787987970688:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891150.438961:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891150.438985:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae4400/0xa66601b03fd543b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2ab expref: 8 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891150.439003:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891150.439054:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e08b9a10-102a-4021-bba3-9abf67ad4662+7:2394:x1875787987970688:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 111us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891150.439076:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:3.0:1788891150.442906:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891150.443031:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987970944 00000100:00100000:0.0:1788891150.443041:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987970944 00000100:00100000:0.0:1788891150.443102:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 129 00000100:00100000:0.0:1788891150.443113:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+6:2390:x1875787987970944:12345-192.168.204.26@tcp:39:umount.0 00000020:00000080:0.0:1788891150.443156:0:17109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd5434e 00000020:00010000:0.0:1788891150.443166:0:17109:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9250b72d4800: total 0 00000100:00080000:0.0:1788891150.443172:0:17109:0:(import.c:65:import_set_state_nolock()) ffff9250b72d6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788891150.443205:0:17109:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934678 00000020:00010000:1.0:1788891150.443448:0:19132:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9250b72d4800: total 0 00010000:00010000:1.0:1788891150.443453:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891150.443506:0:19132:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9250b72d4800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788891150.443566:0:19132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e37a00) 00010000:00010000:1.0:1788891150.443570:0:19132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788891150.443579:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4200/0xa66601b03fd54443 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de2d5 expref: 6 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891150.443613:0:19132:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9250b72d4800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788891150.443624:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891150.443626:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891150.443628:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788891150.448115:0:17089:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934679 is committed 00000001:00100000:3.0:1788891150.448127:0:17089:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6f09a10f-9224-43a2-a8d4-25920b0f419e 00000001:00080000:3.0:1788891150.448131:0:17089:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934678 is committed 00000020:00000080:3.0:1788891150.448138:0:17089:0:(genops.c:885:class_export_put()) final put ffff924f81ecd000/6f09a10f-9224-43a2-a8d4-25920b0f419e 00000020:00080000:3.0:1788891150.448162:0:17089:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967531 batchid updated 00000020:00080000:3.0:1788891150.448180:0:17148:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967531 00000020:00080000:3.0:1788891150.448190:0:17148:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967531 00000020:00000080:1.0:1788891150.448258:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81ecd000/6f09a10f-9224-43a2-a8d4-25920b0f419e for lustre-MDT0000 00000020:00000080:1.0:1788891150.448316:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f81ecf000 for lustre-MDT0000 00000100:00100000:0.0:1788891150.448678:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+2:2390:x1875787987970944:12345-192.168.204.26@tcp:39:umount.0 Request processed in 5561us (5779us total) trans 8589934679 rc 0/0 00000100:00100000:0.0:1788891150.448691:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 129 00000100:00100000:2.0:1788891150.454894:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891150.454976:0:20411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987971072 00000100:00100000:3.0:1788891150.454986:0:20411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987971072 00000100:00100000:3.0:1788891150.455088:0:20411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 130 00000100:00100000:3.0:1788891150.455100:0:20411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+5:2390:x1875787987971072:12345-192.168.204.26@tcp:39:umount.0 00000020:00000080:3.0:1788891150.455140:0:20411:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd54355 00000100:00080000:3.0:1788891150.455150:0:20411:0:(import.c:65:import_set_state_nolock()) ffff9250b72d5800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788891150.455181:0:20411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1788891150.455353:0:20411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6db8dbfb-e84b-4eac-afbf-d489bcb0a680+3:2390:x1875787987971072:12345-192.168.204.26@tcp:39:umount.0 Request processed in 254us (468us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788891150.455361:0:20411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 130 00010000:00010000:2.0:1788891150.455422:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891150.479036:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891150.479120:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987971328 00000100:00100000:3.0:1788891150.479130:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987971328 00000100:00100000:3.0:1788891150.479189:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 167 00000100:00100000:3.0:1788891150.479199:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+7:2390:x1875787987971328:12345-192.168.204.26@tcp:251:umount.0 00000020:00000080:3.0:1788891150.479244:0:17104:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd542ec 00000020:00010000:3.0:1788891150.479251:0:17104:0:(genops.c:1921:obd_stale_export_put()) Put export ffff924f81ecf800: total 0 00000100:00080000:3.0:1788891150.479256:0:17104:0:(import.c:65:import_set_state_nolock()) ffff924f823b4800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788891150.479340:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e08b9a10-102a-4021-bba3-9abf67ad4662+3:2390:x1875787987971328:12345-192.168.204.26@tcp:251:umount.0 Request processed in 142us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891150.479348:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 167 00000020:00010000:1.0:1788891150.479483:0:17098:0:(genops.c:1907:obd_stale_export_get()) Get export ffff924f81ecf800: total 0 00010000:00010000:1.0:1788891150.479570:0:17098:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff924f81ecf800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788891150.479604:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924f82310a00/0xa66601b03fd542f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de1c4 expref: 2 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891150.479617:0:17098:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff924f81ecf800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788891150.479625:0:17098:0:(genops.c:885:class_export_put()) final put ffff924f81ecf800/e08b9a10-102a-4021-bba3-9abf67ad4662 00010000:00010000:1.0:1788891150.479632:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891150.479634:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891150.479636:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788891150.479737:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81ecf800/e08b9a10-102a-4021-bba3-9abf67ad4662 for MGS 00000020:00000080:3.0:1788891150.483759:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f823b4800 for MGS 00010000:00010000:1.0:1788891150.907954:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788891151.809455:0:20783:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788891151.828736:0:20783:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788891151.828791:0:20783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd53eaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53eb6 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891151.828807:0:20783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd53eaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53eb6 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891151.828816:0:20783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd53eaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd53eb6 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891151.828823:0:20783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd53eaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd53eb6 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891151.828848:0:20783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788891151.828853:0:20783:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788891151.828888:0:20783:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788891151.828893:0:20783:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788891151.828899:0:20783:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788891151.828923:0:20783:0:(import.c:65:import_set_state_nolock()) ffff9250ba96d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788891151.828964:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875787997438208:0@lo:39:umount.0 00000100:00100000:1.0:1788891151.829030:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891151.829431:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997438208 00010000:00010000:2.0:1788891151.829433:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788891151.829440:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997438208 00010000:00010000:2.0:1788891151.829442:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd53eaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd53eb6 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.829451:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081523600 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891151.829455:0:17097:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd53eaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd53eb6 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.829464:0:17097:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd53eaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd53eb6 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891151.829485:0:17097:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd53eaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd53eb6 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891151.829491:0:17097:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788891151.829494:0:17097:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788891151.829496:0:17097:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788891151.829693:0:17097:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd53eaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd53eb6 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.829700:0:17097:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788891151.829705:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788891151.829719:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875787997438208:12345-0@lo:39:umount.0 00010000:00010000:2.0:1788891151.829727:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd53eaf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd53eb6 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.829735:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925081523600/0xa66601b03fd53eaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd53eb6 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788891151.829746:0:17111:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53ee0 00010000:00010000:2.0:1788891151.829749:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891151.829752:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891151.829754:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788891151.829756:0:17111:0:(import.c:65:import_set_state_nolock()) ffff924f832de000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788891151.829778:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891151.829829:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:189d2e4e-bf9f-4645-ba04-f80564b97077:3630:1875787997438336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788891151.829836:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3626:x1875787997438208:12345-0@lo:39:umount.0 Request processed in 119us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891151.829864:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788891151.829914:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250ba96d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788891151.829915:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997438336 00000100:00100000:1.0:1788891151.829921:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997438336 00000100:00100000:2.0:1788891151.829930:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875787997438208:0@lo:39:umount.0 00000100:00100000:1.0:1788891151.829961:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788891151.829969:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189d2e4e-bf9f-4645-ba04-f80564b97077+24:3630:x1875787997438336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891151.829980:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891151.829995:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925080031800/0xa66601b03fd53eb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd53eaf expref: 24 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891151.830008:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891151.830050:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189d2e4e-bf9f-4645-ba04-f80564b97077+23:3630:x1875787997438336:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891151.830057:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788891151.830097:0:20783:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788891151.830100:0:20783:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788891151.830104:0:20783:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1788891151.830128:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:189d2e4e-bf9f-4645-ba04-f80564b97077:3630:1875787997438336:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891151.831086:0:20783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081522e00/0xa66601b03fd53e00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53e07 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891151.831099:0:20783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081522e00/0xa66601b03fd53e00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53e07 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891151.831106:0:20783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081522e00/0xa66601b03fd53e00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd53e07 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891151.831112:0:20783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff925081522e00/0xa66601b03fd53e00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd53e07 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891151.831146:0:20783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891151.831152:0:20783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82310e00/0xa66601b03fd5420c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54213 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891151.831159:0:20783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82310e00/0xa66601b03fd5420c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54213 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891151.831166:0:20783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82310e00/0xa66601b03fd5420c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd54213 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891151.831171:0:20783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff924f82310e00/0xa66601b03fd5420c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd54213 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891151.831182:0:20783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788891151.831187:0:20783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd543a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd543b0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891151.831193:0:20783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd543a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd543b0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891151.831200:0:20783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd543a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd543b0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891151.831205:0:20783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd543a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd543b0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891151.831218:0:20783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788891151.831224:0:20783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523200/0xa66601b03fd53df2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53df9 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891151.831237:0:20783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523200/0xa66601b03fd53df2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53df9 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831240:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788891151.831248:0:20783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523200/0xa66601b03fd53df2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd53df9 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831249:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925081522e00/0xa66601b03fd53e00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd53e07 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891151.831264:0:20783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff925081523200/0xa66601b03fd53df2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd53df9 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831267:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522e00 already unused, calling callback (ffffffffc13fbc20) 00010000:00010000:1.0:1788891151.831274:0:20783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1788891151.831280:0:20783:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:00010000:2.0:1788891151.831281:0:19132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925081522e00/0xa66601b03fd53e00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd53e07 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831292:0:19132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925081522e00/0xa66601b03fd53e00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd53e07 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891151.831299:0:19132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925081522e00/0xa66601b03fd53e00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd53e07 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891151.831304:0:19132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:01000004:1.0:1788891151.831305:0:20783:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 10000000:01000000:2.0:1788891151.831307:0:19132:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788891151.831310:0:19132:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:01000000:1.0:1788891151.831311:0:20783:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:2.0:1788891151.831336:0:19132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925081522e00/0xa66601b03fd53e00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd53e07 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831341:0:19132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891151.831361:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925081522e00/0xa66601b03fd53e00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd53e07 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831368:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925081522e00/0xa66601b03fd53e00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd53e07 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831380:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788891151.831394:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff924f82310e00/0xa66601b03fd5420c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd54213 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831400:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82310e00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891151.831403:0:19132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff924f82310e00/0xa66601b03fd5420c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd54213 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831409:0:19132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff924f82310e00/0xa66601b03fd5420c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd54213 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788891151.831473:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891151.831480:0:20783:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1788891151.831485:0:20783:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9250c12df000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788891151.831499:0:20783:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff924f82388800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:2.0:1788891151.831502:0:19132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff924f82310e00/0xa66601b03fd5420c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd54213 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788891151.831504:0:20783:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff925087448000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788891151.831517:0:20783:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff925086cf6800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:2.0:1788891151.831518:0:19132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788891151.831541:0:19132:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788891151.831546:0:19132:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00080000:1.0:1788891151.831548:0:20783:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff924f832dd000 lustre-MDT0000-lwp-MDT0000_UUID 0@lo 1 (1 0 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788891151.831556:0:20783:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9250b72d4800 6db8dbfb-e84b-4eac-afbf-d489bcb0a680 192.168.204.26@tcp 1 (0 1 0) 1 0 0 0: 0000000000000000 8589934679 stale:0 00010000:00010000:2.0:1788891151.831566:0:19132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff924f82310e00/0xa66601b03fd5420c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd54213 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831573:0:19132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891151.831586:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff924f82310e00/0xa66601b03fd5420c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd54213 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831592:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff924f82310e00/0xa66601b03fd5420c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd54213 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831601:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788891151.831604:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd543a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd543b0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831610:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4800 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891151.831612:0:19132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd543a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd543b0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831618:0:19132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd543a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd543b0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891151.831624:0:19132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd543a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd543b0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891151.831637:0:19132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788891151.831639:0:19132:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788891151.831641:0:19132:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788891151.831654:0:19132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd543a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd543b0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831660:0:19132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891151.831683:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd543a9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd543b0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831689:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250baae4800/0xa66601b03fd543a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd543b0 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831698:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891151.831701:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925081523200/0xa66601b03fd53df2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd53df9 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831707:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081523200 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891151.831710:0:19132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925081523200/0xa66601b03fd53df2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd53df9 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831716:0:19132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925081523200/0xa66601b03fd53df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd53df9 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891151.831721:0:19132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925081523200/0xa66601b03fd53df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd53df9 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891151.831726:0:19132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788891151.831728:0:19132:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788891151.831730:0:19132:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788891151.831749:0:19132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925081523200/0xa66601b03fd53df2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd53df9 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831755:0:19132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891151.831761:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925081523200/0xa66601b03fd53df2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd53df9 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831767:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925081523200/0xa66601b03fd53df2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd53df9 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.831777:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891151.831778:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891151.831780:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891151.831795:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997438464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891151.831841:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788891151.831850:0:20783:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9250ba88b370) has exports, disconnecting them 00000020:00080000:1.0:1788891151.831859:0:20783:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9250c12df000), last request at 1788891147 00000020:00000080:1.0:1788891151.831865:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd541e2 00000100:00100000:2.0:1788891151.831886:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788891151.831893:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997438592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891151.831913:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891151.831938:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997438720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891151.831960:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891151.831975:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788891151.831981:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f831db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997438848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891151.831998:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891151.832021:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997438464 00000100:00100000:2.0:1788891151.832027:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997438464 00000100:00080000:1.0:1788891151.832038:0:20783:0:(import.c:65:import_set_state_nolock()) ffff9250c12db000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788891151.832057:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997438592 00000100:00100000:2.0:1788891151.832067:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997438592 00000100:00100000:2.0:1788891151.832085:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997438720 00000100:00100000:2.0:1788891151.832088:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997438720 00000100:00100000:2.0:1788891151.832100:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997438848 00000020:00080000:1.0:1788891151.832103:0:20783:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9250c12df000): rc 0 00000020:00000080:1.0:1788891151.832107:0:20783:0:(genops.c:885:class_export_put()) final put ffff9250c12df000/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:2.0:1788891151.832110:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997438848 00000020:00080000:1.0:1788891151.832121:0:20783:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff924f82388800), last request at 1788891147 00000020:00000080:1.0:1788891151.832126:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd54084 00000100:00080000:1.0:1788891151.832132:0:20783:0:(import.c:65:import_set_state_nolock()) ffff924f8238e000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788891151.832133:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000020:00080000:1.0:1788891151.832143:0:20783:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff924f82388800): rc 0 00000100:00100000:2.0:1788891151.832146:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189d2e4e-bf9f-4645-ba04-f80564b97077+26:3627:x1875787997438464:12345-0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788891151.832147:0:20783:0:(genops.c:885:class_export_put()) final put ffff924f82388800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788891151.832155:0:20783:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff925087448000), last request at 1788891101 00000020:00000080:1.0:1788891151.832159:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53fce 00010000:00010000:2.0:1788891151.832162:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1788891151.832162:0:20783:0:(import.c:65:import_set_state_nolock()) ffff925087449000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788891151.832171:0:20783:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff925087448000): rc 0 00000020:00000080:1.0:1788891151.832174:0:20783:0:(genops.c:885:class_export_put()) final put ffff925087448000/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:2.0:1788891151.832178:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250857dee00/0xa66601b03fd53e07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd53e00 expref: 26 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788891151.832180:0:20783:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff925086cf6800), last request at 1788891101 00000020:00000080:1.0:1788891151.832186:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53f73 00000100:00080000:1.0:1788891151.832191:0:20783:0:(import.c:65:import_set_state_nolock()) ffff925086ea2800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788891151.832196:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:1.0:1788891151.832200:0:20783:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934679 00000100:00100000:2.0:1788891151.832230:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189d2e4e-bf9f-4645-ba04-f80564b97077+25:3627:x1875787997438464:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891151.832238:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788891151.832253:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788891151.832261:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83add500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189d2e4e-bf9f-4645-ba04-f80564b97077+24:3627:x1875787997438592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891151.832269:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891151.832278:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250857de200/0xa66601b03fd54213 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd5420c expref: 24 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788891151.832285:0:20783:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff925086cf6800): rc 0 00010000:00010000:2.0:1788891151.832288:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00000080:1.0:1788891151.832293:0:20783:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbbfc4806bae0 00000100:00080000:1.0:1788891151.832310:0:20783:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788891151.832311:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83add500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189d2e4e-bf9f-4645-ba04-f80564b97077+23:3627:x1875787997438592:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891151.832315:0:20783:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:2.0:1788891151.832321:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788891151.832333:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788891151.832339:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925088664450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189d2e4e-bf9f-4645-ba04-f80564b97077+22:3629:x1875787997438720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891151.832346:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891151.832354:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250857df400/0xa66601b03fd543b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd543a9 expref: 22 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.832362:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891151.832410:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925088664450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189d2e4e-bf9f-4645-ba04-f80564b97077+21:3629:x1875787997438720:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891151.832412:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000020:00000080:3.0:1788891151.832424:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9250c12df000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788891151.832426:0:17111:0:(genops.c:885:class_export_put()) final put ffff924f832dd000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788891151.832469:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f82388800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788891151.832491:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff925087448000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788891151.832507:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9250c12db000 for lustre-MDT0000 00000020:00000080:3.0:1788891151.832512:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f832dd000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788891151.832557:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f8238e000 for lustre-MDT0000 00000020:00000080:3.0:1788891151.832561:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff925087449000 for lustre-MDT0000 00000020:00000080:3.0:1788891151.832564:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f832de000 for lustre-MDT0000 00000100:00100000:2.0:1788891151.833093:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788891151.833137:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788891151.833146:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83ade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189d2e4e-bf9f-4645-ba04-f80564b97077+20:3629:x1875787997438848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891151.833155:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891151.833167:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250857dec00/0xa66601b03fd53df9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd53df2 expref: 20 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891151.833177:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891151.833205:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83ade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189d2e4e-bf9f-4645-ba04-f80564b97077+19:3629:x1875787997438848:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891151.833210:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1788891151.833237:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891151.833265:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997438848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891151.833274:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997438720:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788891151.833411:0:20783:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788891151.833429:0:20783:0:(import.c:65:import_set_state_nolock()) ffff9250ba9aa000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788891151.833483:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891151.833488:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891151.833511:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f831d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997438592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891151.833520:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:3627:1875787997438464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788891151.833865:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997438976:0@lo:39:umount.0 00000100:00100000:3.0:1788891151.833904:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891151.834066:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997438976 00000100:00100000:2.0:1788891151.834074:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997438976 00000100:00100000:2.0:1788891151.834169:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788891151.834171:0:20783:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788891151.834179:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875787997438976:12345-0@lo:39:umount.0 00000100:00100000:1.0:1788891151.834187:0:20783:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934599 gen 3 00000020:00000080:2.0:1788891151.834205:0:17114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53fdc 00000004:00080000:1.0:1788891151.834209:0:20783:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788891151.834216:0:17114:0:(import.c:65:import_set_state_nolock()) ffff9250875b7000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788891151.834240:0:17114:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:1.0:1788891151.834266:0:20783:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788891151.834281:0:20783:0:(import.c:65:import_set_state_nolock()) ffff924f81773800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788891151.834294:0:20783:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788891151.834297:0:20783:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934599 gen 3 00000100:00100000:1.0:1788891151.834305:0:20783:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff924f833d0000 x1875787997435776/t8589934601(8589934601) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788891160 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788891151.834314:0:20783:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff924f833d0000, transno 8589934601 00000004:00080000:1.0:1788891151.834329:0:20783:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788891151.834355:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3626:x1875787997438976:12345-0@lo:39:umount.0 Request processed in 177us (449us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788891151.834364:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788891151.834464:0:20783:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788891151.834474:0:20783:0:(import.c:65:import_set_state_nolock()) ffff9250ba96f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788891151.834515:0:20783:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9250ba88b370) has no exports 00010000:00010000:1.0:1788891151.834668:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891151.836263:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997439104:0@lo:9:umount.0 00000100:00100000:3.0:1788891151.836349:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891151.836400:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997439232:0@lo:9:umount.0 00000100:00100000:1.0:1788891151.836421:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997439104 00000100:00100000:1.0:1788891151.836429:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997439104 00000100:00100000:1.0:1788891151.836476:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788891151.836486:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8416dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1875787997439104:12345-0@lo:9:umount.0 00000100:00100000:3.0:1788891151.836506:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788891151.836507:0:18720:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd540c3 00000100:00080000:1.0:1788891151.836517:0:18720:0:(import.c:65:import_set_state_nolock()) ffff925091ac7000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788891151.836577:0:18720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1788891151.836680:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8416dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3626:x1875787997439104:12345-0@lo:9:umount.0 Request processed in 196us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891151.836688:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788891151.836699:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997439232 00000100:00100000:1.0:1788891151.836702:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997439232 00000100:00100000:1.0:1788891151.836736:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788891151.836743:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090313800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1875787997439232:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788891151.836762:0:18720:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd5421a 00000100:00080000:1.0:1788891151.836767:0:18720:0:(import.c:65:import_set_state_nolock()) ffff924f81ec9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788891151.836786:0:18720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:1.0:1788891151.836856:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090313800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3626:x1875787997439232:12345-0@lo:9:umount.0 Request processed in 113us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891151.836862:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788891151.836876:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788891151.836880:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788891151.836886:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891151.836890:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788891151.838501:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250ba9aa000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788891151.838516:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997438976:0@lo:39:umount.0 00000100:00080000:3.0:1788891151.838565:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f81773800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788891151.838593:0:3626:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788891151.838595:0:3626:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788891151.838598:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997439104:0@lo:9:umount.0 00000100:00100000:3.0:1788891151.838610:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 3 00000100:00080000:3.0:1788891151.838614:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250ba96f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788891151.838624:0:3626:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788891151.838625:0:3626:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788891151.838628:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997439232:0@lo:9:umount.0 00000020:00080000:2.0:1788891151.853758:0:20783:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9250ba88b370) has no exports 00000020:00000080:2.0:1788891151.918850:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53e4d 00000020:00000080:2.0:1788891151.918866:0:20783:0:(genops.c:885:class_export_put()) final put ffff925090958800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788891151.918916:0:20783:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788891151.919171:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925090958800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788891151.919198:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891151.919209:0:20783:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788891151.919213:0:20783:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9250bf67cd28) has no exports 00000020:00000080:3.0:1788891151.924194:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53e46 00000020:00000080:3.0:1788891151.924207:0:20783:0:(genops.c:885:class_export_put()) final put ffff924f81775800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788891151.924275:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891151.924286:0:20783:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788891151.924290:0:20783:0:(genops.c:885:class_export_put()) final put ffff924f81774800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788891151.924293:0:20783:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81774800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788891151.924298:0:20783:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788891151.924634:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81775800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788891151.934756:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891152.507779:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997439360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788891152.507862:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891152.507907:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997439360 00000100:00100000:2.0:1788891152.507910:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788891152.507916:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997439360 00000100:00100000:2.0:1788891152.507918:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997439488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788891152.507954:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891152.507981:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788891152.507993:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997439360:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788891152.508010:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997439488 00000100:00100000:2.0:1788891152.508016:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997439488 00002000:00000024:0.0:1788891152.508023:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788891152.508040:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788891152.508047:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3627:x1875787997439488:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788891152.508053:0:17115:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788891152.508091:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3627:x1875787997439488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 43us (136us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788891152.508099:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:02020000:2.0:1788891152.508140:0:3627:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:0.0:1788891152.508289:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997439360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 299us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891152.508296:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788891152.508392:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788891152.509920:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997440000:0@lo:400:kworker.0 00000100:00100000:3.0:1788891152.509979:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891152.510032:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788891152.510049:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997439872:0@lo:400:kworker.0 00000100:00100000:3.0:1788891152.510077:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891152.510116:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997439744:0@lo:400:kworker.0 00000100:00100000:3.0:1788891152.510603:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891152.510624:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997440256:0@lo:400:kworker.0 00000100:00100000:3.0:1788891152.510643:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891152.510662:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788891152.510667:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997439616:0@lo:400:kworker.0 00000100:00100000:3.0:1788891152.510689:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891152.510703:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1875787997440128:0@lo:400:kworker.0 00000100:00100000:3.0:1788891152.510721:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891152.510756:0:20411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997440000 00000100:00100000:3.0:1788891152.510762:0:20411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997440000 00000100:00100000:3.0:1788891152.510800:0:20411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997439872 00000100:00100000:3.0:1788891152.510803:0:20411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997439872 00000100:00100000:3.0:1788891152.510812:0:20411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997439744 00000100:00100000:3.0:1788891152.510814:0:20411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997439744 00000100:00100000:3.0:1788891152.510821:0:20411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997440256 00000100:00100000:3.0:1788891152.510824:0:20411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997440256 00000100:00100000:3.0:1788891152.510838:0:20411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997440128 00000100:00100000:3.0:1788891152.510840:0:20411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997440128 00000100:00100000:3.0:1788891152.510851:0:20411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788891152.510859:0:20411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875787997440000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891152.510909:0:20411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875787997440000:12345-0@lo:400:kworker.0 Request processed in 51us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891152.510915:0:20411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788891152.510931:0:20411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788891152.510946:0:20411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875787997440256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891152.510979:0:20411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875787997440256:12345-0@lo:400:kworker.0 Request processed in 35us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891152.510985:0:20411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788891152.510997:0:20411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788891152.511001:0:20411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3628:x1875787997439872:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788891152.511007:0:20411:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788891152.511031:0:20411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3628:x1875787997439872:12345-0@lo:400:kworker.0 Request processed in 28us (953us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788891152.511388:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788891152.511394:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3630:x1875787997439744:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788891152.511400:0:18639:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788891152.511430:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3630:x1875787997439744:12345-0@lo:400:kworker.0 Request processed in 35us (827us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788891152.511436:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788891152.511451:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788891152.511455:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3630:x1875787997440128:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788891152.511460:0:18639:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788891152.511481:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3630:x1875787997440128:12345-0@lo:400:kworker.0 Request processed in 24us (759us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788891152.511487:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1788891152.511545:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788891152.511599:0:3628:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788891152.511605:0:3628:0:(import.c:65:import_set_state_nolock()) ffff924f8238b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788891152.511610:0:3628:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788891152.511711:0:20352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997439616 00000100:00100000:0.0:1788891152.511716:0:20352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997439616 00000100:00100000:0.0:1788891152.511756:0:20352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788891152.511763:0:20352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997439616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891152.511799:0:20352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997439616:12345-0@lo:400:kworker.0 Request processed in 37us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891152.511806:0:20352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788891152.511837:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891152.511886:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997439616:0@lo:400:kworker.0 00000100:00080000:0.0:1788891152.511897:0:3630:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788891152.511900:0:3630:0:(import.c:65:import_set_state_nolock()) ffff925087571000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788891152.511903:0:3630:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788891152.511909:0:3630:0:(import.c:65:import_set_state_nolock()) ffff925087571000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891152.511913:0:3630:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 343 00000100:00080000:0.0:1788891152.511920:0:3630:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff925087571000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891152.511948:0:3630:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83a64700 x1875787997440384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788891152.511970:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3630:1875787997440128:0@lo:400:kworker.0 00000100:00080000:0.0:1788891152.511991:0:3630:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788891152.511994:0:3630:0:(import.c:65:import_set_state_nolock()) ffff92508744d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788891152.511998:0:3630:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788891152.512001:0:3630:0:(import.c:65:import_set_state_nolock()) ffff92508744d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891152.512005:0:3630:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 323 00000100:00080000:0.0:1788891152.512009:0:3630:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92508744d000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891152.512023:0:3630:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83a66a00 x1875787997440512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788891152.512048:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997439744:0@lo:400:kworker.0 00010000:00080000:0.0:1788891152.512063:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c12a7b80 x1875787997440256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891152.512073:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997440256:0@lo:400:kworker.0 00000100:00100000:0.0:1788891152.512108:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1875787997440384:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788891152.512140:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891152.512158:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875787997440512:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788891152.512179:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891152.512204:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997440384 00000100:00100000:0.0:1788891152.512207:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997440384 00000100:00100000:0.0:1788891152.512223:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997440512 00000100:00100000:0.0:1788891152.512226:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997440512 00000100:00100000:0.0:1788891152.512241:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788891152.512246:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1875787997440384:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1788891152.512260:0:17109:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788891152.512296:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1875787997440384:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 49us (156us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788891152.512309:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788891152.512322:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788891152.512326:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1875787997440512:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1788891152.512334:0:17109:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788891152.512359:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1875787997440512:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 32us (180us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788891152.512365:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1788891152.512405:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925087571000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788891152.512410:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788891152.512413:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1875787997440384:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1788891152.512421:0:3626:0:(import.c:65:import_set_state_nolock()) ffff92508744d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788891152.512424:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788891152.512427:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875787997440512:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788891152.512605:0:20411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1788891152.516833:0:3627:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788891152.516841:0:3627:0:(import.c:65:import_set_state_nolock()) ffff924f81edd000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788891152.516847:0:3627:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788891152.516853:0:3627:0:(import.c:65:import_set_state_nolock()) ffff924f81edd000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788891152.516859:0:3627:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 323 00000100:00080000:2.0:1788891152.516870:0:3627:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff924f81edd000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788891152.516922:0:3627:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83addc00 x1875787997440640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788891152.516983:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997439360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788891152.518193:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997440640:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788891152.518260:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891152.519595:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997440640 00000100:00100000:2.0:1788891152.519606:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997440640 00000100:00100000:2.0:1788891152.519649:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788891152.519657:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1875787997440640:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788891152.519673:0:17114:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788891152.519738:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1875787997440640:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 81us (1477us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788891152.519744:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788891152.519799:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f81edd000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788891152.519804:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788891152.519808:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997440640:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788891152.562034:0:3628:0:(import.c:65:import_set_state_nolock()) ffff924f8238b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788891152.562050:0:3628:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 333 00000100:00080000:1.0:1788891152.562060:0:3628:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff924f8238b000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891152.562104:0:3628:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f833d2a00 x1875787997440768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788891152.562139:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997439872:0@lo:400:kworker.0 00010000:00080000:1.0:1788891152.562174:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84291500 x1875787997440000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891152.562187:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997440000:0@lo:400:kworker.0 00000100:00100000:2.0:1788891152.563044:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1875787997440768:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788891152.563116:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891152.563420:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997440768 00000100:00100000:3.0:1788891152.563428:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997440768 00000100:00100000:3.0:1788891152.563482:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788891152.563489:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1875787997440768:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1788891152.563511:0:17109:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788891152.563855:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1875787997440768:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 364us (738us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788891152.563863:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1788891152.570207:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f8238b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788891152.570220:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788891152.570226:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1875787997440768:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1788891152.956388:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891153.531886:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997440896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788891153.532037:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891153.532069:0:20461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997440896 00000100:00100000:0.0:1788891153.532078:0:20461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997440896 00000100:00100000:0.0:1788891153.532146:0:20461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788891153.532156:0:20461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997440896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788891153.532185:0:20461:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788891153.532233:0:20461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997440896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891153.532239:0:20461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788891153.532754:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997440896:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788891153.979831:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788891154.492168:0:17861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788891155.003744:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788891155.585910:0:18610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788891155.585919:0:18610:0:(genops.c:885:class_export_put()) final put ffff924f832d8000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788891155.585945:0:18610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6db8dbfb-e84b-4eac-afbf-d489bcb0a680 00000020:00000080:3.0:1788891155.585947:0:18610:0:(genops.c:885:class_export_put()) final put ffff92509df7e000/6db8dbfb-e84b-4eac-afbf-d489bcb0a680 00000001:00100000:3.0:1788891155.585953:0:18610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6f09a10f-9224-43a2-a8d4-25920b0f419e 00000020:00000080:3.0:1788891155.585955:0:18610:0:(genops.c:885:class_export_put()) final put ffff925087577800/6f09a10f-9224-43a2-a8d4-25920b0f419e 00000020:00000080:0.0:1788891155.586081:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f832d8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000001:00100000:3.0:1788891155.586240:0:17841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788891155.586249:0:17841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1788891155.586252:0:17841:0:(genops.c:885:class_export_put()) final put ffff925086ea5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788891155.586388:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92509df7e000/6db8dbfb-e84b-4eac-afbf-d489bcb0a680 for lustre-OST0000 00000020:00000080:0.0:1788891155.586428:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff925087577800/6f09a10f-9224-43a2-a8d4-25920b0f419e for lustre-OST0000 00000020:00000080:0.0:1788891155.586445:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff925091ac7000 for lustre-OST0000 00000020:00000080:0.0:1788891155.586449:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92509df78000 for lustre-OST0000 00000020:00000080:0.0:1788891155.586452:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff925087573800 for lustre-OST0000 00000001:00100000:1.0:1788891155.586967:0:17089:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788891155.586972:0:17089:0:(genops.c:885:class_export_put()) final put ffff925086cf6800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788891155.586988:0:17089:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6db8dbfb-e84b-4eac-afbf-d489bcb0a680 00000020:00000080:1.0:1788891155.586991:0:17089:0:(genops.c:885:class_export_put()) final put ffff9250b72d4800/6db8dbfb-e84b-4eac-afbf-d489bcb0a680 00000020:00000080:0.0:1788891155.587035:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff925086cf6800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788891155.587073:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9250b72d4800/6db8dbfb-e84b-4eac-afbf-d489bcb0a680 for lustre-MDT0000 00000020:00000080:0.0:1788891155.587094:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff925086ea2800 for lustre-MDT0000 00000020:00000080:0.0:1788891155.587097:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9250b72d6800 for lustre-MDT0000 00000001:00100000:3.0:1788891155.587286:0:17841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6db8dbfb-e84b-4eac-afbf-d489bcb0a680 00000001:00080000:3.0:1788891155.587294:0:17841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1788891155.587296:0:17841:0:(genops.c:885:class_export_put()) final put ffff9250b72d3000/6db8dbfb-e84b-4eac-afbf-d489bcb0a680 00000020:00000080:1.0:1788891155.587331:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff925086ea5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788891155.587377:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9250875b7000 for lustre-MDT0001 00000001:00100000:3.0:1788891155.587604:0:17841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6f09a10f-9224-43a2-a8d4-25920b0f419e 00000001:00080000:3.0:1788891155.587609:0:17841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1788891155.587612:0:17841:0:(genops.c:885:class_export_put()) final put ffff924f823b3000/6f09a10f-9224-43a2-a8d4-25920b0f419e 00000020:00000080:0.0:1788891155.587652:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9250b72d3000/6db8dbfb-e84b-4eac-afbf-d489bcb0a680 for lustre-MDT0001 00000020:00000080:0.0:1788891155.587678:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9250b72d5800 for lustre-MDT0001 00000020:00000080:1.0:1788891155.587817:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f823b3000/6f09a10f-9224-43a2-a8d4-25920b0f419e for lustre-MDT0001 00000020:00000080:1.0:1788891155.587940:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f823b7800 for lustre-MDT0001 00010000:00010000:1.0:1788891156.027803:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891157.052834:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891157.629589:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788891157.629609:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997441024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788891157.629682:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:1.0:1788891157.629987:0:19431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788891157.629993:0:19431:0:(genops.c:885:class_export_put()) final put ffff924f81ec8000/lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788891157.630027:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997441024 00000100:00100000:1.0:1788891157.630035:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997441024 00000100:00100000:1.0:1788891157.630095:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788891157.630107:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997441024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788891157.630145:0:18618:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1788891157.630166:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788891157.630171:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788891157.630175:0:36:0:(import.c:65:import_set_state_nolock()) ffff924f81edd000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891157.630181:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 374 00000100:00080000:0.0:1788891157.630186:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788891157.630192:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff924f81edd000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891157.630199:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997441024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891157.630206:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788891157.630215:0:36:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83a64380 x1875787997441280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788891157.630231:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997441152:0@lo:400:kworker.0 00000100:00080000:0.0:1788891157.630243:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788891157.630248:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788891157.630250:0:36:0:(import.c:65:import_set_state_nolock()) ffff92508744d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891157.630254:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 374 00000100:00080000:0.0:1788891157.630257:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788891157.630261:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92508744d000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891157.630287:0:36:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83a64e00 x1875787997441536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788891157.630303:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788891157.630306:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788891157.630308:0:36:0:(import.c:65:import_set_state_nolock()) ffff924f8238b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891157.630311:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 374 00000100:00080000:0.0:1788891157.630314:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788891157.630317:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff924f8238b000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891157.630330:0:36:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83a65880 x1875787997441664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788891157.630347:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788891157.630350:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788891157.630352:0:36:0:(import.c:65:import_set_state_nolock()) ffff925087571000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891157.630355:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 374 00000100:00080000:0.0:1788891157.630357:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788891157.630360:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff925087571000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891157.630371:0:36:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9250c12a7b80 x1875787997441920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:0.0:1788891157.630391:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81ec8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788891157.630422:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f81ec9000 for lustre-OST0001 00000100:00100000:0.0:1788891157.630435:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997441408:0@lo:400:kworker.0 00000100:00100000:0.0:1788891157.630465:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788891157.630503:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788891157.630550:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997441408 00000100:00100000:0.0:1788891157.630555:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997441408 00000100:00100000:0.0:1788891157.630587:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788891157.630594:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997441408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891157.630709:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997441280:0@lo:38:kworker.0 00000100:00100000:0.0:1788891157.630743:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997441408:12345-0@lo:400:kworker.0 Request processed in 149us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891157.630752:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891157.630753:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788891157.630781:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875787997441536:0@lo:38:kworker.0 00000100:00080000:0.0:1788891157.630796:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788891157.630811:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891157.630831:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1875787997441664:0@lo:38:kworker.0 00000100:00100000:2.0:1788891157.630858:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891157.630877:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1875787997441920:0@lo:38:kworker.0 00000100:00100000:2.0:1788891157.630903:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891157.630932:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1875787997442048:0@lo:400:kworker.0 00000100:00100000:2.0:1788891157.630962:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891157.630982:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788891157.630988:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997441792:0@lo:400:kworker.0 00000100:00100000:2.0:1788891157.631016:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891157.631049:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997441536 00000100:00100000:0.0:1788891157.631054:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997441536 00000100:00100000:2.0:1788891157.631069:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997441664 00000100:00100000:0.0:1788891157.631072:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997441920 00000100:00100000:2.0:1788891157.631075:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997441664 00000100:00100000:0.0:1788891157.631077:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997441920 00000100:00100000:0.0:1788891157.631094:0:18639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997442048 00000100:00100000:0.0:1788891157.631097:0:18639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997442048 00000100:00100000:2.0:1788891157.631098:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997441792 00000100:00100000:2.0:1788891157.631104:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997441792 00000100:00100000:0.0:1788891157.631129:0:18639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788891157.631137:0:18639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875787997442048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891157.631175:0:18639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875787997442048:12345-0@lo:400:kworker.0 Request processed in 40us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891157.631237:0:17934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997441280 00000100:00100000:3.0:1788891157.631242:0:17934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997441280 00000100:00100000:3.0:1788891157.631265:0:17934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788891157.631281:0:17934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3626:x1875787997441280:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788891157.631295:0:17934:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788891157.632903:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891157.633019:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997441408:0@lo:400:kworker.0 00000100:00080000:1.0:1788891157.633051:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788891157.633140:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788891157.633157:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875787997441792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891157.633213:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875787997441792:12345-0@lo:400:kworker.0 Request processed in 64us (2196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891157.633220:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788891157.633244:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788891157.633248:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875787997441536:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788891157.633265:0:17111:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788891157.633311:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875787997441536:12345-0@lo:38:kworker.0 Request processed in 61us (2499us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788891157.633318:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788891157.633350:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788891157.633355:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875787997441664:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788891157.633365:0:17111:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788891157.633396:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875787997441664:12345-0@lo:38:kworker.0 Request processed in 40us (2537us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788891157.633403:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788891157.633419:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788891157.633425:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f831da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875787997441920:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788891157.633433:0:17111:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788891157.633448:0:18639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788891157.633463:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f831da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875787997441920:12345-0@lo:38:kworker.0 Request processed in 37us (2559us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788891157.633470:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1788891157.633508:0:3626:0:(import.c:65:import_set_state_nolock()) ffff92508744d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788891157.633514:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788891157.633518:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875787997441536:0@lo:38:kworker.0 00000100:00100000:0.0:1788891157.633541:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997441024:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788891157.633552:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f8238b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788891157.633558:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788891157.633562:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1875787997441664:0@lo:38:kworker.0 00000100:00080000:2.0:1788891157.633574:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925087571000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788891157.633577:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788891157.633581:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1875787997441920:0@lo:38:kworker.0 00010000:00080000:0.0:1788891157.633608:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83a67800 x1875787997441792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891157.633620:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997441792:0@lo:400:kworker.0 00010000:00080000:0.0:1788891157.633634:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c12a6680 x1875787997442048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891157.633643:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1875787997442048:0@lo:400:kworker.0 00000100:00100000:2.0:1788891157.633698:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997441152 00000100:00100000:2.0:1788891157.633705:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997441152 00000100:00100000:2.0:1788891157.633747:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788891157.633754:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f82e40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+19:3629:x1875787997441152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891157.633796:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f82e40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:189d2e4e-bf9f-4645-ba04-f80564b97077+19:3629:x1875787997441152:12345-0@lo:400:kworker.0 Request processed in 43us (3529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891157.633803:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788891157.633842:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997441152:0@lo:400:kworker.0 00000100:00100000:3.0:1788891157.642053:0:17934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3626:x1875787997441280:12345-0@lo:38:kworker.0 Request processed in 10764us (11296us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788891157.642068:0:17934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788891157.643313:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f81edd000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788891157.643322:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788891157.643327:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997441280:0@lo:38:kworker.0 00000020:01000000:1.0:1788891158.012843:0:20783:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff925090083720 - data ffff9250b0904af8/ffff9250b4e55c00 00000020:01000000:1.0:1788891158.012997:0:20783:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff924f81f5a180 - data ffff925092140d80/ffff9250b731fc00 00000001:00000004:1.0:1788891158.019738:0:20783:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934679 00000100:00080000:0.0:1788891158.058210:0:20783:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788891158.058218:0:20783:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788891158.058231:0:20783:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff924f833d3480 x1875787997438976/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788891161 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891158.058278:0:20783:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788891158.060444:0:20783:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788891158.060451:0:20783:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934599 gen 4 00000004:00080000:0.0:1788891158.060469:0:20783:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788891158.060472:0:20783:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788891158.060981:0:17133:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788891158.060986:0:17133:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:3.0:1788891158.060995:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788891158.062645:0:20783:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788891158.062651:0:20783:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 4 00000004:00080000:0.0:1788891158.062665:0:20783:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788891158.062667:0:20783:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788891158.062935:0:17135:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788891158.062939:0:17135:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 3 count 2 00000040:00080000:2.0:1788891158.062954:0:17135:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788891158.063805:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53e15 00000020:00000080:0.0:1788891158.063813:0:20783:0:(genops.c:885:class_export_put()) final put ffff924f83a7b800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788891158.063890:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f83a7b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788891158.065426:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53e2a 00000020:00000080:0.0:1788891158.065488:0:20783:0:(genops.c:885:class_export_put()) final put ffff9250ba9ac000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788891158.066029:0:20783:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788891158.066035:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788891158.066042:0:20783:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788891158.066047:0:20783:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9250ba88cd28) has no exports 00000004:01000000:0.0:1788891158.066207:0:20783:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788891158.066215:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53e8c 00000020:00000080:0.0:1788891158.066220:0:20783:0:(genops.c:885:class_export_put()) final put ffff925091ac6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788891158.066611:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9250ba9ac000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788891158.066907:0:20783:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788891158.066913:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788891158.066919:0:20783:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788891158.066921:0:20783:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9250b7178000) has no exports 00000020:00000080:0.0:1788891158.066927:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53e85 00000020:00000080:0.0:1788891158.066932:0:20783:0:(genops.c:885:class_export_put()) final put ffff9250ba96a800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788891158.067116:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff925091ac6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788891158.067123:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9250ba96a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788891158.067295:0:20783:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788891158.067299:0:20783:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788891158.067303:0:20783:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 5 00000004:00080000:0.0:1788891158.067307:0:20783:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788891158.067309:0:20783:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788891158.067393:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891158.067400:0:20783:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788891158.067405:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53e77 00000020:00000080:0.0:1788891158.067410:0:20783:0:(genops.c:885:class_export_put()) final put ffff9250ba969000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788891158.067447:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9250ba96f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788891158.067453:0:37:0:(genops.c:885:class_export_put()) final put ffff9250ba96c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788891158.067455:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9250ba96c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788891158.067462:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788891158.067752:0:20783:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788891158.067757:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788891158.067761:0:20783:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788891158.067765:0:20783:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9250bf67b370) has no exports 00000020:00000080:0.0:1788891158.067769:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53e70 00000020:00000080:0.0:1788891158.067773:0:20783:0:(genops.c:885:class_export_put()) final put ffff924f81773000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788891158.067791:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9250ba969000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788891158.068145:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81773000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788891158.069021:0:20783:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788891158.069025:0:20783:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788891158.069029:0:20783:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934599 gen 5 00000004:00080000:0.0:1788891158.069033:0:20783:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788891158.069035:0:20783:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788891158.069109:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891158.069117:0:20783:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788891158.069132:0:20783:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788891158.069139:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53e62 00000020:00000080:0.0:1788891158.069145:0:20783:0:(genops.c:885:class_export_put()) final put ffff9250ba9ad000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788891158.069367:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f81773800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788891158.069375:0:37:0:(genops.c:885:class_export_put()) final put ffff9250ba9af800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788891158.069377:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9250ba9af800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788891158.069383:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788891158.069774:0:20783:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788891158.069834:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9250ba9ad000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788891158.069856:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788891158.069863:0:20783:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788891158.069867:0:20783:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9250ba8899b8) has no exports 00000020:00000080:2.0:1788891158.069874:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53e5b 00000020:00000080:2.0:1788891158.069879:0:20783:0:(genops.c:885:class_export_put()) final put ffff9250ba9a8800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788891158.070641:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9250ba9a8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788891158.071394:0:20783:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788891158.071399:0:20783:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788891158.071402:0:20783:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788891158.071408:0:20783:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788891158.071464:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891158.071472:0:20783:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788891158.071498:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891158.071502:0:20783:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788891158.071507:0:20783:0:(genops.c:885:class_export_put()) final put ffff924f83a79000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788891158.071518:0:20783:0:(genops.c:844:class_export_destroy()) destroying export ffff924f83a79000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788891158.071545:0:20783:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788891158.071642:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53e31 00000020:00000080:3.0:1788891158.071648:0:20783:0:(genops.c:885:class_export_put()) final put ffff9250ba9a8000/lustre-MDD0000_UUID 00000020:01000000:3.0:1788891158.071653:0:20783:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788891158.071656:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891158.071661:0:20783:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788891158.071664:0:20783:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9250ba888000) has no exports 00000020:00000080:3.0:1788891158.071682:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891158.071686:0:20783:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788891158.071689:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53e38 00000020:00000080:3.0:1788891158.071693:0:20783:0:(genops.c:885:class_export_put()) final put ffff9250ba9a9000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788891158.071702:0:20783:0:(tgt_mount.c:187:server_put_mount()) put mount ffff924f839d2800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788891158.071706:0:20783:0:(obd_mount.c:710:lustre_put_lsi()) put ffff924f839d2800 3 00000020:01000004:3.0:1788891158.071709:0:20783:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff924f839d2800 from lustre-MDT0000 00000020:00000080:3.0:1788891158.071725:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891158.071729:0:20783:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788891158.071732:0:20783:0:(genops.c:885:class_export_put()) final put ffff924f83a7f800/lustre-MDT0000_UUID 00000020:00000080:3.0:1788891158.071733:0:20783:0:(genops.c:844:class_export_destroy()) destroying export ffff924f83a7f800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788891158.071740:0:20783:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788891158.071768:0:20783:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1788891158.071771:0:20783:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788891158.071774:0:20783:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788891158.071776:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891158.071779:0:20783:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788891158.071785:0:20783:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff924f839d0800 189d2e4e-bf9f-4645-ba04-f80564b97077 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788891158.071790:0:20783:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff924f81ed4d28) has exports, disconnecting them 00000020:00080000:3.0:1788891158.071793:0:20783:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff924f839d0800), last request at 1788891092 00000020:00000080:3.0:1788891158.071806:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53ddd 00000020:00010000:3.0:1788891158.071810:0:20783:0:(genops.c:1921:obd_stale_export_put()) Put export ffff924f839d0800: total 2 00000100:00080000:3.0:1788891158.071815:0:20783:0:(import.c:65:import_set_state_nolock()) ffff925090905800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788891158.071828:0:20783:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff924f839d0800): rc 0 00000020:00080000:3.0:1788891158.071837:0:20783:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff924f81ed4d28) has no exports 00000020:00010000:3.0:1788891158.071879:0:17098:0:(genops.c:1907:obd_stale_export_get()) Get export ffff924f839d0800: total 2 00010000:00010000:3.0:1788891158.071904:0:17098:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff924f839d0800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788891158.071931:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250857de800/0xa66601b03fd5403e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd54037 expref: 14 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891158.071947:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924f82310400/0xa66601b03fd5419c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd54195 expref: 13 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891158.071959:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250857de600/0xa66601b03fd54386 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd5437f expref: 12 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891158.071970:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925080030800/0xa66601b03fd53efc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd53ef5 expref: 11 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891158.071984:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925080030a00/0xa66601b03fd53f18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd53f11 expref: 10 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891158.071994:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae5000/0xa66601b03fd541c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd541bf expref: 9 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891158.072003:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924f82311000/0xa66601b03fd53deb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd53de4 expref: 8 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891158.072013:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8ba00/0xa66601b03fd54205 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd541fe expref: 7 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891158.072024:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8b400/0xa66601b03fd54068 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd54061 expref: 6 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891158.072034:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250857df200/0xa66601b03fd54394 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd5438d expref: 5 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891158.072055:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813ec400/0xa66601b03fd53fb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd53fb2 expref: 4 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891158.072069:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925080030000/0xa66601b03fd53f0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd53f03 expref: 3 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891158.072081:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8b600/0xa66601b03fd543a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa66601b03fd5439b expref: 2 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891158.072092:0:17098:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff924f839d0800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788891158.072106:0:17098:0:(genops.c:885:class_export_put()) final put ffff924f839d0800/189d2e4e-bf9f-4645-ba04-f80564b97077 00010000:00010000:3.0:1788891158.072111:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891158.072113:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891158.072115:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891158.072150:0:17104:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9250c113a600:17104] 2 exiting: rc = 0 00000100:00100000:0.0:1788891158.072323:0:17103:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff925090569c00:17103] 1 exiting: rc = 0 00000020:00000080:0.0:1788891158.072377:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9250ba9aa000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788891158.072384:0:37:0:(genops.c:885:class_export_put()) final put ffff9250ba9ab800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788891158.072387:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9250ba9ab800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1788891158.072390:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788891158.072439:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9250ba9a8000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788891158.072443:0:37:0:(genops.c:885:class_export_put()) final put ffff9250ba9af000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788891158.072445:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9250ba9af000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788891158.072448:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788891158.072485:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9250ba9a9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788891158.072490:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f839d0800/189d2e4e-bf9f-4645-ba04-f80564b97077 for MGS 00000020:00000080:0.0:1788891158.072541:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff925090905800 for MGS 00000100:00100000:0.0:1788891158.072582:0:17102:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff925090568200:17102] 0 exiting: rc = 1 00000100:00100000:3.0:1788891158.072864:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072873:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072878:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072884:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072890:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072896:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072902:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072908:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072913:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072918:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072924:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072937:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072942:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072947:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072952:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072957:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072971:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072977:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072982:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072988:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072993:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.072998:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073004:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073010:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073015:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073020:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073026:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073032:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073037:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073043:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073049:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073054:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073059:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073065:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073070:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073075:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073081:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073087:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073092:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073098:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073108:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073115:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073120:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073126:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073131:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073137:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073143:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073148:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073153:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073159:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073164:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073178:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073184:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073192:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073198:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073202:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073207:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073213:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073218:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073223:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073229:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073234:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073240:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891158.073244:0:20783:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788891158.074452:0:20783:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff925090083120 - data ffff9250b0904798/ffff924f823a5400 00000020:01000000:3.0:1788891158.074617:0:20783:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9250b69a2060 - data ffff924f8196bca8/ffff9250b5a40c00 00000020:00000080:3.0:1788891158.075031:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53dc1 00000020:00000080:3.0:1788891158.075039:0:20783:0:(genops.c:885:class_export_put()) final put ffff924f83992000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788891158.075051:0:20783:0:(tgt_mount.c:187:server_put_mount()) put mount ffff924f839d2800 from MGS, refs=2 00000020:01000004:3.0:1788891158.075055:0:20783:0:(obd_mount.c:710:lustre_put_lsi()) put ffff924f839d2800 2 00000020:01000004:3.0:1788891158.075058:0:20783:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff924f839d2800 from MGS 00000020:00000080:3.0:1788891158.075078:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891158.075084:0:20783:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788891158.075087:0:20783:0:(genops.c:885:class_export_put()) final put ffff924f83990800/MGS 00000020:00000080:3.0:1788891158.075089:0:20783:0:(genops.c:844:class_export_destroy()) destroying export ffff924f83990800/MGS for MGS 00000020:01000000:3.0:1788891158.075095:0:20783:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788891158.075152:0:20783:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788891158.075156:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891158.075161:0:20783:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788891158.075167:0:20783:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff924f83a7b000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788891158.075173:0:20783:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff924f81ed0000) has exports, disconnecting them 00000020:00080000:3.0:1788891158.075177:0:20783:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff924f83a7b000), last request at 1788891092 00000020:00000080:3.0:1788891158.075181:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53ec4 00000020:00080000:3.0:1788891158.075201:0:20783:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff924f83a7b000): rc 0 00000020:00000080:3.0:1788891158.075205:0:20783:0:(genops.c:885:class_export_put()) final put ffff924f83a7b000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788891158.075894:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f83992000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788891158.075904:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f83a7b000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788891158.089250:0:20783:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788891158.089269:0:20783:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788891158.089273:0:20783:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788891158.089279:0:20783:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788891158.089461:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891158.089471:0:20783:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788891158.089477:0:20783:0:(obd_mount.c:710:lustre_put_lsi()) put ffff924f839d2800 1 00000020:00000080:3.0:1788891158.089484:0:20783:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53db3 00000020:00000080:3.0:1788891158.089491:0:20783:0:(genops.c:885:class_export_put()) final put ffff924f83991800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788891158.089496:0:20783:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788891158.089500:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891158.089503:0:20783:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788891158.089507:0:20783:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9250bf6799b8) has no exports 00010000:00010000:0.0:1788891158.091878:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788891158.091894:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9250ba96d800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788891158.091904:0:467:0:(genops.c:885:class_export_put()) final put ffff925091ac1800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788891158.091908:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff925091ac1800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788891158.091920:0:467:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788891158.091998:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f83991800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788891158.128819:0:20783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891158.128832:0:20783:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788891158.128838:0:20783:0:(genops.c:885:class_export_put()) final put ffff924f839d4000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788891158.128843:0:20783:0:(genops.c:844:class_export_destroy()) destroying export ffff924f839d4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788891158.128854:0:20783:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788891158.128968:0:20783:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff924f839d1800 00000020:02000400:2.0:1788891158.129024:0:20783:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1788891158.652726:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997442176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788891158.652799:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891158.652916:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997442176 00000100:00100000:1.0:1788891158.652924:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997442176 00000100:00100000:1.0:1788891158.652974:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788891158.652984:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997442176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788891158.653014:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788891158.653067:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997442176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891158.653074:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788891158.653147:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997442176:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788891159.099894:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891160.126470:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788891160.432981:0:20984:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788891160.446828:0:20984:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788891160.446881:0:20984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd53fb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53fb9 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891160.446894:0:20984:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd53fb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53fb9 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891160.446901:0:20984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd53fb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd53fb9 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891160.446908:0:20984:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd53fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd53fb9 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891160.446933:0:20984:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788891160.446952:0:20984:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1788891160.446975:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:2.0:1788891160.446976:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788891160.446980:0:20984:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1788891160.446981:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd53fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd53fb9 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788891160.446985:0:20984:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1788891160.446988:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ec200 already unused, calling callback (ffffffffc13fbc20) 00000100:00080000:2.0:1788891160.446990:0:20984:0:(import.c:65:import_set_state_nolock()) ffff92508744d000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 10000000:00010000:0.0:1788891160.446991:0:17097:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd53fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd53fb9 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788891160.446994:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788891160.446996:0:20984:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788891160.446999:0:20984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788891160.447000:0:17097:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd53fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd53fb9 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788891160.447006:0:17097:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd53fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd53fb9 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891160.447012:0:17097:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788891160.447015:0:17097:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788891160.447017:0:17097:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788891160.447059:0:17097:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd53fb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd53fb9 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891160.447065:0:17097:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788891160.447100:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd53fb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd53fb9 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891160.447108:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd53fb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd53fb9 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891160.447119:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891160.447121:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891160.447123:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891160.447261:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788891160.447278:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997442304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891160.447361:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891160.447567:0:20136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997442304 00000100:00100000:0.0:1788891160.447574:0:20136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997442304 00000100:00100000:0.0:1788891160.447611:0:20136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788891160.447620:0:20136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3629:x1875787997442304:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788891160.447627:0:20136:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788891160 with bad export cookie 11990272914417335773 00010000:00010000:2.0:1788891160.448959:0:20984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd53f11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53f18 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891160.448975:0:20984:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd53f11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53f18 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891160.448983:0:20984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd53f11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd53f18 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891160.448990:0:20984:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd53f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd53f18 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891160.449013:0:20984:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891160.449020:0:20984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd541fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54205 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891160.449027:0:20984:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd541fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54205 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891160.449034:0:20984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd541fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd54205 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891160.449040:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891160.449048:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd53f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd53f18 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891160.449067:0:20984:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd541fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd54205 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891160.449097:0:20984:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891160.449097:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081523800 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788891160.449103:0:19132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd53f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd53f18 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891160.449107:0:20984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250857dfa00/0xa66601b03fd5439b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd543a2 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891160.449117:0:19132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd53f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd53f18 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891160.449119:0:20984:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250857dfa00/0xa66601b03fd5439b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd543a2 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891160.449136:0:19132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd53f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd53f18 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891160.449137:0:20984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250857dfa00/0xa66601b03fd5439b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd543a2 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891160.449155:0:19132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788891160.449156:0:20984:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9250857dfa00/0xa66601b03fd5439b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd543a2 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891160.449159:0:19132:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1788891160.449177:0:20984:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788891160.449183:0:20984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081522800/0xa66601b03fd53f03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd53f0a expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891160.449190:0:20984:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081522800/0xa66601b03fd53f03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd53f0a expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891160.449192:0:19132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd53f11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd53f18 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891160.449199:0:20984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925081522800/0xa66601b03fd53f03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd53f0a expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891160.449203:0:19132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891160.449211:0:20984:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff925081522800/0xa66601b03fd53f03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd53f0a expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891160.449239:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd53f11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd53f18 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891160.449243:0:20984:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1788891160.449249:0:20984:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:1.0:1788891160.449251:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925081523800/0xa66601b03fd53f11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd53f18 expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891160.449258:0:20984:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:1.0:1788891160.449268:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788891160.449273:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd541fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd54205 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891160.449280:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b000 already unused, calling callback (ffffffffc13fbc20) 00000020:01000004:2.0:1788891160.449284:0:20984:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 10000000:00010000:1.0:1788891160.449284:0:19132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd541fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd54205 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:2.0:1788891160.449290:0:20984:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788891160.449295:0:20984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788891160.449302:0:20984:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00010000:00010000:1.0:1788891160.449305:0:19132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd541fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd54205 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788891160.449311:0:20984:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff924f83372800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:1.0:1788891160.449318:0:19132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd541fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd54205 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788891160.449321:0:20984:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff924f8238c000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788891160.449333:0:20984:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff925091ac8000) has exports, disconnecting them 10000000:01000000:1.0:1788891160.449334:0:19132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788891160.449338:0:19132:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000020:00080000:2.0:1788891160.449339:0:20984:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff924f83372800), last request at 1788891157 10000000:01000000:1.0:1788891160.449342:0:19132:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00000080:2.0:1788891160.449348:0:20984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd541f0 00010000:00010000:1.0:1788891160.449360:0:19132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd541fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd54205 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788891160.449365:0:20984:0:(import.c:65:import_set_state_nolock()) ffff924f83375000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788891160.449368:0:19132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788891160.449377:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd541fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd54205 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891160.449395:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8b000/0xa66601b03fd541fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd54205 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788891160.449409:0:20984:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff924f83372800): rc 0 00010000:00010000:1.0:1788891160.449410:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00000080:2.0:1788891160.449412:0:20984:0:(genops.c:885:class_export_put()) final put ffff924f83372800/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:1.0:1788891160.449415:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250857dfa00/0xa66601b03fd5439b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd543a2 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891160.449423:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857dfa00 already unused, calling callback (ffffffffc13fbc20) 00000020:00080000:2.0:1788891160.449427:0:20984:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff924f8238c000), last request at 1788891157 10000000:00010000:1.0:1788891160.449428:0:19132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250857dfa00/0xa66601b03fd5439b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd543a2 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788891160.449432:0:20984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd54092 00010000:00010000:1.0:1788891160.449440:0:19132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250857dfa00/0xa66601b03fd5439b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd543a2 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788891160.449443:0:20984:0:(import.c:65:import_set_state_nolock()) ffff924f82389800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788891160.449451:0:20984:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff924f8238c000): rc 0 00000020:00000080:2.0:1788891160.449455:0:20984:0:(genops.c:885:class_export_put()) final put ffff924f8238c000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788891160.449463:0:20984:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbbfc41dc7ae0 10000000:00010000:1.0:1788891160.449464:0:19132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250857dfa00/0xa66601b03fd5439b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd543a2 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891160.449473:0:19132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788891160.449475:0:19132:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788891160.449477:0:19132:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:2.0:1788891160.449481:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788891160.449489:0:20984:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff924f83a67100 x1875787997439488/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788891168 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788891160.449496:0:19132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250857dfa00/0xa66601b03fd5439b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd543a2 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891160.449499:0:20984:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:1.0:1788891160.449506:0:19132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788891160.449546:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250857dfa00/0xa66601b03fd5439b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd543a2 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891160.449554:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250857dfa00/0xa66601b03fd5439b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd543a2 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891160.449563:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891160.449567:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925081522800/0xa66601b03fd53f03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd53f0a expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891160.449572:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522800 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788891160.449575:0:19132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925081522800/0xa66601b03fd53f03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd53f0a expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891160.449581:0:19132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925081522800/0xa66601b03fd53f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd53f0a expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891160.449588:0:19132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925081522800/0xa66601b03fd53f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd53f0a expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891160.449603:0:19132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788891160.449605:0:19132:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788891160.449607:0:19132:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788891160.449622:0:19132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925081522800/0xa66601b03fd53f03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd53f0a expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891160.449627:0:19132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788891160.449634:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925081522800/0xa66601b03fd53f03 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd53f0a expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891160.449641:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925081522800/0xa66601b03fd53f03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa66601b03fd53f0a expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891160.449653:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891160.449655:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891160.449657:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891160.449673:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997442688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891160.449726:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891160.449767:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788891160.449772:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997442816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891160.449790:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891160.449814:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997442688 00000100:00100000:1.0:1788891160.449819:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997442688 00000100:00100000:1.0:1788891160.449844:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997442816 00000100:00100000:1.0:1788891160.449847:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997442816 00000100:00100000:1.0:1788891160.449858:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788891160.449863:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3629:x1875787997442688:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788891160.449870:0:17095:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788891160 with bad export cookie 11990272914417335773 00000100:00100000:1.0:1788891160.449916:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3629:x1875787997442688:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (189us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788891160.449924:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788891160.449959:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788891160.449964:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3629:x1875787997442816:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788891160.449969:0:17095:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788891160 with bad export cookie 11990272914417335773 00000100:00100000:1.0:1788891160.449994:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3629:x1875787997442816:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (202us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788891160.450000:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788891160.450040:0:3629:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.126@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788891160.450044:0:3629:0:(import.c:65:import_set_state_nolock()) ffff924f83997800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788891160.450048:0:3629:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1788891160.450128:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788891160.450357:0:20984:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788891160.450362:0:20984:0:(import.c:65:import_set_state_nolock()) ffff924f81edd000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788891160.453714:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788891160.453723:0:20984:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788891160.453748:0:20984:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788891160.453815:0:20984:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788891160.453844:0:20984:0:(import.c:65:import_set_state_nolock()) ffff924f82eae800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788891160.453862:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788891160.453864:0:20984:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788891160.453871:0:20984:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788891160.453948:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997442944:0@lo:9:umount.0 00000100:00100000:2.0:1788891160.454200:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891160.454262:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997442944 00000100:00100000:2.0:1788891160.454269:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997442944 00000100:00100000:2.0:1788891160.454338:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788891160.454347:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875787997442944:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788891160.454371:0:18613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd540a0 00000100:00080000:3.0:1788891160.454376:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788891160.454378:0:18613:0:(import.c:65:import_set_state_nolock()) ffff924f81f18000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788891160.454396:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788891160.454416:0:18613:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788891160.454557:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3626:x1875787997442944:12345-0@lo:9:umount.0 Request processed in 210us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891160.454564:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1788891160.454581:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f82eae800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788891160.454581:0:20984:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000004:00080000:3.0:1788891160.454588:0:3626:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788891160.454590:0:3626:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788891160.454591:0:20984:0:(import.c:65:import_set_state_nolock()) ffff925086eaf800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788891160.454593:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997442944:0@lo:9:umount.0 00000100:00100000:3.0:1788891160.454609:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997443072:0@lo:9:umount.0 00000020:00080000:2.0:1788891160.454632:0:20984:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff925091ac8000) has no exports 00000100:00100000:3.0:1788891160.454635:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891160.454665:0:20352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997443072 00000100:00100000:0.0:1788891160.454670:0:20352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997443072 00000100:00080000:3.0:1788891160.454715:0:17105:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788891160.454726:0:20352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788891160.454735:0:20352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1875787997443072:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788891160.454748:0:20352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd54221 00000100:00080000:0.0:1788891160.454753:0:20352:0:(import.c:65:import_set_state_nolock()) ffff924f81ecb000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788891160.454787:0:20352:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00010000:00010000:3.0:1788891160.454825:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891160.454891:0:20352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3626:x1875787997443072:12345-0@lo:9:umount.0 Request processed in 157us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891160.454898:0:20352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788891160.454943:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925086eaf800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788891160.454955:0:3626:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788891160.454957:0:3626:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788891160.454971:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997443072:0@lo:9:umount.0 00000020:00000080:2.0:1788891160.455580:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f83372800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1788891160.455634:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f8238c000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788891160.455669:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f83375000 for lustre-MDT0001 00000020:00000080:2.0:1788891160.455674:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f82389800 for lustre-MDT0001 00010000:00010000:3.0:1788891160.459601:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891160.461691:0:20136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3629:x1875787997442304:12345-0@lo:103:ldlm_bl.0 Request processed in 14063us (14322us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788891160.461706:0:20136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788891160.464378:0:3629:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.126@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788891160.464383:0:3629:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788891160.464503:0:3629:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f8318d500 x1875787997442304/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788891176 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891160.464517:0:3629:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f833d2a00 x1875787997442688/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788891176 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891160.464551:0:3629:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f833d0000 x1875787997442816/t0(0) o103->MGC192.168.204.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788891176 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788891160.464564:0:3629:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788891160.464568:0:3629:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788891160.464569:0:3629:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788891160.464573:0:3629:0:(import.c:65:import_set_state_nolock()) ffff924f83997800 MGS: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788891160.464706:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:189d2e4e-bf9f-4645-ba04-f80564b97077:0:1875787997442432:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788891160.464733:0:3629:0:(import.c:510:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 314 00000100:00080000:1.0:1788891160.464742:0:3629:0:(import.c:624:import_select_connection()) MGC192.168.204.126@tcp: import ffff924f83997800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891160.464805:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997439488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788891160.464878:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:189d2e4e-bf9f-4645-ba04-f80564b97077:0:1875787997442560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788891160.465365:0:3629:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9250bf73b100 x1875787997443200/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788891160.465421:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997442688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788891160.465431:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997442304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788891160.465446:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:189d2e4e-bf9f-4645-ba04-f80564b97077:3629:1875787997442816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891160.466260:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:189d2e4e-bf9f-4645-ba04-f80564b97077:3626:1875787997443200:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1788891160.466311:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875787997443200 offset 0 length 520: 4 00000020:00080000:2.0:1788891160.469936:0:20984:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff925091ac8000) has no exports 00000020:01000000:0.0:1788891160.502289:0:20984:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff924f833c33c0 - data ffff9250bf880ca8/ffff9250c1422800 00000020:01000000:0.0:1788891160.502460:0:20984:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff924f81f5a420 - data ffff9250b09a2d80/ffff925085c3a800 00000001:00000004:0.0:1788891160.511935:0:20984:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:1.0:1788891160.543802:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788891160.543818:0:20984:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788891160.543826:0:20984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788891160.545039:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788891160.545044:0:20984:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1788891160.545105:0:20984:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788891160.545108:0:20984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788891160.545409:0:17849:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788891160.545414:0:17849:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:2.0:1788891160.545424:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788891160.547364:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788891160.547370:0:20984:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1788891160.547481:0:20984:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788891160.547485:0:20984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788891160.547863:0:17851:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788891160.547868:0:17851:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1788891160.547876:0:17851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788891160.549300:0:20984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53f26 00000020:00000080:1.0:1788891160.549311:0:20984:0:(genops.c:885:class_export_put()) final put ffff924f82eaf800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788891160.549969:0:20984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53f3b 00000020:00000080:1.0:1788891160.549975:0:20984:0:(genops.c:885:class_export_put()) final put ffff925083393000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788891160.550289:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f82eaf800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788891160.550358:0:20984:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788891160.550364:0:20984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891160.550373:0:20984:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788891160.550377:0:20984:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9250bf678000) has no exports 00000004:01000000:1.0:1788891160.550552:0:20984:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788891160.550559:0:20984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53f8f 00000020:00000080:1.0:1788891160.550563:0:20984:0:(genops.c:885:class_export_put()) final put ffff925086f08000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788891160.550639:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff925083393000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788891160.550700:0:20984:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788891160.550705:0:20984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891160.550710:0:20984:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788891160.550713:0:20984:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff925091ac99b8) has no exports 00000020:00000080:1.0:1788891160.550718:0:20984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53f88 00000020:00000080:1.0:1788891160.550723:0:20984:0:(genops.c:885:class_export_put()) final put ffff925086ead000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788891160.550740:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff925086f08000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788891160.551265:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff925086ead000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788891160.551347:0:20984:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788891160.551351:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788891160.551355:0:20984:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788891160.551361:0:20984:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788891160.551363:0:20984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788891160.551538:0:20984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788891160.551545:0:20984:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788891160.551553:0:20984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53f7a 00000020:00000080:1.0:1788891160.551559:0:20984:0:(genops.c:885:class_export_put()) final put ffff925086ea4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788891160.551606:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff925086eaf800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788891160.551614:0:467:0:(genops.c:885:class_export_put()) final put ffff925086ea6000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788891160.551617:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff925086ea6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1788891160.551621:0:467:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788891160.551804:0:20984:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788891160.551809:0:20984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891160.551814:0:20984:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788891160.551817:0:20984:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9250baa699b8) has no exports 00000020:00000080:1.0:1788891160.551821:0:20984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53f6c 00000020:00000080:1.0:1788891160.551825:0:20984:0:(genops.c:885:class_export_put()) final put ffff924f82eaa000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788891160.551898:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff925086ea4000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:1.0:1788891160.552363:0:20984:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788891160.552366:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788891160.552369:0:20984:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788891160.552373:0:20984:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788891160.552374:0:20984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788891160.552459:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f82eaa000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788891160.552557:0:20984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788891160.552563:0:20984:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788891160.552575:0:20984:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788891160.552581:0:20984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53f5e 00000020:00000080:1.0:1788891160.552586:0:20984:0:(genops.c:885:class_export_put()) final put ffff924f82eae000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788891160.552626:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f82eae800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788891160.552632:0:467:0:(genops.c:885:class_export_put()) final put ffff924f81eda000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788891160.552635:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81eda000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1788891160.552639:0:467:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788891160.552742:0:20984:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788891160.552747:0:20984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891160.552752:0:20984:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788891160.552755:0:20984:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9250baa68000) has no exports 00000020:00000080:1.0:1788891160.552810:0:20984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53f57 00000020:00000080:1.0:1788891160.552816:0:20984:0:(genops.c:885:class_export_put()) final put ffff924f81edb800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788891160.552832:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f82eae000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788891160.552903:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81edb800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788891160.557612:0:20984:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788891160.557631:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788891160.557635:0:20984:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788891160.557642:0:20984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788891160.557709:0:20984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891160.557723:0:20984:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788891160.557752:0:20984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891160.557756:0:20984:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788891160.557775:0:20984:0:(genops.c:885:class_export_put()) final put ffff925083391800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788891160.557780:0:20984:0:(genops.c:844:class_export_destroy()) destroying export ffff925083391800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788891160.557787:0:20984:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788891160.557956:0:20984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53f42 00000020:00000080:2.0:1788891160.557962:0:20984:0:(genops.c:885:class_export_put()) final put ffff925083396800/lustre-MDD0001_UUID 00000020:01000000:2.0:1788891160.557967:0:20984:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788891160.557970:0:20984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788891160.557975:0:20984:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788891160.557978:0:20984:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff925091accd28) has no exports 00000020:00000080:2.0:1788891160.557995:0:20984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891160.557998:0:20984:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788891160.558002:0:20984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53f49 00000020:00000080:2.0:1788891160.558006:0:20984:0:(genops.c:885:class_export_put()) final put ffff924f82ea8800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788891160.558013:0:20984:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9250c12df800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788891160.558016:0:20984:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9250c12df800 2 00000020:01000004:2.0:1788891160.558019:0:20984:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9250c12df800 from lustre-MDT0001 00000020:00000080:2.0:1788891160.558037:0:20984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891160.558040:0:20984:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788891160.558043:0:20984:0:(genops.c:885:class_export_put()) final put ffff924f82ea9800/lustre-MDT0001_UUID 00000020:00000080:2.0:1788891160.558045:0:20984:0:(genops.c:844:class_export_destroy()) destroying export ffff924f82ea9800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788891160.558052:0:20984:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788891160.558080:0:20984:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788891160.558083:0:20984:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788891160.558086:0:20984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788891160.558089:0:20984:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788891160.558100:0:20984:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff925086ea4800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788891160.558105:0:20984:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9250b71799b8) has exports, disconnecting them 00000020:00080000:2.0:1788891160.558109:0:20984:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff925086ea4800), last request at 1788891101 00000020:00000080:2.0:1788891160.558113:0:20984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53fc7 00000020:00080000:2.0:1788891160.558125:0:20984:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff925086ea4800): rc 0 00000020:00000080:2.0:1788891160.558129:0:20984:0:(genops.c:885:class_export_put()) final put ffff925086ea4800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788891160.558245:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f81edd000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788891160.558254:0:467:0:(genops.c:885:class_export_put()) final put ffff924f81ede000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788891160.558257:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81ede000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788891160.558269:0:467:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788891160.558354:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff925083396800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788891160.558358:0:467:0:(genops.c:885:class_export_put()) final put ffff924f82ea9000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788891160.558359:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f82ea9000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788891160.558363:0:467:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788891160.558478:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f82ea8800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788891160.558482:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff925086ea4800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788891160.561647:0:20984:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788891160.561655:0:20984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788891160.561660:0:20984:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788891160.561666:0:20984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788891160.561691:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92508744d000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788891160.561876:0:20984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891160.561894:0:20984:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788891160.561905:0:20984:0:(genops.c:885:class_export_put()) final put ffff924f83869800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788891160.561909:0:20984:0:(genops.c:844:class_export_destroy()) destroying export ffff924f83869800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788891160.561915:0:20984:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788891160.561980:0:20984:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9250c12df800 1 00000020:00000080:3.0:1788891160.561985:0:20984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53eee 00000020:00000080:3.0:1788891160.561991:0:20984:0:(genops.c:885:class_export_put()) final put ffff9250bf76c800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788891160.561999:0:20984:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788891160.562007:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff9250bf76c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788891160.562016:0:20984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891160.562020:0:20984:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788891160.562024:0:20984:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9250b717cd28) has no exports 00000020:00000080:2.0:1788891160.591335:0:20984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891160.591349:0:20984:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1788891160.591355:0:20984:0:(genops.c:885:class_export_put()) final put ffff9250c12d8000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788891160.591360:0:20984:0:(genops.c:844:class_export_destroy()) destroying export ffff9250c12d8000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1788891160.591371:0:20984:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1788891160.591484:0:20984:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9250c12d9000 00000020:01000000:2.0:1788891160.591503:0:20984:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788891160.591506:0:20984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788891160.591511:0:20984:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788891160.591514:0:20984:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff924f81ed3370) has no exports 00000100:00100000:3.0:1788891160.593953:0:20411:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff924f82d38600:20411] 4 exiting: rc = 0 00000100:00100000:2.0:1788891160.593959:0:17111:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff924f822dfc00:17111] 2 exiting: rc = 0 00000100:00100000:1.0:1788891160.594094:0:18639:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff924f82c0ea00:18639] 3 exiting: rc = 0 00000100:00100000:0.0:1788891160.594262:0:17110:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff924f822df600:17110] 1 exiting: rc = 0 00000100:00100000:1.0:1788891160.594491:0:17109:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff925090569000:17109] 0 exiting: rc = 1 00000100:00100000:2.0:1788891160.594961:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.594970:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.594977:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.594983:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.594989:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.594995:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595001:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595009:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595015:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595021:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595026:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595032:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595038:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595043:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595050:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595067:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595073:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595079:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595085:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595091:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595096:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595102:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595109:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595114:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595120:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595126:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595131:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595136:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595142:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595147:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595152:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595157:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595162:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595168:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595174:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595180:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595186:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595191:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595199:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595205:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595221:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595230:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595235:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595311:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595321:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595328:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595333:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595339:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595345:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595350:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595365:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595370:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595376:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595381:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595386:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595392:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595397:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595402:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595407:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595413:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595419:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595426:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595431:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.595438:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891160.603766:0:17113:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff924f822da600:17113] 1 exiting: rc = 0 00000100:00100000:2.0:1788891160.603981:0:17112:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff924f81735a00:17112] 0 exiting: rc = 1 00000100:00100000:3.0:1788891160.604121:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604129:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604135:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604142:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604148:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604155:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604160:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604165:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604175:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604180:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604185:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604190:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604195:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604200:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604205:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604220:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604226:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604232:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604237:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604242:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604260:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604266:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604271:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604277:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604284:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604289:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604294:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604299:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604305:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604311:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604317:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604321:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604327:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604332:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604337:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604342:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604347:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604354:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604359:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604364:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604370:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604376:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604381:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604387:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604393:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604398:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604404:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604410:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604415:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604421:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604427:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604432:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604437:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604443:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604448:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604459:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604464:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604469:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604474:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604479:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604484:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604489:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604499:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604506:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.604906:0:17934:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff924f8229b600:17934] 2 exiting: rc = 0 00000100:00100000:3.0:1788891160.604966:0:17115:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9250c130dc00:17115] 1 exiting: rc = 0 00000100:00100000:2.0:1788891160.605077:0:17114:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9250c130d000:17114] 0 exiting: rc = 1 00000100:00100000:3.0:1788891160.605277:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605285:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605307:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605314:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605320:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605327:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605334:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605339:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605346:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605352:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605357:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605363:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605369:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605376:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605395:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605402:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605409:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605414:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605420:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605426:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605432:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605438:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605444:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605451:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605465:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605472:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605490:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605497:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605503:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605509:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605514:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605613:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605621:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605627:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605633:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605639:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605644:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605649:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605670:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605676:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605682:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605687:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605692:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605698:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605703:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605707:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605713:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605718:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605724:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605729:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605747:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605753:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605759:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605764:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605770:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605775:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605781:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605787:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605792:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605805:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605810:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605815:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605820:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.605825:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891160.617520:0:17116:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff924f822db800:17116] 0 exiting: rc = 1 00000100:00100000:1.0:1788891160.617597:0:17117:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9250c130c600:17117] 1 exiting: rc = 0 00000100:00100000:2.0:1788891160.617642:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617651:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617659:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617665:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617670:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617676:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617681:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617689:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617702:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617711:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617721:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617726:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617730:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617734:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617737:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617740:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617744:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617747:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617750:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617769:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617774:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617781:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617788:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617795:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617802:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617808:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617966:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617977:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617984:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617990:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.617997:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618006:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618015:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618025:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618035:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618041:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618046:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618052:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618056:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618061:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618066:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618071:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618086:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618121:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618146:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618153:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618160:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618168:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618176:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618183:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618190:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618197:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618204:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618223:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618239:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618245:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618250:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618255:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618260:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618264:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618270:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618274:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618279:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.618284:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891160.618802:0:17118:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9250c10d6400:17118] 0 exiting: rc = 1 00000100:00100000:3.0:1788891160.618920:0:17119:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9250b669d200:17119] 1 exiting: rc = 0 00000100:00100000:2.0:1788891160.619033:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619042:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619049:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619056:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619065:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619077:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619087:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619094:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619100:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619110:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619173:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619180:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619188:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619194:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619202:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619218:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619226:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619234:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619240:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619246:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619252:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619260:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619264:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619269:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619274:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619287:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619292:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619297:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619303:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619308:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619314:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619319:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619323:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619328:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619332:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619338:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619343:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619348:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619353:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619358:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619363:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619368:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619373:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619380:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619388:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619395:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619402:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619410:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619417:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619423:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619429:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619436:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619443:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619450:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619457:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619464:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619475:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619486:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619495:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619501:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619646:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619657:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619664:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.619670:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891160.620182:0:17120:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff925086a40200:17120] 0 exiting: rc = 1 00000100:00100000:3.0:1788891160.620314:0:17121:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9250b669da00:17121] 1 exiting: rc = 0 00000100:00100000:2.0:1788891160.620425:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620433:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620440:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620448:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620454:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620461:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620469:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620478:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620485:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620492:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620500:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620507:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620514:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620629:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620640:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620647:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620654:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620661:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620669:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620676:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620684:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620691:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620698:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620705:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620713:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620719:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620726:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620734:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620742:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620749:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620756:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620771:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620778:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620789:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620800:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620811:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620816:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620821:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620834:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620839:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620844:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620848:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620853:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620858:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620863:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620868:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620873:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620878:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620883:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620889:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620894:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620899:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620904:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620970:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620979:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620986:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.620995:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.621002:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.621009:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.621015:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.621021:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.621028:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.621033:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.621039:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891160.621788:0:17122:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9250b669d400:17122] 0 exiting: rc = 1 00000100:00100000:3.0:1788891160.621977:0:17123:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff924f8326fe00:17123] 1 exiting: rc = 0 00000100:00100000:3.0:1788891160.622137:0:17124:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9250b6708800:17124] 2 exiting: rc = 0 00000100:00100000:2.0:1788891160.622259:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622266:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622283:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622289:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622296:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622319:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622326:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622333:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622338:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622344:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622350:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622355:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622361:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622367:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622372:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622377:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622382:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622388:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622393:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622399:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622404:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622410:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622416:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622421:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622426:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622432:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622438:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622443:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622448:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622467:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622474:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622479:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622486:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622493:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622498:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622504:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622510:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622619:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622625:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622631:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622637:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622642:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622648:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622656:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622662:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622667:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622673:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622679:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622685:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622690:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622695:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622701:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622707:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622729:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622736:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622742:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622747:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622753:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622758:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622763:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622769:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622774:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622780:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891160.622785:0:20984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788891160.628354:0:20984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891160.628366:0:20984:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788891160.628373:0:20984:0:(genops.c:885:class_export_put()) final put ffff924f83990000/MDS_uuid 00000020:00000080:2.0:1788891160.628377:0:20984:0:(genops.c:844:class_export_destroy()) destroying export ffff924f83990000/MDS_uuid for MDS 00000020:01000000:2.0:1788891160.628387:0:20984:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788891160.628620:0:20984:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788891161.148939:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891162.171618:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788891162.748272:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 189d2e4e-bf9f-4645-ba04-f80564b97077->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788891162.748280:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 189d2e4e-bf9f-4645-ba04-f80564b97077->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788891162.748283:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788891162.748287:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788891162.748291:0:37:0:(import.c:65:import_set_state_nolock()) ffff924f8238b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891162.748299:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 379 00000100:00080000:0.0:1788891162.748304:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788891162.748311:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff924f8238b000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891162.748350:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f8318ca80 x1875787997443328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788891162.748422:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788891162.748426:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788891162.748428:0:37:0:(import.c:65:import_set_state_nolock()) ffff925087571000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891162.748432:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 379 00000100:00080000:0.0:1788891162.748435:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788891162.748439:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff925087571000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891162.748453:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f8318ea00 x1875787997443584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788891162.748454:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788891162.748475:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997443456:0@lo:400:kworker.0 00000400:00000100:3.0:1788891162.748549:0:3628:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875787997443456 offset 0 length 224: 4 00000100:00100000:3.0:1788891162.748604:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1875787997443712:0@lo:400:kworker.0 00000400:00000100:3.0:1788891162.748621:0:3628:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875787997443712 offset 0 length 224: 4 00000100:00100000:2.0:1788891162.748745:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1875787997443328:0@lo:38:kworker.0 00000400:00000100:2.0:1788891162.748766:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875787997443328 offset 0 length 520: 4 00000100:00100000:2.0:1788891162.748788:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1875787997443584:0@lo:38:kworker.0 00000400:00000100:2.0:1788891162.748798:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875787997443584 offset 0 length 520: 4 00000020:01000004:1.0:1788891163.116973:0:21185:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788891163.127324:0:21185:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788891163.127447:0:21185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54061 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54068 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891163.127461:0:21185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54061 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54068 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891163.127468:0:21185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54061 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd54068 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891163.127474:0:21185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54061 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd54068 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891163.127954:0:21185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788891163.127960:0:21185:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788891163.128074:0:21185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788891163.128085:0:21185:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f8318ca80 x1875787997443328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788891182 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891163.128150:0:21185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788891163.128157:0:21185:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788891163.128174:0:21185:0:(import.c:65:import_set_state_nolock()) ffff924f8238b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788891163.128179:0:21185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788891163.128184:0:21185:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f8318ca80 x1875787997443328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788891182 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788891163.128233:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788891163.128237:0:21185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00010000:00010000:0.0:1788891163.128247:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54061 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd54068 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891163.128255:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8aa00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:0.0:1788891163.128259:0:17097:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54061 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd54068 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891163.128260:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1875787997443328:0@lo:38:kworker.0 00010000:00010000:0.0:1788891163.128275:0:17097:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd54068 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788891163.128283:0:17097:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd54068 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891163.128289:0:17097:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788891163.128292:0:17097:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788891163.128295:0:17097:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788891163.128310:0:17097:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff924f83997800 00010000:00010000:0.0:1788891163.128315:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54061 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd54068 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891163.128319:0:21185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788891163.128325:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54061 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd54068 expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891163.128336:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891163.128337:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891163.128339:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788891163.129442:0:21185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788891163.129454:0:21185:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f8318f480 x1875787997443456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891178 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891163.129557:0:21185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788891163.129563:0:21185:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788891163.129586:0:21185:0:(import.c:65:import_set_state_nolock()) ffff924f81f1d000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788891163.129654:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3626:1875787997443840:0@lo:39:umount.0 00000400:00000100:2.0:1788891163.129705:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875787997443840 offset 0 length 224: 4 00000100:00100000:3.0:1788891163.129809:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997443456:0@lo:400:kworker.0 00010000:00010000:3.0:1788891163.195677:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891164.219654:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891165.243746:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788891165.756317:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 189d2e4e-bf9f-4645-ba04-f80564b97077->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788891165.756332:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 189d2e4e-bf9f-4645-ba04-f80564b97077->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788891165.756336:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788891165.756340:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788891165.756511:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788891165.756554:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997443968:0@lo:400:kworker.0 00000400:00000100:0.0:1788891165.756627:0:3630:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875787997443968 offset 0 length 224: 4 00000001:00100000:2.0:1788891165.822062:0:19431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788891165.822074:0:19431:0:(genops.c:885:class_export_put()) final put ffff924f81ece800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788891165.822236:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81ece800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788891165.822432:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f81ecb000 for lustre-OST0001 00010000:00010000:3.0:1788891166.267697:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788891166.845204:0:18610:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788891166.845213:0:18610:0:(genops.c:885:class_export_put()) final put ffff924f81f19000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788891166.845417:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81f19000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788891166.845479:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f81f18000 for lustre-OST0000 00010000:00010000:3.0:1788891167.292206:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788891167.806979:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) 189d2e4e-bf9f-4645-ba04-f80564b97077->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788891167.806997:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) 189d2e4e-bf9f-4645-ba04-f80564b97077->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788891167.807000:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788891167.807004:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788891167.807129:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997444096:0@lo:400:kworker.0 00000400:00000100:3.0:1788891167.807189:0:3630:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875787997444096 offset 0 length 224: 4 00010000:00010000:0.0:1788891168.315821:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891169.341543:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891170.299666:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891160/real 1788891160] req@ffff9250bf73b100 x1875787997443200/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788891170 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891170.299702:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9250bf73b100 x1875787997443200/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788891170 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788891170.299722:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f83997800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788891170.300064:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788891170.300070:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:189d2e4e-bf9f-4645-ba04-f80564b97077:3626:1875787997443200:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1788891170.300172:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 189d2e4e-bf9f-4645-ba04-f80564b97077->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788891170.300177:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788891170.300181:0:37:0:(import.c:65:import_set_state_nolock()) ffff924f83997800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788891170.300186:0:37:0:(import.c:510:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 382 00000100:00080000:1.0:1788891170.300191:0:37:0:(import.c:589:import_select_connection()) MGC192.168.204.126@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788891170.300197:0:37:0:(import.c:624:import_select_connection()) MGC192.168.204.126@tcp: import ffff924f83997800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891170.300231:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f833d2680 x1875787997444224/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788891170.300262:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788891170.300267:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788891170.300439:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997444352:0@lo:400:kworker.0 00000400:00000100:0.0:1788891170.300493:0:3627:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875787997444352 offset 0 length 224: 4 00000100:00100000:2.0:1788891170.300723:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:189d2e4e-bf9f-4645-ba04-f80564b97077:3626:1875787997444224:0@lo:250:kworker.0 00000400:00000100:2.0:1788891170.300759:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875787997444224 offset 0 length 520: 4 00010000:00010000:3.0:1788891170.363677:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891171.388034:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891172.414089:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891173.371809:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891163/real 1788891163] req@ffff924f833d1c00 x1875787997443840/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788891173 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891173.371840:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff924f833d1c00 x1875787997443840/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788891173 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788891173.371859:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f81f1d000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788891173.371942:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3626:1875787997443840:0@lo:39:umount.0 00000100:00080000:1.0:1788891173.372662:0:21185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788891173.372668:0:21185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788891173.372673:0:21185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788891173.374243:0:21185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82311800/0xa66601b03fd54037 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5403e expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891173.374262:0:21185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82311800/0xa66601b03fd54037 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd5403e expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891173.374269:0:21185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82311800/0xa66601b03fd54037 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd5403e expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891173.374276:0:21185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff924f82311800/0xa66601b03fd54037 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd5403e expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891173.374306:0:21185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891173.374331:0:21185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250857de400/0xa66601b03fd5438d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54394 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891173.374338:0:21185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250857de400/0xa66601b03fd5438d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54394 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891173.374344:0:21185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250857de400/0xa66601b03fd5438d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd54394 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891173.374351:0:21185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff9250857de400/0xa66601b03fd5438d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd54394 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891173.374626:0:21185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788891173.374631:0:21185:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788891173.374657:0:21185:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788891173.374662:0:21185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788891173.374667:0:21185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891173.374672:0:21185:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788891173.374677:0:21185:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9250baa6cd28) has no exports 00000020:00080000:1.0:1788891173.374701:0:21185:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9250baa6cd28) has no exports 00010000:00010000:0.0:1788891173.375665:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788891173.375676:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff924f82311800/0xa66601b03fd54037 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd5403e expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891173.375686:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311800 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:0.0:1788891173.375689:0:17097:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff924f82311800/0xa66601b03fd54037 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd5403e expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891173.375699:0:17097:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff924f82311800/0xa66601b03fd54037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd5403e expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788891173.375707:0:17097:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff924f82311800/0xa66601b03fd54037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd5403e expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891173.375713:0:17097:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788891173.375715:0:17097:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788891173.375718:0:17097:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788891173.375738:0:17097:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff924f83997800 00010000:00010000:0.0:1788891173.375743:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff924f82311800/0xa66601b03fd54037 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd5403e expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891173.375765:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff924f82311800/0xa66601b03fd54037 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd5403e expref: -99 pid: 18609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891173.375779:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891173.375783:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250857de400/0xa66601b03fd5438d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd54394 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891173.375788:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250857de400 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:0.0:1788891173.375791:0:17097:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250857de400/0xa66601b03fd5438d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd54394 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891173.375798:0:17097:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250857de400/0xa66601b03fd5438d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd54394 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788891173.375804:0:17097:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250857de400/0xa66601b03fd5438d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd54394 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891173.375809:0:17097:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788891173.375811:0:17097:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788891173.375813:0:17097:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788891173.376004:0:17097:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff924f83997800 00010000:00010000:0.0:1788891173.376009:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250857de400/0xa66601b03fd5438d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd54394 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891173.376014:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250857de400/0xa66601b03fd5438d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd54394 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891173.376024:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891173.376026:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891173.376034:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891173.376444:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788891173.377949:0:21185:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9250c1186840 - data ffff924f8193b000/ffff925086f6cc00 00000020:01000000:1.0:1788891173.378229:0:21185:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9250900e40c0 - data ffff9250923ab0d8/ffff924f82238800 00100000:10000000:1.0:1788891173.389370:0:21185:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788891173.398854:0:21185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd5404c 00000020:00000080:2.0:1788891173.398865:0:21185:0:(genops.c:885:class_export_put()) final put ffff925086eac800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788891173.398915:0:21185:0:(tgt_mount.c:187:server_put_mount()) put mount ffff925086f0e000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788891173.398920:0:21185:0:(obd_mount.c:710:lustre_put_lsi()) put ffff925086f0e000 2 00000020:01000004:2.0:1788891173.398923:0:21185:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff925086f0e000 from lustre-OST0000 00000020:00000080:2.0:1788891173.398947:0:21185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891173.398955:0:21185:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788891173.398968:0:21185:0:(genops.c:885:class_export_put()) final put ffff925086eab000/lustre-OST0000_UUID 00000020:00000080:2.0:1788891173.398971:0:21185:0:(genops.c:844:class_export_destroy()) destroying export ffff925086eab000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788891173.398977:0:21185:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788891173.399022:0:21185:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788891173.399026:0:21185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788891173.399029:0:21185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788891173.399034:0:21185:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788891173.399040:0:21185:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff924f8238d800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788891173.399046:0:21185:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff925090b23370) has exports, disconnecting them 00000020:00080000:2.0:1788891173.399051:0:21185:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff924f8238d800), last request at 1788891111 00000020:00000080:2.0:1788891173.399054:0:21185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd54076 00000020:00080000:2.0:1788891173.399064:0:21185:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff924f8238d800): rc 0 00000020:00000080:2.0:1788891173.399068:0:21185:0:(genops.c:885:class_export_put()) final put ffff924f8238d800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788891173.399242:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff925086eac800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788891173.400222:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f8238d800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788891173.400279:0:21185:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788891173.400284:0:21185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788891173.400288:0:21185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788891173.400293:0:21185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788891173.400551:0:21185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891173.400558:0:21185:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788891173.400564:0:21185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788891173.400568:0:21185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891173.400571:0:21185:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788891173.400577:0:21185:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff924f81f1a000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788891173.400592:0:21185:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9250bac2cd28) has exports, disconnecting them 00000020:00080000:3.0:1788891173.400597:0:21185:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff924f81f1a000), last request at 1788891111 00000020:00000080:3.0:1788891173.400607:0:21185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd5408b 00000020:00080000:3.0:1788891173.400619:0:21185:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff924f81f1a000): rc 0 00000020:00000080:3.0:1788891173.400624:0:21185:0:(genops.c:885:class_export_put()) final put ffff924f81f1a000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788891173.400656:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f8238b000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788891173.400664:0:37:0:(genops.c:885:class_export_put()) final put ffff924f8238b800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788891173.400666:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f8238b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788891173.400674:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788891173.401041:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81f1a000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1788891173.405619:0:21185:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788891173.405628:0:21185:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788891173.405636:0:21185:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788891173.405644:0:21185:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788891173.405674:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f81f1d000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788891173.405841:0:21185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891173.405850:0:21185:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1788891173.405855:0:21185:0:(genops.c:885:class_export_put()) final put ffff92509df7f000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1788891173.405859:0:21185:0:(genops.c:844:class_export_destroy()) destroying export ffff92509df7f000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1788891173.405865:0:21185:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1788891173.405927:0:21185:0:(obd_mount.c:710:lustre_put_lsi()) put ffff925086f0e000 1 00000020:00000080:0.0:1788891173.405933:0:21185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd54029 00000020:00000080:0.0:1788891173.405939:0:21185:0:(genops.c:885:class_export_put()) final put ffff9250875b1800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788891173.405947:0:21185:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788891173.405954:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9250875b1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788891173.405976:0:21185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788891173.405982:0:21185:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788891173.405985:0:21185:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9250baa6b370) has no exports 00000020:00000080:0.0:1788891173.434623:0:21185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891173.434637:0:21185:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788891173.434648:0:21185:0:(genops.c:885:class_export_put()) final put ffff925086f0a800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788891173.434654:0:21185:0:(genops.c:844:class_export_destroy()) destroying export ffff925086f0a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788891173.434665:0:21185:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788891173.434789:0:21185:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff925086f08800 00000020:02000400:0.0:1788891173.434833:0:21185:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788891173.442294:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891174.460447:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891175.488419:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788891175.547688:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 189d2e4e-bf9f-4645-ba04-f80564b97077->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788891175.547695:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 189d2e4e-bf9f-4645-ba04-f80564b97077->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788891175.547698:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788891175.547701:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788891175.547778:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788891175.547797:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997444480:0@lo:400:kworker.0 00000400:00000100:0.0:1788891175.547852:0:3627:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875787997444480 offset 0 length 224: 4 00000020:01000004:2.0:1788891175.573108:0:21389:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788891175.584035:0:21389:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788891175.584121:0:21389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82311400/0xa66601b03fd541bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd541c6 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891175.584137:0:21389:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82311400/0xa66601b03fd541bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd541c6 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891175.584173:0:21389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff924f82311400/0xa66601b03fd541bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd541c6 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891175.584180:0:21389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff924f82311400/0xa66601b03fd541bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd541c6 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891175.584204:0:21389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788891175.584209:0:21389:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788891175.584241:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788891175.584255:0:21389:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f8318ea00 x1875787997443584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788891182 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891175.584276:0:21389:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788891175.584283:0:21389:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788891175.584290:0:21389:0:(import.c:65:import_set_state_nolock()) ffff925087571000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788891175.584295:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788891175.584300:0:21389:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f8318ea00 x1875787997443584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788891182 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891175.584307:0:21389:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00010000:00010000:3.0:1788891175.584342:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891175.584350:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff924f82311400/0xa66601b03fd541bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd541c6 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891175.584360:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f82311400 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:3.0:1788891175.584363:0:19132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff924f82311400/0xa66601b03fd541bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd541c6 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891175.584372:0:19132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff924f82311400/0xa66601b03fd541bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd541c6 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788891175.584380:0:19132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff924f82311400/0xa66601b03fd541bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd541c6 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891175.584386:0:19132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788891175.584389:0:19132:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788891175.584392:0:19132:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788891175.584405:0:19132:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff924f83997800 00010000:00010000:3.0:1788891175.584409:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff924f82311400/0xa66601b03fd541bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd541c6 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891175.584416:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff924f82311400/0xa66601b03fd541bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd541c6 expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891175.584436:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891175.584438:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891175.584440:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891175.584954:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1875787997443584:0@lo:38:kworker.0 00000100:00100000:1.0:1788891175.586856:0:21389:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788891175.589398:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788891175.589414:0:21389:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f8318dc00 x1875787997443712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891178 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891175.589432:0:21389:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f833d2300 x1875787997443968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891181 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891175.589451:0:21389:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f8318c700 x1875787997444096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891183 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891175.589460:0:21389:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f833d0380 x1875787997444352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891186 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891175.589487:0:21389:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f8318d180 x1875787997444480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891191 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891175.589495:0:21389:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788891175.589500:0:21389:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788891175.589540:0:21389:0:(import.c:65:import_set_state_nolock()) ffff924f81ec9800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788891175.589556:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997444096:0@lo:400:kworker.0 00000100:00100000:0.0:1788891175.589569:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997443968:0@lo:400:kworker.0 00000100:00100000:1.0:1788891175.589679:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997444480:0@lo:400:kworker.0 00000100:00100000:3.0:1788891175.589832:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3626:1875787997444608:0@lo:39:umount.0 00000100:00100000:2.0:1788891175.591986:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1875787997443712:0@lo:400:kworker.0 00000100:00100000:1.0:1788891175.592592:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3627:1875787997444352:0@lo:400:kworker.0 00000400:00000100:3.0:1788891175.592628:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875787997444608 offset 0 length 224: 4 00010000:00010000:1.0:1788891176.507754:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891177.533118:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891178.555669:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891179.580436:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891180.604968:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788891180.667652:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) 189d2e4e-bf9f-4645-ba04-f80564b97077->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788891180.667662:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) 189d2e4e-bf9f-4645-ba04-f80564b97077->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788891181.627675:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891182.653070:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891183.675795:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891184.699666:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891185.723772:0:17097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788891185.787607:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) 189d2e4e-bf9f-4645-ba04-f80564b97077->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788891185.787617:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) 189d2e4e-bf9f-4645-ba04-f80564b97077->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788891185.851660:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891175/real 1788891175] req@ffff924f833d3800 x1875787997444608/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788891185 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891185.851692:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff924f833d3800 x1875787997444608/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788891185 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891185.851704:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891170/real 1788891170] req@ffff924f833d2680 x1875787997444224/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788891185 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891185.851729:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff924f833d2680 x1875787997444224/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788891185 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788891185.851747:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f81ec9800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788891185.851778:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3626:1875787997444608:0@lo:39:umount.0 00000100:00080000:3.0:1788891185.851786:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f83997800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788891185.851813:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788891185.851817:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:189d2e4e-bf9f-4645-ba04-f80564b97077:3626:1875787997444224:0@lo:250:kworker.0 00000100:00080000:1.0:1788891185.851840:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788891185.851846:0:21389:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788891185.851851:0:21389:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788891185.852738:0:21389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd54195 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd5419c expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891185.852752:0:21389:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd54195 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd5419c expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891185.852759:0:21389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd54195 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd5419c expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891185.852780:0:21389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd54195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd5419c expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891185.852809:0:21389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891185.852816:0:21389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd5437f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54386 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891185.852823:0:21389:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd5437f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54386 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891185.852830:0:21389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd5437f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd54386 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891185.852836:0:21389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd5437f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa66601b03fd54386 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891185.852859:0:21389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788891185.852863:0:21389:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788891185.852886:0:21389:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788891185.852890:0:21389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788891185.852895:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891185.852900:0:21389:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788891185.852905:0:21389:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff925091acb370) has no exports 00010000:00010000:2.0:1788891185.852921:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:1.0:1788891185.852928:0:21389:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff925091acb370) has no exports 00010000:00010000:2.0:1788891185.852931:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd54195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd5419c expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891185.852952:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a000 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891185.852963:0:19132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd54195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd5419c expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891185.852973:0:19132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd54195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd5419c expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891185.852981:0:19132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd54195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd5419c expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891185.852987:0:19132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788891185.852990:0:19132:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788891185.852993:0:19132:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788891185.853007:0:19132:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff924f83997800 00010000:00010000:2.0:1788891185.853012:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd54195 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd5419c expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891185.853019:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8a000/0xa66601b03fd54195 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd5419c expref: -99 pid: 19430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891185.853033:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891185.853036:0:19132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd5437f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd54386 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891185.853041:0:19132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8ae00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891185.853045:0:19132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd5437f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa66601b03fd54386 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891185.853051:0:19132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd5437f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd54386 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891185.853057:0:19132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd5437f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd54386 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891185.853069:0:19132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788891185.853072:0:19132:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788891185.853074:0:19132:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788891185.853081:0:19132:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff924f83997800 00010000:00010000:2.0:1788891185.853084:0:19132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd5437f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd54386 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891185.853090:0:19132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd5437f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd54386 expref: -99 pid: 17106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891185.853102:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891185.853104:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891185.853106:0:19132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788891185.854583:0:21389:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff924f833c3ea0 - data ffff9250a0eb7288/ffff9250c1420000 00000100:00080000:0.0:1788891185.854694:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) 189d2e4e-bf9f-4645-ba04-f80564b97077->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788891185.854700:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788891185.854703:0:467:0:(import.c:65:import_set_state_nolock()) ffff924f83997800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891185.854710:0:467:0:(import.c:510:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 392 00000100:00080000:0.0:1788891185.854726:0:467:0:(import.c:589:import_select_connection()) MGC192.168.204.126@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788891185.854732:0:467:0:(import.c:624:import_select_connection()) MGC192.168.204.126@tcp: import ffff924f83997800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891185.854766:0:467:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f8318c700 x1875787997444736/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1788891185.855046:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891185.855122:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:189d2e4e-bf9f-4645-ba04-f80564b97077:3626:1875787997444736:0@lo:250:kworker.0 00000400:00000100:2.0:1788891185.855174:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875787997444736 offset 0 length 520: 4 00000020:01000000:1.0:1788891185.859101:0:21389:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9250900834e0 - data ffff9250b08ebbd0/ffff9250b4e55400 00100000:10000000:1.0:1788891185.871924:0:21389:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788891185.877466:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd541aa 00000020:00000080:0.0:1788891185.877479:0:21389:0:(genops.c:885:class_export_put()) final put ffff924f83104800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788891185.877512:0:21389:0:(tgt_mount.c:187:server_put_mount()) put mount ffff924f8238d000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788891185.877517:0:21389:0:(obd_mount.c:710:lustre_put_lsi()) put ffff924f8238d000 2 00000020:01000004:0.0:1788891185.877547:0:21389:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff924f8238d000 from lustre-OST0001 00000020:00000080:0.0:1788891185.877579:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891185.877589:0:21389:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788891185.877593:0:21389:0:(genops.c:885:class_export_put()) final put ffff925086ea2000/lustre-OST0001_UUID 00000020:00000080:0.0:1788891185.877597:0:21389:0:(genops.c:844:class_export_destroy()) destroying export ffff925086ea2000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788891185.877603:0:21389:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788891185.877705:0:21389:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 189d2e4e-bf9f-4645-ba04-f80564b97077->MGS 00010000:00010000:0.0:1788891185.877733:0:21389:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925081522c00/0xa66601b03fd53ef5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd53efc expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788891185.877746:0:21389:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925081522c00/0xa66601b03fd53ef5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd53efc expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891185.877753:0:21389:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788891185.877756:0:21389:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788891185.877760:0:21389:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788891185.877786:0:21389:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff924f83997800 00010000:00010000:0.0:1788891185.877790:0:21389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925081522c00/0xa66601b03fd53ef5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd53efc expref: -99 pid: 17840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891185.877806:0:21389:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd53de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa66601b03fd53deb expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788891185.877813:0:21389:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd53de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa66601b03fd53deb expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891185.877819:0:21389:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788891185.877821:0:21389:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788891185.877823:0:21389:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788891185.877840:0:21389:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff924f83997800 00010000:00010000:0.0:1788891185.877843:0:21389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925081523400/0xa66601b03fd53de4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa66601b03fd53deb expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788891185.877860:0:21389:0:(import.c:65:import_set_state_nolock()) ffff924f83997800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788891185.877864:0:21389:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788891185.877867:0:21389:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788891185.877869:0:21389:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788891185.877872:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788891185.877895:0:21389:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff924f8318c700 x1875787997444736/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788891205 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788891185.877912:0:21389:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788891185.877915:0:21389:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00000020:00000080:3.0:1788891185.877984:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f83104800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1788891185.878031:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:189d2e4e-bf9f-4645-ba04-f80564b97077:3626:1875787997444736:0@lo:250:kworker.0 10000000:01000000:0.0:1788891185.878145:0:21389:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788891185.878152:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd53dcf 00000020:00000080:0.0:1788891185.878157:0:21389:0:(genops.c:885:class_export_put()) final put ffff924f83993000/189d2e4e-bf9f-4645-ba04-f80564b97077 00000020:01000000:0.0:1788891185.878171:0:21389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.126@tcp (flags='') 00000020:00000080:0.0:1788891185.878176:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788891185.878181:0:21389:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.126@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788891185.878184:0:21389:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff924f81ed19b8) has no exports 00000020:00000080:3.0:1788891185.878230:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f83993000/189d2e4e-bf9f-4645-ba04-f80564b97077 for MGC192.168.204.126@tcp 10000000:01000000:3.0:1788891185.878256:0:17106:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788891185.878390:0:21389:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.126@tcp: client import never connected 00000100:00080000:0.0:1788891185.878393:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788891185.878395:0:21389:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788891185.878398:0:21389:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788891185.878399:0:21389:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788891185.878448:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891185.878453:0:21389:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.126@tcp (uuid 189d2e4e-bf9f-4645-ba04-f80564b97077) 00000020:01000000:0.0:1788891185.878459:0:21389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788891185.878462:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788891185.878465:0:21389:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788891185.878470:0:21389:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff925087572800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788891185.878475:0:21389:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9250b717b370) has exports, disconnecting them 00000020:00080000:0.0:1788891185.878485:0:21389:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff925087572800), last request at 1788891121 00000020:00000080:0.0:1788891185.878489:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd541d4 00000020:00080000:0.0:1788891185.878498:0:21389:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff925087572800): rc 0 00000020:00000080:0.0:1788891185.878503:0:21389:0:(genops.c:885:class_export_put()) final put ffff925087572800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788891185.878986:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f83997800 for MGC192.168.204.126@tcp 00000020:00000080:3.0:1788891185.878994:0:467:0:(genops.c:885:class_export_put()) final put ffff924f83992800/189d2e4e-bf9f-4645-ba04-f80564b97077 00000020:00000080:3.0:1788891185.878997:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f83992800/189d2e4e-bf9f-4645-ba04-f80564b97077 for MGC192.168.204.126@tcp 00000020:01000000:3.0:1788891185.879002:0:467:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.126@tcp (189d2e4e-bf9f-4645-ba04-f80564b97077) 00000020:00000080:3.0:1788891185.879242:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff925087572800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788891185.885664:0:21389:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788891185.885673:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788891185.885678:0:21389:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788891185.885743:0:21389:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788891185.886027:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891185.886035:0:21389:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788891185.886043:0:21389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788891185.886047:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788891185.886051:0:21389:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788891185.886058:0:21389:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff924f81ecc800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788891185.886065:0:21389:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff925090b20000) has exports, disconnecting them 00000020:00080000:2.0:1788891185.886070:0:21389:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff924f81ecc800), last request at 1788891121 00000020:00000080:2.0:1788891185.886083:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd541e9 00000020:00080000:2.0:1788891185.886099:0:21389:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff924f81ecc800): rc 0 00000020:00000080:2.0:1788891185.886104:0:21389:0:(genops.c:885:class_export_put()) final put ffff924f81ecc800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788891185.886596:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff925087571000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788891185.886605:0:467:0:(genops.c:885:class_export_put()) final put ffff9250ba968800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788891185.886608:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff9250ba968800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788891185.886614:0:467:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788891185.886677:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81ecc800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788891185.887643:0:21389:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788891185.887649:0:21389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788891185.887652:0:21389:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788891185.887658:0:21389:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788891185.887679:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff924f81ec9800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788891185.888879:0:17097:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788891185.889016:0:19132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788891185.889091:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788891185.889186:0:17093:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9250905bfc00:17093] 1 exiting: rc = 0 00000100:00100000:0.0:1788891185.901841:0:17092:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9250905be600:17092] 0 exiting: rc = 1 00000100:00100000:3.0:1788891185.902014:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.902518:0:20136:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff924f8218d600:20136] 3 exiting: rc = 0 00000100:00100000:0.0:1788891185.902619:0:17096:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff924f832a8c00:17096] 2 exiting: rc = 0 00000100:00100000:3.0:1788891185.902680:0:17095:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff924f832a8a00:17095] 1 exiting: rc = 0 00000100:00100000:3.0:1788891185.903047:0:17094:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff924f832a9200:17094] 0 exiting: rc = 1 00000100:00100000:3.0:1788891185.903111:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903135:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903142:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903151:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903158:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903163:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903169:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903175:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903180:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903185:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903273:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903280:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903286:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903292:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903297:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903302:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903307:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903312:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903318:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903323:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903328:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903333:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903338:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903343:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903348:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903352:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903357:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903362:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903368:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903373:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903378:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903383:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903388:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903393:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903398:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903403:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903415:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903420:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903426:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903431:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903438:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903442:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903447:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903452:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903456:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903461:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903465:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903470:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903474:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903479:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903484:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903490:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903494:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903500:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903505:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903509:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903515:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903520:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903550:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903557:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903565:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903570:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903575:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.903580:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788891185.905085:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891185.905097:0:21389:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788891185.905104:0:21389:0:(genops.c:885:class_export_put()) final put ffff924f81ece000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788891185.905108:0:21389:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81ece000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788891185.905114:0:21389:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788891185.905676:0:21389:0:(obd_mount.c:710:lustre_put_lsi()) put ffff924f8238d000 1 00000020:00000080:3.0:1788891185.905690:0:21389:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa66601b03fd5418e 00000020:00000080:3.0:1788891185.905697:0:21389:0:(genops.c:885:class_export_put()) final put ffff924f81f1b800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788891185.905752:0:21389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788891185.905756:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891185.905762:0:21389:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788891185.905765:0:21389:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff925090b219b8) has no exports 00000020:00000080:0.0:1788891185.909564:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff924f81f1b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788891185.939124:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891185.939140:0:21389:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788891185.939145:0:21389:0:(genops.c:885:class_export_put()) final put ffff924f8238e800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788891185.939150:0:21389:0:(genops.c:844:class_export_destroy()) destroying export ffff924f8238e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788891185.939161:0:21389:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788891185.939556:0:21389:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff924f8238a800 00000020:01000000:2.0:1788891185.939586:0:21389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788891185.939591:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788891185.939596:0:21389:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788891185.939600:0:21389:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9250bac28000) has no exports 00000020:00000080:2.0:1788891185.939624:0:21389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891185.939628:0:21389:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788891185.939631:0:21389:0:(genops.c:885:class_export_put()) final put ffff9250875b4800/OSS_uuid 00000020:00000080:2.0:1788891185.939634:0:21389:0:(genops.c:844:class_export_destroy()) destroying export ffff9250875b4800/OSS_uuid for OSS 00000020:01000000:2.0:1788891185.939638:0:21389:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788891185.939706:0:18613:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff925086e5a000:18613] 0 exiting: rc = 1 00000100:00100000:2.0:1788891185.939831:0:18616:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff925086f59600:18616] 2 exiting: rc = 0 00000100:00100000:2.0:1788891185.939884:0:18615:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff925086f59400:18615] 1 exiting: rc = 0 00000100:00100000:2.0:1788891185.939940:0:18720:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff924f820d0c00:18720] 3 exiting: rc = 0 00000100:00100000:0.0:1788891185.940298:0:20352:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff924f82d38200:20352] 4 exiting: rc = 0 00000100:00100000:2.0:1788891185.940472:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:1.0:1788891185.940478:0:17105:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788891185.940483:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940489:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940498:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940505:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940514:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940798:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940806:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940811:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940817:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940830:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940835:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940840:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940845:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940850:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940855:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940861:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940866:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940870:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940875:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940881:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940885:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940890:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940896:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940901:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940906:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940911:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940915:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940921:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940926:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940932:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940937:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940942:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940948:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940954:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940959:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940964:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940970:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940975:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940981:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940986:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940991:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.940996:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941001:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941006:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941019:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941025:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941031:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941037:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941042:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941047:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941052:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941058:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941062:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941067:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941073:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941078:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941083:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941088:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941093:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941098:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941104:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941109:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.941114:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.942191:0:18617:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff925086f59a00:18617] 0 exiting: rc = 1 00000100:00100000:3.0:1788891185.942207:0:18618:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff925086f58e00:18618] 1 exiting: rc = 0 00000100:00100000:0.0:1788891185.942298:0:20461:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff924f82021600:20461] 2 exiting: rc = 0 00000100:00100000:2.0:1788891185.942924:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.942932:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.942937:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.942943:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.942948:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.942954:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.942960:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.942965:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.942971:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.942977:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.942982:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.942987:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.942993:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.942998:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943003:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943008:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943024:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943029:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943034:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943040:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943045:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943050:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943055:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943060:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943066:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943071:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943076:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943082:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943088:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943093:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943098:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943103:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943108:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943113:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943118:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943124:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943129:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943134:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943139:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943145:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943150:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943155:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943160:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943165:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943170:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943176:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943181:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943186:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943191:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943196:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943201:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943216:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943221:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943226:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943231:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943237:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943242:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943248:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943253:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943259:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943265:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943270:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943276:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.943281:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.945088:0:18619:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9250908dc600:18619] 0 exiting: rc = 1 00000100:00100000:3.0:1788891185.945311:0:18621:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff925088b34e00:18621] 2 exiting: rc = 0 00000100:00100000:1.0:1788891185.945588:0:18620:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff925088b35c00:18620] 1 exiting: rc = 0 00000100:00100000:3.0:1788891185.945755:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945763:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945769:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945775:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945780:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945786:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945792:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945797:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945802:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945808:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945813:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945828:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945835:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945841:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945853:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945859:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945864:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945869:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945874:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945879:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945883:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945889:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945894:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945900:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945906:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945911:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945929:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945934:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945940:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945945:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945951:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945967:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945974:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945981:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945986:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945992:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.945997:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946003:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946008:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946014:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946019:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946026:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946032:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946037:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946043:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946049:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946055:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946061:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946066:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946072:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946077:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946083:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946088:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946094:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946100:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946107:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946122:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946137:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946152:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946158:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946164:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946175:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946181:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891185.946192:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.954446:0:18623:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff924f82324c00:18623] 1 exiting: rc = 0 00000100:00100000:0.0:1788891185.954514:0:18622:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff924f82325e00:18622] 0 exiting: rc = 1 00000100:00100000:0.0:1788891185.957607:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957615:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957620:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957624:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957629:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957633:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957638:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957642:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957647:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957652:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957656:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957665:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957672:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957677:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957682:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957687:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957692:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957697:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957703:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957722:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957732:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957737:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957753:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957758:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957762:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957767:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957772:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957776:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957784:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957791:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957798:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957806:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957814:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957826:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957830:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957836:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957842:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957847:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957851:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957855:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957860:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957864:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957868:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957873:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957878:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957883:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957887:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957891:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957896:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957901:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957907:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957911:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957915:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957920:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957925:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957930:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957934:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957947:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957952:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957956:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957961:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957965:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957970:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891185.957974:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891185.959371:0:18625:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9250b69aac00:18625] 1 exiting: rc = 0 00000100:00100000:3.0:1788891185.959514:0:18624:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff924f81704600:18624] 0 exiting: rc = 1 00000100:00100000:1.0:1788891185.960326:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960343:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960351:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960358:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960364:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960371:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960465:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960473:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960480:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960486:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960492:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960498:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960504:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960509:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960515:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960591:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960603:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960612:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960646:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960658:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960668:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960678:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960688:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960699:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960724:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960735:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960754:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960771:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960778:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960785:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960806:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960814:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960842:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960848:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960853:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960859:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960864:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960870:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960876:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960886:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960892:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960897:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960918:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960926:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960932:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960938:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960944:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960950:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960955:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960961:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960967:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960972:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960992:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.960998:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.961024:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.961030:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.961036:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.961042:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.961047:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.961052:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.961058:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.961064:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.961070:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891185.961083:0:21389:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788891185.969974:0:21389:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788891198.700805:0:22153:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788891205.067941:0:22752:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788891205.067946:0:22752:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788891205.067947:0:22752:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788891205.068026:0:22752:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9250b4f3c000 00000020:01000004:0.0:1788891205.068043:0:22752:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788891205.068049:0:22752:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788891205.068060:0:22752:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff925090b23370) 00000020:00000080:0.0:1788891205.068070:0:22752:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788891205.118295:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788891205.121045:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788891205.122829:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788891205.123852:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788891205.124081:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788891205.124372:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788891205.124619:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788891205.124890:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788891205.125172:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788891205.125362:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788891205.125655:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788891205.125948:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788891205.126183:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788891205.126421:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788891205.126632:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788891205.126867:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788891205.127167:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788891205.127390:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788891205.127631:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788891205.127899:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788891205.128186:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788891205.128376:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788891205.128894:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788891205.129192:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788891205.129387:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788891205.129653:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788891205.129933:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788891205.130209:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788891205.130416:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788891205.130654:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788891205.130934:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788891205.131178:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788891205.131401:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788891205.131632:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788891205.131879:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788891205.133445:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788891205.133762:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788891205.134242:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788891205.134440:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788891205.134771:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788891205.134967:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788891205.135269:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788891205.135468:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788891205.135757:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788891205.136115:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788891205.136408:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788891205.136678:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788891205.138859:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788891205.139357:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788891205.139604:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788891205.140025:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788891205.140259:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788891205.140454:0:22752:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:3.0:1788891205.141033:0:22752:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788891205.141273:0:22752:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788891205.141281:0:22752:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788891205.141294:0:22752:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd549fa 00000020:01000004:3.0:1788891205.141300:0:22752:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788891205.141304:0:22752:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788891205.141309:0:22752:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9250b4f3c000 from MGS 00000020:01000004:3.0:1788891205.141313:0:22752:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788891205.141323:0:22752:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9250bac299b8) 00000020:00000080:3.0:1788891205.141343:0:22752:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788891205.141403:0:22752:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9250b4f3c000 from MGS, refs=2 00080000:01000000:3.0:1788891205.141408:0:22752:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788891205.141413:0:22752:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd54a08 00000100:00100000:3.0:1788891205.141519:0:22752:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788891205.141683:0:22752:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788891205.141689:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788891205.142294:0:22752:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788891205.142301:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788891205.143023:0:22752:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788891205.143228:0:22752:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788891205.143233:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788891205.143771:0:22752:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788891205.143777:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788891205.144065:0:22752:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788891205.144072:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788891205.144837:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891205.144841:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891205.144843:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891205.145122:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891205.145125:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891205.145127:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891205.145662:0:22752:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788891205.147118:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788891205.149932:0:22752:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788891205.150694:0:22764:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788891205.150746:0:22752:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788891205.150783:0:22752:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788891205.151387:0:22752:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788891205.151847:0:22752:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788891205.151990:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788891205.151996:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788891205.156921:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788891205.156935:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788891205.157319:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788891205.157325:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788891205.158011:0:22752:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788891205.158033:0:22752:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.126@tcp' 00000020:01000004:0.0:1788891205.158035:0:22752:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788891205.158065:0:22752:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.126@tcp (typ=mgc) 00000020:00000080:0.0:1788891205.158076:0:22752:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.126@tcp (ffff925090b24d28) 00000100:00080000:3.0:1788891205.158186:0:22769:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1788891205.158213:0:22752:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788891205.158289:0:22752:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f82eab800@MGC192.168.204.126@tcp: add connection 192.168.204.126@tcp at head 00010000:00010000:0.0:1788891205.158445:0:22752:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.126@tcp-0 is initialized 00000040:01000000:0.0:1788891205.158451:0:22752:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788891205.159364:0:22770:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788891205.159439:0:22752:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.126@tcp (uuid ad5d36d9-7941-4f84-88d2-361333de6068) 00000020:00000080:3.0:1788891205.159454:0:22752:0:(genops.c:1385:class_connect()) connect: client ad5d36d9-7941-4f84-88d2-361333de6068, cookie 0xa66601b03fd54a16 00000100:00080000:3.0:1788891205.159463:0:22752:0:(import.c:510:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788891205.159469:0:22752:0:(import.c:624:import_select_connection()) MGC192.168.204.126@tcp: import ffff924f82eab800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1788891205.159500:0:22752:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9250bf73b480 x1875787997444864/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788891205.159555:0:22752:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ad5d36d9-7941-4f84-88d2-361333de6068->MGS 00000020:01000004:3.0:1788891205.159570:0:22752:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788891205.159574:0:22752:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788891205.159585:0:22752:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9250bac2b370) 00000020:00000080:3.0:1788891205.159594:0:22752:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788891205.159752:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad5d36d9-7941-4f84-88d2-361333de6068:3626:1875787997444864:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788891205.159815:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891205.159892:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997444864 00000100:00100000:0.0:1788891205.159899:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997444864 00000100:00100000:0.0:1788891205.159926:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788891205.159932:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3626:x1875787997444864:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788891205.159953:0:22765:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from ad5d36d9-7941-4f84-88d2-361333de6068@0@lo t0 exp 0000000000000000 cur 427 last 0 00000020:00000080:0.0:1788891205.159972:0:22765:0:(genops.c:1385:class_connect()) connect: client ad5d36d9-7941-4f84-88d2-361333de6068, cookie 0xa66601b03fd54a24 00000100:00080000:0.0:1788891205.160073:0:22765:0:(import.c:65:import_set_state_nolock()) ffff924f82eaa800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788891205.160132:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+5:3626:x1875787997444864:12345-0@lo:250:mount.lustre.0 Request processed in 198us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891205.160140:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788891205.160177:0:3626:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788891205.160184:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) MGC192.168.204.126@tcp: connect to target with instance 0 00000100:00080000:0.0:1788891205.160190:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) MGC192.168.204.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788891205.160194:0:3626:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788891205.160196:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f82eab800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788891205.160199:0:3626:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788891205.160205:0:3626:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788891205.160209:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad5d36d9-7941-4f84-88d2-361333de6068:3626:1875787997444864:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788891205.174699:0:22752:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788891205.175087:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788891205.175094:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788891205.176013:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788891205.176020:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788891205.176650:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788891205.176656:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788891205.177449:0:22752:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788891205.177968:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788891205.177974:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788891205.178653:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788891205.178661:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788891205.209766:0:22752:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788891205.209964:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788891205.209970:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788891205.210830:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788891205.210837:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788891205.211366:0:22752:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788891205.211858:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788891205.211871:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788891205.212249:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788891205.212256:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788891205.212956:0:22752:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788891205.213108:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788891205.213114:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788891205.213472:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788891205.213479:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788891205.213956:0:22752:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788891205.214083:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788891205.214087:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788891205.214465:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788891205.214470:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788891205.233852:0:22752:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788891205.234054:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788891205.234060:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788891205.237015:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788891205.237029:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788891205.238369:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788891205.238379:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788891205.239424:0:22752:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788891205.239452:0:22752:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788891205.239458:0:22752:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788891205.239605:0:22752:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788891205.239640:0:22752:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.126@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788891205.239645:0:22752:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788891205.239646:0:22752:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788891205.239648:0:22752:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891205.239649:0:22752:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891205.239650:0:22752:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891205.239652:0:22752:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891205.239653:0:22752:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788891205.239654:0:22752:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788891205.239656:0:22752:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891205.239657:0:22752:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788891205.239660:0:22752:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788891205.239662:0:22752:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788891205.239664:0:22752:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788891205.239665:0:22752:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891205.239666:0:22752:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891205.239667:0:22752:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891205.239668:0:22752:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891205.239669:0:22752:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788891205.239671:0:22752:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788891205.239672:0:22752:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891205.239673:0:22752:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788891205.239709:0:22752:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788891205.239730:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997444992:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788891205.239804:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891205.239849:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509276d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891205.239925:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997444992 00000100:00100000:3.0:1788891205.239933:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997444992 00000100:00100000:3.0:1788891205.239981:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788891205.239991:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+5:22752:x1875787997444992:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788891205.240037:0:22768:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788891205.240040:0:22768:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788891205.240042:0:22768:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788891205.240341:0:22788:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788891205.241034:0:22768:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1788891205.245640:0:22789:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788891205.245649:0:22789:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788891205.245652:0:22789:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788891205.245654:0:22789:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788891205.245817:0:22789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788891205.246046:0:22768:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788891205.246057:0:22768:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788891205.249994:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+5:22752:x1875787997444992:12345-0@lo:253:mount.lustre.0 Request processed in 9997us (10182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891205.250013:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788891205.250123:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997444992:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788891205.250152:0:22752:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788891205.250155:0:22752:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788891205.250157:0:22752:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788891205.250158:0:22752:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891205.250159:0:22752:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891205.250160:0:22752:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891205.250162:0:22752:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891205.250163:0:22752:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788891205.250164:0:22752:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788891205.250166:0:22752:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891205.250168:0:22752:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788891205.250186:0:22752:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9250b4f3c000 from lustre-MDT0000 10000000:01000000:0.0:1788891205.250215:0:22752:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788891205.250218:0:22752:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788891205.250222:0:22752:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff925090b24d28 10000000:01000000:0.0:1788891205.250227:0:22752:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788891205.250235:0:22752:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff925090b24d28 from 1 10000000:01000000:0.0:1788891205.250237:0:22752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788891205.250273:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5600/0xa66601b03fd54a2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.250283:0:22752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae5600/0xa66601b03fd54a2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.250292:0:22752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae5600/0xa66601b03fd54a2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891205.250311:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997445120:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891205.250361:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891205.250405:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509276de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788891205.250424:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997445120 00000100:00100000:1.0:1788891205.250431:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997445120 00000100:00100000:1.0:1788891205.250470:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788891205.250480:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+5:22752:x1875787997445120:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891205.250494:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891205.250508:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c7c00/0xa66601b03fd54a32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54a2b expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891205.250563:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c7c00/0xa66601b03fd54a32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54a2b expref: 6 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891205.250574:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c7c00/0xa66601b03fd54a32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54a2b expref: 6 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891205.250584:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7c00, rc 0) 00000100:00100000:1.0:1788891205.250631:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+6:22752:x1875787997445120:12345-0@lo:101:mount.lustre.0 Request processed in 152us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891205.250638:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788891205.250658:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997445120:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891205.250677:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae5600/0xa66601b03fd54a2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54a32 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891205.250686:0:22752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae5600/0xa66601b03fd54a2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54a32 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891205.250740:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997445248:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891205.250766:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891205.250793:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff925088646d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788891205.250844:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997445248 00000100:00100000:3.0:1788891205.250849:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997445248 00000100:00100000:3.0:1788891205.250869:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788891205.250876:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+7:22752:x1875787997445248:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891205.250960:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+7:22752:x1875787997445248:12345-0@lo:501:mount.lustre.0 Request processed in 84us (193us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788891205.250968:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788891205.251044:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997445248:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788891205.251071:0:22752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788891205.251084:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5600/0xa66601b03fd54a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54a32 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891205.251098:0:22752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae5600/0xa66601b03fd54a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54a32 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891205.251106:0:22752:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9250b4f3c000 10000000:01000000:2.0:1788891205.251109:0:22752:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788891205.251113:0:22752:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9250b4f3c000 10000000:01000000:2.0:1788891205.251115:0:22752:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788891205.251117:0:22752:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9250b4f3c000 from 1 10000000:01000000:2.0:1788891205.251119:0:22752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788891205.251137:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ece00/0xa66601b03fd54a39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891205.251144:0:22752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250813ece00/0xa66601b03fd54a39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891205.251153:0:22752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250813ece00/0xa66601b03fd54a39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891205.251166:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997445376:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788891205.251190:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891205.251254:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff925088646d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788891205.251267:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997445376 00000100:00100000:1.0:1788891205.251273:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997445376 00000100:00100000:3.0:1788891205.252808:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788891205.252826:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+6:22752:x1875787997445376:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891205.252839:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891205.252858:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8b400/0xa66601b03fd54a40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54a39 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891205.252881:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8b400/0xa66601b03fd54a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54a39 expref: 7 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891205.252891:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8b400/0xa66601b03fd54a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54a39 expref: 7 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891205.252899:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8b400, rc 0) 00000100:00100000:3.0:1788891205.253169:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+7:22752:x1875787997445376:12345-0@lo:101:mount.lustre.0 Request processed in 350us (1976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891205.253176:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788891205.254789:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997445376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891205.254814:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250813ece00/0xa66601b03fd54a39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54a40 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891205.254825:0:22752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250813ece00/0xa66601b03fd54a39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54a40 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891205.254865:0:22752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788891205.254876:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ece00/0xa66601b03fd54a39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54a40 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891205.254883:0:22752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250813ece00/0xa66601b03fd54a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54a40 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891205.254890:0:22752:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788891205.254895:0:22752:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788891205.254901:0:22752:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9250b4f3c000 10000000:01000000:2.0:1788891205.254904:0:22752:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788891205.254908:0:22752:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788891205.254911:0:22752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788891205.254943:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd54a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891205.256172:0:22752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd54a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891205.256185:0:22752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd54a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891205.256212:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997445504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788891205.256273:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891205.256305:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff925088646d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788891205.256590:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997445504 00000100:00100000:0.0:1788891205.256597:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997445504 00000100:00100000:0.0:1788891205.256683:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788891205.256703:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+7:22752:x1875787997445504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891205.256716:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891205.256730:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae4400/0xa66601b03fd54a4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54a47 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.256751:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae4400/0xa66601b03fd54a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54a47 expref: 8 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.256761:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae4400/0xa66601b03fd54a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54a47 expref: 8 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.256769:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4400, rc 0) 00000100:00100000:0.0:1788891205.256817:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+8:22752:x1875787997445504:12345-0@lo:101:mount.lustre.0 Request processed in 116us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891205.256824:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788891205.256908:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997445504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891205.256921:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd54a47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54a4e expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891205.256935:0:22752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd54a47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54a4e expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891205.257001:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997445632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891205.257026:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891205.257267:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff925088646d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788891205.257314:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997445632 00000100:00100000:1.0:1788891205.257319:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997445632 00000100:00100000:3.0:1788891205.257369:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788891205.257380:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+8:22752:x1875787997445632:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891205.257581:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+9:22752:x1875787997445632:12345-0@lo:501:mount.lustre.0 Request processed in 204us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891205.257588:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788891205.257633:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997445632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891205.257658:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997445760:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788891205.257695:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891205.257721:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff925088646d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788891205.257732:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997445760 00000100:00100000:1.0:1788891205.257737:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997445760 00000100:00100000:1.0:1788891205.257770:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788891205.257777:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+9:22752:x1875787997445760:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788891205.259391:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+9:22752:x1875787997445760:12345-0@lo:503:mount.lustre.0 Request processed in 1608us (1689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891205.259398:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997445760:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788891205.259405:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788891205.261675:0:22790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad5d36d9-7941-4f84-88d2-361333de6068:22790:1875787997445888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788891205.261751:0:22790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891205.261800:0:22790:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090295480 going to sleep for 11 seconds 00000100:00100000:0.0:1788891205.261825:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997445888 00000100:00100000:0.0:1788891205.261833:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997445888 00000100:00100000:0.0:1788891205.261944:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788891205.261954:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+9:22790:x1875787997445888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788891205.262732:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+9:22790:x1875787997445888:12345-0@lo:502:llog_process_th.0 Request processed in 778us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891205.262740:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788891205.262821:0:22790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad5d36d9-7941-4f84-88d2-361333de6068:22790:1875787997445888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788891205.262850:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788891205.262861:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891205.262864:0:22790:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788891205.262869:0:22790:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788891205.262872:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788891205.262887:0:22790:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9250b717b370) 00000020:00000080:1.0:1788891205.262903:0:22790:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788891205.262909:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788891205.263007:0:22790:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788891205.263015:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd54a5c 00000020:00000080:1.0:1788891205.263482:0:22790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788891205.263488:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788891205.263491:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891205.263493:0:22790:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788891205.263583:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788891205.263590:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891205.263591:0:22790:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788891205.263595:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788891205.263604:0:22790:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9250b717cd28) 00000020:00000080:1.0:1788891205.263615:0:22790:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788891205.263619:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788891205.263621:0:22790:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788891205.263631:0:22790:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788891205.263637:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788891205.263680:0:22790:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9250b4f3c000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788891205.263694:0:22790:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9250b71799b8) 00000020:00000080:1.0:1788891205.264377:0:22790:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788891205.264445:0:22790:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788891205.264451:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd54a71 00000020:00000080:1.0:1788891205.264712:0:22790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788891205.264718:0:22790:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788891205.264724:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa66601b03fd54a78 00080000:01000000:1.0:1788891205.264729:0:22790:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788891205.264733:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd54a7f 00010000:00010000:1.0:1788891205.329202:0:22790:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788891205.330959:0:22790:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934679 00000001:00080000:1.0:1788891205.332106:0:22790:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788891205.332637:0:22790:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9250b7178000) 00000020:00000080:1.0:1788891205.332655:0:22790:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788891205.332739:0:22790:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788891205.332748:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd54a8d 00000020:00000080:1.0:1788891205.333288:0:22790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788891205.337645:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa66601b03fd54a94 00000020:00000080:3.0:1788891205.338063:0:22790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788891205.338074:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891205.338081:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891205.338083:0:22790:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788891205.338087:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788891205.338090:0:22790:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788891205.338092:0:22790:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788891205.338094:0:22790:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788891205.338102:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788891205.338105:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891205.338107:0:22790:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788891205.338110:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891205.338116:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891205.338117:0:22790:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788891205.338123:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788891205.338164:0:22790:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788891205.338180:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891205.338184:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891205.338185:0:22790:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788891205.338188:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891205.338191:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891205.338193:0:22790:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788891205.338196:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788891205.338201:0:22790:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:00000080:3.0:1788891205.338226:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788891205.338240:0:22790:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9250bac28000) 00000020:00000080:3.0:1788891205.338252:0:22790:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788891205.338256:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788891205.338324:0:22790:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788891205.338340:0:22790:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788891205.338346:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd54aa2 00010000:00080000:3.0:1788891205.338376:0:22790:0:(ldlm_lib.c:102:import_set_conn()) imp ffff925083eda000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:3.0:1788891205.340254:0:22790:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788891205.344124:0:22790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788891205.344142:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788891205.344184:0:22790:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788891205.344278:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd54aa9 00000100:00080000:1.0:1788891205.344292:0:22790:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788891205.344299:0:22790:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff925083eda000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891205.344348:0:22790:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f833d0380 x1875787997446016/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788891205.344413:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997446016:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788891205.344488:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788891205.344651:0:22790:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788891205.344709:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788891205.344723:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891205.344725:0:22790:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788891205.344729:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788891205.344732:0:22790:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1788891205.344733:0:22790:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788891205.344735:0:22790:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788891205.344736:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788891205.344739:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891205.344741:0:22790:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788891205.344743:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788891205.344748:0:22790:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788891205.344752:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891205.344753:0:22790:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788891205.344756:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788891205.344760:0:22790:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:1.0:1788891205.344780:0:22790:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788891205.344782:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788891205.344803:0:22790:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9250ba59cd28) 00000020:00000080:1.0:1788891205.344816:0:22790:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788891205.344821:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788891205.344885:0:22790:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788891205.344891:0:22790:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788891205.344897:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd54ab7 00010000:00080000:1.0:1788891205.344925:0:22790:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9250875b5800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.126@tcp at head 00000100:00100000:2.0:1788891205.344976:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997446016 00000100:00100000:2.0:1788891205.344984:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997446016 00000100:00100000:2.0:1788891205.345027:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788891205.345036:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1875787997446016:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788891205.345051:0:22777:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:1.0:1788891205.345146:0:22790:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788891205.345945:0:22790:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788891205.346158:0:22790:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788891205.348122:0:22790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788891205.348629:0:22790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788891205.354492:0:22790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1788891205.356236:0:22796:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788891205.356242:0:22796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788891205.358503:0:22790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788891205.358516:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788891205.358578:0:22790:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788891205.358607:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd54abe 00000100:00080000:3.0:1788891205.358618:0:22790:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788891205.358624:0:22790:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9250875b5800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1788891205.358659:0:22790:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9250bf73b480 x1875787997446144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788891205.358688:0:22790:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788891205.358758:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891205.358763:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891205.358764:0:22790:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788891205.358767:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788891205.358771:0:22790:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788891205.358772:0:22790:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788891205.358774:0:22790:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788891205.358775:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788891205.358777:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891205.358778:0:22790:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788891205.358781:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788891205.358784:0:22790:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788891205.358788:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891205.358789:0:22790:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788891205.358791:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788891205.358796:0:22790:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:3.0:1788891205.358819:0:22790:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788891205.358822:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788891205.358832:0:22790:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9250bac2cd28) 00000020:00000080:3.0:1788891205.358844:0:22790:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788891205.358848:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788891205.358906:0:22790:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788891205.358912:0:22790:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788891205.358917:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa66601b03fd54acc 00010000:00080000:3.0:1788891205.358944:0:22790:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9250900ed800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:3.0:1788891205.359137:0:22790:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788891205.359210:0:22790:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788891205.359225:0:22790:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788891205.359500:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997446144:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788891205.359589:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875787997446144 offset 0 length 520: 4 00000100:00100000:2.0:1788891205.359910:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1875787997446016:12345-0@lo:38:llog_process_th.0 Request processed in 14872us (15419us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788891205.359923:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788891205.359945:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925083eda000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788891205.359959:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788891205.359963:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997446016:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788891205.360656:0:22790:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 1, last_idx 2 00000040:00080000:3.0:1788891205.362481:0:22790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788891205.363060:0:22790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788891205.363295:0:22790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1788891205.364282:0:22798:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 3 synced_idx: 0 lgh_last_idx: 3 00000040:00080000:3.0:1788891205.364287:0:22798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788891205.366069:0:22790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788891205.366080:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788891205.366120:0:22790:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788891205.366139:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd54ad3 00000100:00080000:0.0:1788891205.366149:0:22790:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788891205.366155:0:22790:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9250900ed800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891205.366190:0:22790:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f8318d880 x1875787997446272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788891205.366220:0:22790:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788891205.366319:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997446272:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1788891205.366384:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891205.366390:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891205.366393:0:22790:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788891205.366396:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000400:00000100:1.0:1788891205.366398:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875787997446272 offset 0 length 520: 4 00000020:00000080:0.0:1788891205.366402:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891205.366405:0:22790:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788891205.366409:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788891205.366411:0:22790:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788891205.366414:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891205.366417:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891205.366418:0:22790:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788891205.366422:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891205.366424:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891205.366426:0:22790:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788891205.366430:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788891205.366459:0:22790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad5d36d9-7941-4f84-88d2-361333de6068:22790:1875787997446400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788891205.366553:0:22790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891205.366575:0:22790:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509276db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788891205.367128:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997446400 00000100:00100000:1.0:1788891205.367137:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997446400 00000100:00100000:1.0:1788891205.367191:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788891205.367202:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+9:22790:x1875787997446400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788891205.367311:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+9:22790:x1875787997446400:12345-0@lo:502:llog_process_th.0 Request processed in 111us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891205.367319:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788891205.367362:0:22790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad5d36d9-7941-4f84-88d2-361333de6068:22790:1875787997446400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788891205.367393:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891205.367397:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891205.367399:0:22790:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788891205.367403:0:22790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788891205.367619:0:22752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788891205.367639:0:22752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788891205.367663:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd54a47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54a4e expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891205.367674:0:22752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250813ec200/0xa66601b03fd54a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54a4e expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891205.367682:0:22752:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9250b4f3c000 from 1 10000000:01000000:3.0:1788891205.367684:0:22752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788891205.367712:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8ba00/0xa66601b03fd54ada lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891205.367719:0:22752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8ba00/0xa66601b03fd54ada lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891205.367729:0:22752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8ba00/0xa66601b03fd54ada lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891205.367742:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997446528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788891205.367773:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891205.367794:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788891205.367845:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997446528 00000100:00100000:0.0:1788891205.367849:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997446528 00000100:00100000:0.0:1788891205.367879:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788891205.367886:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+9:22752:x1875787997446528:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891205.367896:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891205.367907:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae4200/0xa66601b03fd54ae1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54ada expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.367925:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae4200/0xa66601b03fd54ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54ada expref: 10 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.367934:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae4200/0xa66601b03fd54ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54ada expref: 10 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.367943:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4200, rc 0) 00000100:00100000:0.0:1788891205.367972:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+10:22752:x1875787997446528:12345-0@lo:101:mount.lustre.0 Request processed in 86us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891205.367977:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788891205.368102:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997446528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891205.368116:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8ba00/0xa66601b03fd54ada lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54ae1 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891205.368135:0:22752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8ba00/0xa66601b03fd54ada lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54ae1 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891205.368907:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997446656:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788891205.368948:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891205.368970:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788891205.369127:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997446656 00000100:00100000:1.0:1788891205.369133:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997446656 00000100:00100000:1.0:1788891205.369174:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788891205.369183:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+10:22752:x1875787997446656:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788891205.369198:0:22767:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788891205.369204:0:22767:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788891205.369297:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+10:22752:x1875787997446656:12345-0@lo:256:mount.lustre.0 Request processed in 116us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891205.369304:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788891205.369344:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997446656:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788891205.369856:0:22752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788891205.369867:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8ba00/0xa66601b03fd54ada lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54ae1 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.369876:0:22752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8ba00/0xa66601b03fd54ada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54ae1 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891205.369890:0:22752:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9250b4f3c000 from 1 10000000:01000000:0.0:1788891205.369893:0:22752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788891205.369914:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4000/0xa66601b03fd54ae8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.369920:0:22752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae4000/0xa66601b03fd54ae8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.369928:0:22752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae4000/0xa66601b03fd54ae8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891205.369941:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997446784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891205.369969:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891205.369998:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509276d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788891205.370123:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997446784 00000100:00100000:3.0:1788891205.370128:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997446784 00000100:00100000:3.0:1788891205.370220:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788891205.370227:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+10:22752:x1875787997446784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891205.370238:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891205.370249:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8a200/0xa66601b03fd54aef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54ae8 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891205.370266:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8a200/0xa66601b03fd54aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54ae8 expref: 11 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891205.370275:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8a200/0xa66601b03fd54aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54ae8 expref: 11 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891205.370282:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8a200, rc 0) 00000100:00100000:3.0:1788891205.370322:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+11:22752:x1875787997446784:12345-0@lo:101:mount.lustre.0 Request processed in 96us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891205.370338:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788891205.370399:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997446784:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891205.370413:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae4000/0xa66601b03fd54ae8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54aef expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891205.370423:0:22752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae4000/0xa66601b03fd54ae8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54aef expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891205.370499:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997446912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891205.370559:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891205.370596:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b6854cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891205.371264:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997446912 00000100:00100000:3.0:1788891205.371270:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997446912 00000100:00100000:3.0:1788891205.371306:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788891205.371321:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+11:22752:x1875787997446912:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891205.371735:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+11:22752:x1875787997446912:12345-0@lo:501:mount.lustre.0 Request processed in 415us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891205.371745:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788891205.372140:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997446912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891205.372179:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997447040:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788891205.372223:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891205.372252:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997447040 00000100:00100000:1.0:1788891205.372255:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b6854cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891205.372257:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997447040 00000100:00100000:0.0:1788891205.372290:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788891205.372297:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+11:22752:x1875787997447040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891205.372396:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+11:22752:x1875787997447040:12345-0@lo:503:mount.lustre.0 Request processed in 99us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891205.372403:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788891205.373132:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997447040:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788891205.374205:0:22800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad5d36d9-7941-4f84-88d2-361333de6068:22800:1875787997447168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788891205.374261:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891205.374299:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250886469c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891205.374368:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997447168 00000100:00100000:3.0:1788891205.374373:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997447168 00000100:00100000:3.0:1788891205.374414:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788891205.374423:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+11:22800:x1875787997447168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788891205.375256:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+11:22800:x1875787997447168:12345-0@lo:502:llog_process_th.0 Request processed in 833us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891205.375265:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788891205.377726:0:22800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad5d36d9-7941-4f84-88d2-361333de6068:22800:1875787997447168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788891205.377785:0:22800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891205.377795:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891205.377797:0:22800:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788891205.377805:0:22800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9250b4f3c000 00000020:00000080:2.0:1788891205.377808:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788891205.377815:0:22800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891205.377818:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891205.377819:0:22800:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788891205.377822:0:22800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891205.377824:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891205.377826:0:22800:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788891205.377829:0:22800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9250b4f3c000 00000020:00000080:2.0:1788891205.377831:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788891205.378991:0:22800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891205.379001:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891205.379003:0:22800:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788891205.379006:0:22800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891205.379010:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891205.379012:0:22800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788891205.379016:0:22800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9250b4f3c000 00000020:00000080:2.0:1788891205.379018:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788891205.383687:0:22800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891205.383701:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891205.383703:0:22800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788891205.383707:0:22800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891205.383711:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891205.383712:0:22800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788891205.383718:0:22800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9250b4f3c000 00000020:00000080:2.0:1788891205.383721:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788891205.383812:0:22800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad5d36d9-7941-4f84-88d2-361333de6068:22800:1875787997447296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788891205.383942:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891205.383995:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250886469c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891205.384067:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997447296 00000100:00100000:3.0:1788891205.384075:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997447296 00000100:00100000:3.0:1788891205.384127:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788891205.384137:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+11:22800:x1875787997447296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788891205.384271:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+11:22800:x1875787997447296:12345-0@lo:502:llog_process_th.0 Request processed in 135us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891205.384279:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788891205.384388:0:22800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad5d36d9-7941-4f84-88d2-361333de6068:22800:1875787997447296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788891205.384418:0:22800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891205.384422:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891205.384424:0:22800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788891205.384428:0:22800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788891205.384647:0:22752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788891205.384681:0:22752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788891205.384706:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4000/0xa66601b03fd54ae8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54aef expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891205.384718:0:22752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae4000/0xa66601b03fd54ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54aef expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891205.384778:0:22752:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788891205.384786:0:22752:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9250b4f3c000 10000000:01000000:3.0:1788891205.384789:0:22752:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9250b4f3c000 10000000:01000000:3.0:1788891205.384794:0:22752:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788891205.384799:0:22752:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9250b4f3c000 from 1 10000000:01000000:3.0:1788891205.384802:0:22752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788891205.384828:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54af6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891205.384837:0:22752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54af6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891205.384847:0:22752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54af6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891205.384861:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997447424:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788891205.384893:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891205.384920:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788891205.384954:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997447424 00000100:00100000:3.0:1788891205.384958:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997447424 00000100:00100000:3.0:1788891205.384986:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788891205.384994:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+11:22752:x1875787997447424:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891205.385004:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891205.385017:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8bc00/0xa66601b03fd54afd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54af6 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891205.385039:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8bc00/0xa66601b03fd54afd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54af6 expref: 12 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891205.385052:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8bc00/0xa66601b03fd54afd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54af6 expref: 12 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891205.385073:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8bc00, rc 0) 00000100:00100000:3.0:1788891205.385106:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+12:22752:x1875787997447424:12345-0@lo:101:mount.lustre.0 Request processed in 113us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891205.385113:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788891205.385151:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997447424:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891205.385164:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54af6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54afd expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891205.385175:0:22752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54af6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54afd expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891205.385227:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997447552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891205.385256:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891205.385273:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788891205.385287:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997447552 00000100:00100000:3.0:1788891205.385291:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997447552 00000100:00100000:3.0:1788891205.385316:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788891205.385322:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+12:22752:x1875787997447552:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891205.385438:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+12:22752:x1875787997447552:12345-0@lo:501:mount.lustre.0 Request processed in 115us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891205.385446:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788891205.385482:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997447552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891205.385509:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997447680:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788891205.385572:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891205.385592:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508322c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788891205.385605:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997447680 00000100:00100000:3.0:1788891205.385608:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997447680 00000100:00100000:3.0:1788891205.385632:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788891205.385639:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+12:22752:x1875787997447680:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788891205.385717:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+12:22752:x1875787997447680:12345-0@lo:503:mount.lustre.0 Request processed in 78us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891205.385724:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788891205.385762:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997447680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788891205.386115:0:22803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad5d36d9-7941-4f84-88d2-361333de6068:22803:1875787997447808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788891205.386156:0:22803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891205.386218:0:22803:0:(client.c:2715:ptlrpc_set_wait()) set ffff925088646600 going to sleep for 11 seconds 00000100:00100000:3.0:1788891205.386247:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997447808 00000100:00100000:3.0:1788891205.386252:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997447808 00000100:00100000:3.0:1788891205.386309:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788891205.386316:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+12:22803:x1875787997447808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788891205.386404:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+12:22803:x1875787997447808:12345-0@lo:502:llog_process_th.0 Request processed in 88us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891205.386411:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788891205.386464:0:22803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad5d36d9-7941-4f84-88d2-361333de6068:22803:1875787997447808:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788891205.386517:0:22803:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788891205.386550:0:22803:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff925091ac8000) 00000020:00000080:2.0:1788891205.386570:0:22803:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788891205.386646:0:22803:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9250b4f3c000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788891205.386651:0:22803:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9250b4f3c000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788891205.386653:0:22803:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9250b4f3c000 4 00010000:00080000:2.0:1788891205.386683:0:22803:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9250b4ed8800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:2.0:1788891205.388478:0:22803:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788891205.388937:0:22803:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788891205.388986:0:22803:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788891205.389001:0:22803:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa66601b03fd54b0b 00000100:00080000:2.0:1788891205.389014:0:22803:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788891205.389020:0:22803:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9250b4ed8800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788891205.389064:0:22803:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9250a4885f80 x1875787997447936/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788891205.389106:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875787997447936:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788891205.389181:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788891205.389239:0:22803:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788891205.391478:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997447936 00000100:00100000:0.0:1788891205.391504:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997447936 00000100:00100000:0.0:1788891205.391581:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788891205.391594:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1875787997447936:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788891205.391716:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1875787997447936:12345-0@lo:38:llog_process_th.0 Request processed in 123us (2534us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788891205.391736:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788891205.391797:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788891205.391807:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250b4ed8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788891205.391813:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788891205.391818:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875787997447936:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788891205.394512:0:22803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad5d36d9-7941-4f84-88d2-361333de6068:22803:1875787997448064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788891205.394629:0:22803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891205.394670:0:22803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab18d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788891205.394692:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997448064 00000100:00100000:3.0:1788891205.394698:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997448064 00000100:00100000:3.0:1788891205.394749:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788891205.394759:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+12:22803:x1875787997448064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788891205.394901:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+12:22803:x1875787997448064:12345-0@lo:502:llog_process_th.0 Request processed in 143us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891205.394910:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788891205.394971:0:22803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad5d36d9-7941-4f84-88d2-361333de6068:22803:1875787997448064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788891205.395012:0:22803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad5d36d9-7941-4f84-88d2-361333de6068:22803:1875787997448192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788891205.395050:0:22803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891205.395065:0:22803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab18d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788891205.395078:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997448192 00000100:00100000:3.0:1788891205.395082:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997448192 00000100:00100000:3.0:1788891205.395105:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788891205.395112:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+12:22803:x1875787997448192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788891205.395177:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+12:22803:x1875787997448192:12345-0@lo:502:llog_process_th.0 Request processed in 65us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891205.395184:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788891205.395221:0:22803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad5d36d9-7941-4f84-88d2-361333de6068:22803:1875787997448192:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788891205.395241:0:22803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788891205.395381:0:22752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788891205.395405:0:22752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788891205.395422:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54af6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54afd expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891205.395433:0:22752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8a400/0xa66601b03fd54af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54afd expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788891205.395486:0:22752:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788891205.395488:0:22752:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788891205.395490:0:22752:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891205.395491:0:22752:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891205.395492:0:22752:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891205.395494:0:22752:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891205.395495:0:22752:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788891205.395497:0:22752:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788891205.395506:0:22752:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891205.395508:0:22752:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788891205.395512:0:22752:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788891205.395514:0:22752:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788891205.395515:0:22752:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788891205.395516:0:22752:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891205.395517:0:22752:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891205.395518:0:22752:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891205.395519:0:22752:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891205.395520:0:22752:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788891205.395540:0:22752:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788891205.395542:0:22752:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891205.395544:0:22752:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788891205.395558:0:22752:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788891205.395567:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997448320:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788891205.395605:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891205.395626:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab18d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788891205.395647:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997448320 00000100:00100000:3.0:1788891205.395651:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997448320 00000100:00100000:3.0:1788891205.395674:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788891205.395681:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+12:22752:x1875787997448320:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788891205.395701:0:22765:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788891205.395715:0:22765:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788891205.402604:0:22765:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788891205.402631:0:22765:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788891205.402651:0:22788:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788891205.402657:0:22788:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788891205.402684:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9250813ec600/0xa66601b03fd54b12 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891205.402703:0:22788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250baae4200/0xa66601b03fd54ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54ada expref: 12 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891205.402713:0:22788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9250813ec600/0xa66601b03fd54b12 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891205.402754:0:22788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250baae4200/0xa66601b03fd54ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd54ada expref: 12 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891205.402769:0:22788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250baae4200/0xa66601b03fd54ae1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd54ada expref: 12 pid: 22765 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891205.402785:0:22788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4884000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875787997448448:0@lo:104: 00000100:00100000:2.0:1788891205.402864:0:22788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891205.402907:0:22788:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509054e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891205.402989:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997448448 00000100:00100000:0.0:1788891205.402997:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997448448 00000100:00100000:0.0:1788891205.403042:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788891205.403052:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4887800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad5d36d9-7941-4f84-88d2-361333de6068+3:22788:x1875787997448448:12345-0@lo:104: 00010000:00010000:0.0:1788891205.403065:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925091a8ba00/0xa66601b03fd54ada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54ae1 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.403127:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788891205.403134:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4887800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad5d36d9-7941-4f84-88d2-361333de6068+3:22788:x1875787997448448:12345-0@lo:104: Request processed in 83us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891205.403141:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788891205.403162:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891205.403168:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8ba00/0xa66601b03fd54ada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54ae1 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.403177:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8ba00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:0.0:1788891205.403182:0:22762:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8ba00/0xa66601b03fd54ada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd54ae1 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.403191:0:22762:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8ba00/0xa66601b03fd54ada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd54ae1 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788891205.403199:0:22762:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8ba00/0xa66601b03fd54ada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd54ae1 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891205.403211:0:22762:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788891205.403246:0:22762:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925091a8ba00/0xa66601b03fd54ada lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54ae1 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.403252:0:22762:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788891205.403271:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8ba00/0xa66601b03fd54ada lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54ae1 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.403278:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8ba00/0xa66601b03fd54ada lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54ae1 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.403296:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891205.403298:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891205.403300:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891205.403344:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788891205.403353:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad5d36d9-7941-4f84-88d2-361333de6068:3630:1875787997448576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788891205.403384:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891205.403430:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997448576 00000100:00100000:0.0:1788891205.403434:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997448576 00010000:00010000:0.0:1788891205.403451:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250baae4200/0xa66601b03fd54ae1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54ada expref: 13 pid: 22765 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891205.403473:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788891205.403480:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad5d36d9-7941-4f84-88d2-361333de6068+13:3630:x1875787997448576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788891205.403492:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891205.403498:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250baae4200/0xa66601b03fd54ae1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54ada expref: 13 pid: 22765 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.403507:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250baae4200/0xa66601b03fd54ae1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd54ada expref: 13 pid: 22765 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.403553:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9250813ec600/0xa66601b03fd54b12 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.403562:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813ec600/0xa66601b03fd54b12 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788891205.403575:0:22758:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000918501s 00010000:00010000:0.0:1788891205.403580:0:22758:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250813ec600/0xa66601b03fd54b12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.403587:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250813ec600/0xa66601b03fd54b12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.403594:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9250813ec600/0xa66601b03fd54b12 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.403600:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9250813ec600/0xa66601b03fd54b12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.403606:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ec600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891205.403611:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9250813ec600/0xa66601b03fd54b12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891205.403618:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae4200/0xa66601b03fd54ae1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd54ada expref: 13 pid: 22765 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.403621:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9250813ec600/0xa66601b03fd54b12 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891205.403637:0:22788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4884000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875787997448448:0@lo:104: 00010000:00010000:0.0:1788891205.403640:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9250813ec600/0xa66601b03fd54b12 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891205.403653:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891205.403659:0:22788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9250813ec600/0xa66601b03fd54b12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891205.403669:0:22788:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9250813ec600/0xa66601b03fd54b12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891205.403676:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9250813ec600/0xa66601b03fd54b12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891205.403688:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad5d36d9-7941-4f84-88d2-361333de6068+12:3630:x1875787997448576:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (301us total) trans 0 rc 0/0 00010000:00010000:2.0:1788891205.403693:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813ec600/0xa66601b03fd54b12 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891205.403710:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788891205.403742:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad5d36d9-7941-4f84-88d2-361333de6068:3630:1875787997448576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788891205.403976:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+11:22752:x1875787997448320:12345-0@lo:253:mount.lustre.0 Request processed in 8295us (8369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891205.403985:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788891205.404012:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:22752:1875787997448320:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788891205.404024:0:22752:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788891205.404028:0:22752:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788891205.404030:0:22752:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788891205.404031:0:22752:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788891205.404032:0:22752:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788891205.404034:0:22752:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788891205.404036:0:22752:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788891205.404038:0:22752:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788891205.404040:0:22752:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788891205.404042:0:22752:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788891205.404044:0:22752:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788891205.404060:0:22752:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:0.0:1788891205.425041:0:22752:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967531 00000040:01000000:0.0:1788891205.425791:0:22752:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788891205.426004:0:22812:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967531 00000020:00080000:3.0:1788891205.426009:0:22812:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967531 00000040:01000000:0.0:1788891205.426134:0:22813:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788891205.426770:0:22752:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1788891205.426965:0:22813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1788891205.427065:0:22814:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff924f8318d500 x1875787997448704/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891205.427077:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090298000 going to sleep for 0 seconds 00000040:01000000:2.0:1788891205.427397:0:22752:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788891205.427427:0:22752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788891205.429156:0:22752:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788891205.429373:0:22752:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788891205.429477:0:22752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788891205.432610:0:22752:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788891205.435847:0:22752:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788891205.435925:0:22752:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788891205.436765:0:22752:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1788891205.437252:0:22752:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:3.0:1788891205.438931:0:22752:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1788891205.440312:0:22752:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788891205.440358:0:22752:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbbfc4189f988 00100000:10000000:3.0:1788891205.440367:0:22752:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000040:00080000:1.0:1788891205.441294:0:22813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788891205.441366:0:22813:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000020:01000004:0.0:1788891205.441754:0:22752:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788891205.441770:0:22752:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788891205.441796:0:22752:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788891205.441822:0:22752:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788891205.442757:0:22752:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788891205.442976:0:22752:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788891206.203753:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891206.459725:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090298000 going to sleep for 0 seconds 00000040:00080000:3.0:1788891206.460727:0:22808:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788891206.460736:0:22808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788891206.464915:0:22808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:2.0:1788891206.464930:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:0.0:1788891206.848865:0:22770:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788891206.848876:0:22770:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9250b4f3c000 from 11 10000000:01000000:0.0:1788891206.848882:0:22770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788891206.848935:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54b19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891206.848947:0:22770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54b19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891206.848958:0:22770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54b19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891206.848991:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997448832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788891206.849063:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891206.849144:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab18300 going to sleep for 11 seconds 00000100:00100000:3.0:1788891206.849184:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997448832 00000100:00100000:3.0:1788891206.849191:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997448832 00000100:00100000:3.0:1788891206.849459:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788891206.849471:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+11:22770:x1875787997448832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788891206.849483:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891206.849496:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8ba00/0xa66601b03fd54b20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54b19 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891206.849518:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8ba00/0xa66601b03fd54b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54b19 expref: 12 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891206.849734:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8ba00/0xa66601b03fd54b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54b19 expref: 12 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891206.849746:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8ba00, rc 0) 00000100:00100000:3.0:1788891206.849834:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+12:22770:x1875787997448832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 367us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891206.849842:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788891206.850366:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997448832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788891206.850388:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54b19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54b20 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891206.850399:0:22770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54b19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54b20 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891206.850462:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997448960:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788891206.850502:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891206.850547:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997448960 00000100:00100000:0.0:1788891206.850552:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997448960 00000100:00100000:0.0:1788891206.850584:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788891206.850592:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+12:22770:x1875787997448960:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788891206.850607:0:22765:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788891206.850623:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788891206.850626:0:22765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788891206.850697:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+12:22770:x1875787997448960:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891206.850704:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788891206.850737:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab18300 going to sleep for 11 seconds 00000100:00100000:0.0:1788891206.850750:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997448960:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788891206.850786:0:22770:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788891206.850796:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54b19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54b20 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891206.850804:0:22770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54b19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54b20 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891207.227812:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891207.483949:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090298000 going to sleep for 0 seconds 00000040:00080000:2.0:1788891207.484669:0:22808:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788891207.484676:0:22808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788891207.484829:0:22808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 1 00000040:00080000:2.0:1788891207.484866:0:22808:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788891207.485014:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:0.0:1788891208.251864:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788891208.394265:0:23056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788891208.510950:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090298000 going to sleep for 0 seconds 00000020:00000004:2.0:1788891209.004366:0:23108:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788891209.004566:0:23108:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788891209.275751:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891209.532033:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090298000 going to sleep for 0 seconds 00000020:00000004:3.0:1788891209.570650:0:23158:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788891209.570824:0:23158:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788891210.299942:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891210.555753:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090298000 going to sleep for 0 seconds 00000100:00080000:0.0:1788891210.877306:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788891210.877313:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788891210.877317:0:37:0:(import.c:65:import_set_state_nolock()) ffff925083eda000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891210.877325:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 427 00000100:00080000:0.0:1788891210.877333:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788891210.877339:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff925083eda000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891210.877363:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f8318df80 x1875787997449216/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788891210.877379:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891210.877382:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788891210.877385:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891210.877388:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788891210.877390:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788891210.877393:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788891210.877395:0:37:0:(import.c:65:import_set_state_nolock()) ffff9250b4ed8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891210.877400:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9250b4ed8800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891210.877412:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f8318f800 x1875787997449344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788891210.877440:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788891210.877454:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad5d36d9-7941-4f84-88d2-361333de6068:3629:1875787997449088:0@lo:400:kworker.0 00000100:00100000:0.0:1788891210.877519:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891210.879655:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997449088 00000100:00100000:0.0:1788891210.879665:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997449088 00000100:00100000:0.0:1788891210.879718:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788891210.879727:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+12:3629:x1875787997449088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891210.879804:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+12:3629:x1875787997449088:12345-0@lo:400:kworker.0 Request processed in 78us (2284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891210.879812:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788891210.879856:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997449216:0@lo:38:kworker.0 00000100:00100000:0.0:1788891210.879892:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891210.879919:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875787997449344:0@lo:38:kworker.0 00000100:00100000:0.0:1788891210.879945:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891210.879990:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997449216 00000100:00100000:0.0:1788891210.879995:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997449216 00000100:00100000:0.0:1788891210.880015:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788891210.880019:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3626:x1875787997449216:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788891210.880037:0:22778:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788891210.880073:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3626:x1875787997449216:12345-0@lo:38:kworker.0 Request processed in 52us (180us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788891210.880080:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788891210.880107:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997449344 00000100:00100000:0.0:1788891210.880110:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997449344 00000100:00100000:0.0:1788891210.880129:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788891210.880141:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875787997449344:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788891210.880158:0:22774:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 433 last 0 00000020:00000080:0.0:1788891210.880190:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa66601b03fd54b27 00000004:00100000:0.0:1788891210.880204:0:22774:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788891210.880346:0:22774:0:(import.c:65:import_set_state_nolock()) ffff924f83869800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788891210.880383:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875787997449344:12345-0@lo:38:kworker.0 Request processed in 241us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891210.880389:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788891210.880427:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925083eda000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788891210.880431:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788891210.880435:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997449216:0@lo:38:kworker.0 00010000:00080000:0.0:1788891210.880449:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff924f8318f800 x1875787997449344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788891220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788891210.880462:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788891210.880469:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788891210.880474:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788891210.880477:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250b4ed8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788891210.880482:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875787997449344:0@lo:38:kworker.0 00000100:00100000:0.0:1788891210.880519:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad5d36d9-7941-4f84-88d2-361333de6068:3629:1875787997449088:0@lo:400:kworker.0 00010000:00010000:2.0:1788891211.323956:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891211.581897:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090298000 going to sleep for 0 seconds 00010000:00010000:3.0:1788891212.348934:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891212.604643:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090298000 going to sleep for 0 seconds 00010000:00010000:0.0:1788891213.372475:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891213.627582:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090298000 going to sleep for 0 seconds 00000020:01000004:0.0:1788891214.077560:0:23503:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788891214.077563:0:23503:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788891214.077565:0:23503:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788891214.077681:0:23503:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff924f832d8800 00000020:01000004:0.0:1788891214.077696:0:23503:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788891214.077709:0:23503:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788891214.077724:0:23503:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff925090b219b8) 00000020:00000080:0.0:1788891214.077741:0:23503:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788891214.119708:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788891214.120086:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788891214.122984:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788891214.123224:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788891214.123512:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788891214.124006:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788891214.124210:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788891214.124400:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788891214.124832:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788891214.125123:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788891214.125356:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788891214.125645:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788891214.125898:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788891214.126087:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788891214.126867:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788891214.127098:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788891214.127390:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788891214.127737:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788891214.127922:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788891214.128125:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788891214.128340:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788891214.128668:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788891214.128872:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788891214.129099:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788891214.129327:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788891214.129662:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788891214.129858:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788891214.130148:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788891214.130394:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788891214.130802:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788891214.131033:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788891214.131280:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788891214.131663:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788891214.131867:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788891214.132102:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788891214.132396:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788891214.132794:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788891214.133078:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788891214.133310:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788891214.133644:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788891214.133906:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788891214.134091:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788891214.134291:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788891214.134663:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788891214.134856:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788891214.135081:0:23503:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00080000:01000000:2.0:1788891214.137967:0:23503:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788891214.138195:0:23503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788891214.138207:0:23503:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788891214.138218:0:23503:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa66601b03fd54b35 00000020:01000004:2.0:1788891214.138224:0:23503:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788891214.138244:0:23503:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788891214.138248:0:23503:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788891214.138260:0:23503:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788891214.138285:0:23503:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788891214.138289:0:23503:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788891214.144877:0:23503:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788891214.144921:0:23503:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.126@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788891214.144930:0:23503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788891214.144932:0:23503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788891214.144933:0:23503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891214.144934:0:23503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891214.144935:0:23503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891214.144937:0:23503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891214.144938:0:23503:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788891214.144940:0:23503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891214.144941:0:23503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788891214.144945:0:23503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788891214.144947:0:23503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788891214.144948:0:23503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788891214.144949:0:23503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891214.144950:0:23503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891214.144951:0:23503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891214.144953:0:23503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891214.144954:0:23503:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788891214.144955:0:23503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891214.144956:0:23503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788891214.144984:0:23503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788891214.145008:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997449472:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788891214.145086:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891214.145203:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4780 going to sleep for 11 seconds 00000100:00100000:0.0:1788891214.145281:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997449472 00000100:00100000:0.0:1788891214.145289:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997449472 00000100:00100000:0.0:1788891214.145452:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788891214.145464:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+12:23503:x1875787997449472:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788891214.145498:0:22768:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788891214.145502:0:22768:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788891214.145509:0:22768:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788891214.146135:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+12:23503:x1875787997449472:12345-0@lo:253:mount.lustre.0 Request processed in 672us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891214.146145:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788891214.146223:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997449472:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788891214.146235:0:23503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788891214.146238:0:23503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788891214.146240:0:23503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788891214.146241:0:23503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891214.146242:0:23503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891214.146243:0:23503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891214.146244:0:23503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891214.146245:0:23503:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788891214.146247:0:23503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891214.146248:0:23503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788891214.146264:0:23503:0:(tgt_mount.c:101:server_register_mount()) register mount ffff924f832d8800 from lustre-MDT0001 10000000:01000000:0.0:1788891214.146290:0:23503:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788891214.146293:0:23503:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788891214.146299:0:23503:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff925090b24d28 local copy 00010000:00010000:0.0:1788891214.146309:0:23503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5600/0xa66601b03fd54a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54a32 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891214.146479:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997449600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891214.146514:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891214.146759:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baab2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788891214.146835:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997449600 00000100:00100000:1.0:1788891214.146842:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997449600 00000100:00100000:1.0:1788891214.146884:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788891214.146893:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+12:23503:x1875787997449600:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891214.146965:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+12:23503:x1875787997449600:12345-0@lo:501:mount.lustre.0 Request processed in 74us (451us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788891214.146972:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788891214.147042:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997449600:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788891214.147057:0:23503:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788891214.147074:0:23503:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788891214.147080:0:23503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5600/0xa66601b03fd54a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54a32 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891214.147088:0:23503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae5600/0xa66601b03fd54a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54a32 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891214.147114:0:23503:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff924f832d8800 10000000:01000000:0.0:1788891214.147120:0:23503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788891214.147125:0:23503:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff925090b24d28 10000000:01000000:0.0:1788891214.147128:0:23503:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788891214.147131:0:23503:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff925090b24d28 from 1 10000000:01000000:0.0:1788891214.147135:0:23503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788891214.147172:0:23503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5e00/0xa66601b03fd54b3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891214.147181:0:23503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae5e00/0xa66601b03fd54b3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891214.147190:0:23503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae5e00/0xa66601b03fd54b3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891214.147202:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997449728:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891214.147225:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891214.147249:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baab2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788891214.147300:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997449728 00000100:00100000:1.0:1788891214.147305:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997449728 00000100:00100000:1.0:1788891214.147341:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788891214.147348:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+12:23503:x1875787997449728:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891214.147356:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891214.147375:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c7600/0xa66601b03fd54b43 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54b3c expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891214.147394:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c7600/0xa66601b03fd54b43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54b3c expref: 13 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891214.147404:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c7600/0xa66601b03fd54b43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54b3c expref: 13 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891214.147413:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7600, rc 0) 00000100:00100000:1.0:1788891214.147439:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+13:23503:x1875787997449728:12345-0@lo:101:mount.lustre.0 Request processed in 92us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891214.147446:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788891214.147585:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997449728:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891214.147601:0:23503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae5e00/0xa66601b03fd54b3c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54b43 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891214.147611:0:23503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae5e00/0xa66601b03fd54b3c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54b43 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891214.147625:0:23503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788891214.147642:0:23503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5e00/0xa66601b03fd54b3c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54b43 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891214.147649:0:23503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae5e00/0xa66601b03fd54b3c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54b43 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891214.147656:0:23503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff924f832d8800 10000000:01000000:0.0:1788891214.147659:0:23503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788891214.147662:0:23503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff924f832d8800 from 1 10000000:01000000:0.0:1788891214.147664:0:23503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788891214.147678:0:23503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4200/0xa66601b03fd54b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891214.147685:0:23503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae4200/0xa66601b03fd54b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891214.147691:0:23503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae4200/0xa66601b03fd54b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891214.147704:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997449856:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891214.147728:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891214.147746:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baab2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788891214.147879:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997449856 00000100:00100000:1.0:1788891214.147883:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997449856 00000100:00100000:1.0:1788891214.147910:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788891214.147917:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+13:23503:x1875787997449856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891214.147924:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891214.147931:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c7200/0xa66601b03fd54b51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54b4a expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891214.147945:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c7200/0xa66601b03fd54b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54b4a expref: 14 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891214.147953:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c7200/0xa66601b03fd54b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54b4a expref: 14 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891214.147960:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7200, rc 0) 00000100:00100000:1.0:1788891214.147985:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+14:23503:x1875787997449856:12345-0@lo:101:mount.lustre.0 Request processed in 69us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891214.148000:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788891214.148078:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997449856:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891214.148090:0:23503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae4200/0xa66601b03fd54b4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54b51 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891214.148098:0:23503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae4200/0xa66601b03fd54b4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54b51 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891214.148108:0:23503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788891214.148123:0:23503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4200/0xa66601b03fd54b4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54b51 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891214.148131:0:23503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae4200/0xa66601b03fd54b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54b51 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891214.148136:0:23503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788891214.148140:0:23503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788891214.148144:0:23503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff924f832d8800 10000000:01000000:0.0:1788891214.148146:0:23503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788891214.148149:0:23503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788891214.148151:0:23503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788891214.148174:0:23503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5800/0xa66601b03fd54b58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891214.148182:0:23503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae5800/0xa66601b03fd54b58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891214.148190:0:23503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae5800/0xa66601b03fd54b58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891214.148201:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997449984:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891214.148230:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891214.148241:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baab2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788891214.148296:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997449984 00000100:00100000:1.0:1788891214.148300:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997449984 00000100:00100000:1.0:1788891214.148336:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788891214.148343:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+14:23503:x1875787997449984:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891214.148349:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891214.148356:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c7000/0xa66601b03fd54b5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54b58 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891214.148368:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c7000/0xa66601b03fd54b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54b58 expref: 15 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891214.148376:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c7000/0xa66601b03fd54b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54b58 expref: 15 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891214.148383:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7000, rc 0) 00000100:00100000:1.0:1788891214.148408:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+15:23503:x1875787997449984:12345-0@lo:101:mount.lustre.0 Request processed in 66us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891214.148414:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788891214.148697:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997449984:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891214.148708:0:23503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae5800/0xa66601b03fd54b58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54b5f expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891214.148715:0:23503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae5800/0xa66601b03fd54b58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54b5f expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788891214.149972:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1788891214.150708:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788891214.155122:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788891214.155197:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1788891214.155213:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1788891214.155227:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1788891214.155243:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1788891214.155259:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1788891214.155275:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1788891214.155290:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1788891214.155304:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1788891214.155317:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1788891214.155418:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1788891214.155435:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1788891214.155450:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1788891214.155464:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1788891214.155477:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1788891214.155488:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1788891214.155499:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1788891214.155510:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1788891214.155805:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1788891214.155828:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1788891214.155844:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1788891214.155859:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1788891214.155875:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1788891214.155890:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1788891214.155903:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1788891214.155918:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1788891214.155932:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1788891214.155946:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1788891214.155961:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1788891214.155977:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1788891214.155991:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1788891214.156008:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1788891214.156025:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1788891214.156040:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1788891214.156054:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1788891214.156068:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1788891214.156080:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1788891214.156093:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1788891214.156106:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1788891214.156121:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1788891214.156134:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1788891214.156148:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1788891214.156175:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1788891214.156201:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1788891214.156234:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1788891214.156241:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1788891214.156428:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997450112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891214.156499:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891214.156742:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83109f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788891214.156797:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997450112 00000100:00100000:2.0:1788891214.156805:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997450112 00000100:00100000:2.0:1788891214.156893:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788891214.156904:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+15:23503:x1875787997450112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891214.157062:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+15:23503:x1875787997450112:12345-0@lo:501:mount.lustre.0 Request processed in 160us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891214.157070:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788891214.157150:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997450112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891214.157195:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997450240:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788891214.157240:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891214.157343:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83109f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788891214.157417:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997450240 00000100:00100000:0.0:1788891214.157422:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997450240 00000100:00100000:0.0:1788891214.157446:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788891214.157452:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+15:23503:x1875787997450240:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891214.158197:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+15:23503:x1875787997450240:12345-0@lo:503:mount.lustre.0 Request processed in 742us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891214.158204:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788891214.158325:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997450240:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788891214.158948:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788891214.159022:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997450368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891214.159071:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891214.159140:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83109f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788891214.159179:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997450368 00000100:00100000:0.0:1788891214.159185:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997450368 00000100:00100000:0.0:1788891214.159225:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788891214.159234:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+15:23503:x1875787997450368:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891214.160038:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+15:23503:x1875787997450368:12345-0@lo:502:mount.lustre.0 Request processed in 803us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891214.160047:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788891214.160120:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997450368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788891214.160421:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788891214.160450:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1788891214.160463:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1788891214.160478:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1788891214.160493:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1788891214.160509:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1788891214.160675:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1788891214.160694:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1788891214.160721:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1788891214.160733:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1788891214.160745:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1788891214.160765:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1788891214.160777:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1788891214.160788:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1788891214.160800:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1788891214.160811:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1788891214.160824:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1788891214.160836:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1788891214.160849:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1788891214.160862:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1788891214.160873:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1788891214.160884:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1788891214.160896:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1788891214.160908:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1788891214.160930:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1788891214.160943:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1788891214.160955:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1788891214.160967:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1788891214.160978:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1788891214.160991:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1788891214.161003:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1788891214.161016:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1788891214.161028:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1788891214.161040:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1788891214.161054:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1788891214.161065:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1788891214.161077:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1788891214.161091:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1788891214.161104:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1788891214.161118:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1788891214.161147:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1788891214.161176:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1788891214.161190:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1788891214.161202:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1788891214.161248:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997450496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891214.161313:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891214.161468:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83109f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788891214.161510:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997450496 00000100:00100000:2.0:1788891214.161517:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997450496 00000100:00100000:2.0:1788891214.161778:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788891214.161788:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+15:23503:x1875787997450496:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891214.161903:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+15:23503:x1875787997450496:12345-0@lo:502:mount.lustre.0 Request processed in 116us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891214.161911:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788891214.161981:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997450496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788891214.162026:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1788891214.162034:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788891214.162835:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891214.162847:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891214.162853:0:23507:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788891214.162860:0:23507:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788891214.162863:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788891214.162876:0:23507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff925090b20000) 00000020:00000080:0.0:1788891214.162897:0:23507:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788891214.162903:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788891214.162994:0:23507:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788891214.163000:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa66601b03fd54b6d 00000020:00000080:0.0:1788891214.163226:0:23507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788891214.163231:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891214.163234:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891214.163236:0:23507:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788891214.163239:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891214.163242:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891214.163243:0:23507:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788891214.163246:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788891214.163254:0:23507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff92508f410000) 00000020:00000080:0.0:1788891214.163265:0:23507:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788891214.163269:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788891214.163271:0:23507:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788891214.163274:0:23507:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788891214.163279:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788891214.163317:0:23507:0:(tgt_mount.c:153:server_get_mount()) get mount ffff924f832d8800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788891214.163399:0:23507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff92508f413370) 00000020:00000080:0.0:1788891214.163412:0:23507:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788891214.163490:0:23507:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788891214.163496:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd54b82 00000020:00000080:0.0:1788891214.163827:0:23507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788891214.163834:0:23507:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788891214.163839:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xa66601b03fd54b89 00080000:01000000:0.0:1788891214.163844:0:23507:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788891214.163848:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa66601b03fd54b90 00010000:00010000:1.0:1788891214.213886:0:23507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1788891214.214384:0:23507:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:1.0:1788891214.214800:0:23507:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788891214.217484:0:23507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788891214.217497:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891214.217503:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891214.217505:0:23507:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788891214.217509:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891214.217515:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891214.217517:0:23507:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788891214.217540:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788891214.217546:0:23507:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:00000080:3.0:1788891214.217582:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788891214.217598:0:23507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff924f81ed19b8) 00000020:00000080:3.0:1788891214.217620:0:23507:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788891214.217624:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788891214.217696:0:23507:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788891214.217703:0:23507:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788891214.217709:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa66601b03fd54b9e 00010000:00080000:3.0:1788891214.217739:0:23507:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f839d0000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.126@tcp at head 00010000:00010000:3.0:1788891214.219328:0:23507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788891214.219860:0:23507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788891214.219871:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788891214.219904:0:23507:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788891214.219925:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd54ba5 00000100:00080000:3.0:1788891214.219935:0:23507:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788891214.219941:0:23507:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff924f839d0000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:3.0:1788891214.219974:0:23507:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9250bf738380 x1875787997450624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788891214.219997:0:23507:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788891214.220053:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891214.220057:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891214.220059:0:23507:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788891214.220062:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788891214.220065:0:23507:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788891214.220067:0:23507:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788891214.220068:0:23507:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788891214.220069:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788891214.220071:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891214.220072:0:23507:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788891214.220075:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891214.220079:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891214.220080:0:23507:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788891214.220090:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788891214.220122:0:23507:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788891214.220135:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891214.220139:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891214.220140:0:23507:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788891214.220143:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788891214.220144:0:23507:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1788891214.220145:0:23507:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788891214.220147:0:23507:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788891214.220149:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788891214.220151:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891214.220152:0:23507:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788891214.220166:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788891214.220170:0:23507:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788891214.220174:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891214.220175:0:23507:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788891214.220178:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788891214.220181:0:23507:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:3.0:1788891214.220203:0:23507:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788891214.220206:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788891214.220217:0:23507:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff924f81ed3370) 00000020:00000080:3.0:1788891214.220230:0:23507:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788891214.220234:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1788891214.221917:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997450624:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788891214.221988:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788891214.222063:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788891214.222069:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788891214.222072:0:37:0:(import.c:65:import_set_state_nolock()) ffff925083eda000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788891214.222077:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 433 00000100:00080000:1.0:1788891214.222083:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788891214.222089:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff925083eda000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891214.222116:0:37:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f833d0000 x1875787997450752/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788891214.222133:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891214.222137:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788891214.222140:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891214.222142:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788891214.222189:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997450752:0@lo:38:kworker.0 00000100:00100000:1.0:1788891214.222224:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891214.222281:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997450880:0@lo:400:kworker.0 00000100:00100000:1.0:1788891214.222311:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891214.222378:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997450624 00000100:00100000:1.0:1788891214.222385:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997450624 00000100:00100000:1.0:1788891214.222405:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997450752 00000100:00100000:1.0:1788891214.222408:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997450752 00000100:00100000:1.0:1788891214.222418:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788891214.222425:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1875787997450624:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788891214.222448:0:22777:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:1.0:1788891214.222480:0:22777:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd54bb3 00000004:00100000:1.0:1788891214.222495:0:22777:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788891214.222501:0:22777:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1788891214.222626:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997450880 00000100:00100000:1.0:1788891214.222630:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997450880 00000100:00100000:1.0:1788891214.222658:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788891214.222664:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997450880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891214.222706:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997450880:12345-0@lo:400:kworker.0 Request processed in 42us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891214.222713:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788891214.222746:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff924f833d2a00 x1875787997450880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891214.222759:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997450880:0@lo:400:kworker.0 00000004:00080000:3.0:1788891214.223996:0:23507:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788891214.224006:0:23507:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788891214.224015:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa66601b03fd54bba 00010000:00080000:3.0:1788891214.224050:0:23507:0:(ldlm_lib.c:102:import_set_conn()) imp ffff925088697800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.126@tcp at head 00010000:00010000:3.0:1788891214.224281:0:23507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:1.0:1788891214.228936:0:22777:0:(import.c:65:import_set_state_nolock()) ffff924f83106000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788891214.229033:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3626:x1875787997450624:12345-0@lo:38:llog_process_th.0 Request processed in 6604us (7042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891214.229053:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788891214.229079:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788891214.229086:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1875787997450752:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788891214.229129:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1875787997450752:12345-0@lo:38:kworker.0 Request processed in 43us (6904us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788891214.229135:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788891214.229211:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788891214.229219:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925083eda000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788891214.229223:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788891214.229232:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997450752:0@lo:38:kworker.0 00000100:00100000:3.0:1788891214.229248:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788891214.229254:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788891214.229262:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788891214.229268:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788891214.229270:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f839d0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788891214.229334:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997450624:0@lo:38:llog_process_th.0 00000040:01000000:2.0:1788891214.229565:0:23507:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788891214.229947:0:23507:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788891214.231250:0:23507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788891214.231437:0:23507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788891214.231726:0:23507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788891214.231986:0:23512:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788891214.231991:0:23512:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1788891214.232497:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997451008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788891214.232588:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891214.232731:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997451008 00000100:00100000:0.0:1788891214.232753:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997451008 00000100:00100000:0.0:1788891214.232799:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788891214.232808:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3628:x1875787997451008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788891214.232839:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446297600 avail 1300058112 00000100:00100000:0.0:1788891214.232885:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3628:x1875787997451008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891214.232892:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788891214.232936:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997451008:0@lo:41:osp-pre-0-1.0 00000020:00000080:2.0:1788891214.233477:0:23507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788891214.233489:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788891214.233780:0:23507:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788891214.233802:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd54bc1 00000100:00080000:2.0:1788891214.233809:0:23507:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788891214.233814:0:23507:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff925088697800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788891214.233837:0:23507:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9250a4887b80 x1875787997451136/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788891214.233886:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997451136:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788891214.233920:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875787997451136 offset 0 length 520: 4 00000100:00080000:2.0:1788891214.233966:0:23507:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788891214.234027:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891214.234031:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891214.234033:0:23507:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788891214.234036:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788891214.234038:0:23507:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788891214.234040:0:23507:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788891214.234041:0:23507:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788891214.234043:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788891214.234045:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891214.234046:0:23507:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788891214.234049:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788891214.234053:0:23507:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788891214.234056:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891214.234057:0:23507:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788891214.234060:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788891214.234063:0:23507:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:2.0:1788891214.234083:0:23507:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788891214.234086:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788891214.234098:0:23507:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff925091ac99b8) 00000020:00000080:2.0:1788891214.234110:0:23507:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788891214.234115:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788891214.234182:0:23507:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788891214.234189:0:23507:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788891214.234194:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa66601b03fd54bcf 00010000:00080000:2.0:1788891214.234221:0:23507:0:(ldlm_lib.c:102:import_set_conn()) imp ffff925083ec8800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.126@tcp at head 00010000:00010000:2.0:1788891214.234425:0:23507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788891214.234490:0:23507:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788891214.234503:0:23507:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1788891214.235243:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891214.235248:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788891214.235251:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891214.235254:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788891214.236213:0:23507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788891214.236441:0:23507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788891214.236758:0:23507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1788891214.237379:0:23514:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788891214.237384:0:23514:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788891214.238213:0:23507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788891214.238224:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788891214.238259:0:23507:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788891214.238278:0:23507:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd54bd6 00000100:00080000:2.0:1788891214.238288:0:23507:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788891214.238293:0:23507:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff925083ec8800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788891214.238389:0:23507:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9250a4884e00 x1875787997451264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788891214.238449:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997451264:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788891214.238500:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875787997451264 offset 0 length 520: 4 00000100:00080000:2.0:1788891214.238709:0:23507:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788891214.238763:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891214.238767:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891214.238769:0:23507:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788891214.238772:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891214.238776:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891214.238778:0:23507:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788891214.238781:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788891214.238783:0:23507:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788891214.238785:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891214.238788:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891214.238789:0:23507:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788891214.238791:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891214.238793:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891214.238795:0:23507:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788891214.238798:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788891214.238821:0:23507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891214.238823:0:23507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891214.238831:0:23507:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788891214.238835:0:23507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:1.0:1788891214.238976:0:23503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788891214.239002:0:23503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788891214.239025:0:23503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5800/0xa66601b03fd54b58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54b5f expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891214.239036:0:23503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae5800/0xa66601b03fd54b58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54b5f expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891214.239045:0:23503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff924f832d8800 from 1 10000000:01000000:1.0:1788891214.239048:0:23503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788891214.239079:0:23503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c6800/0xa66601b03fd54bdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891214.239088:0:23503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250b69c6800/0xa66601b03fd54bdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891214.239099:0:23503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250b69c6800/0xa66601b03fd54bdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891214.239121:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997451392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788891214.239171:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891214.239187:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508a529840 going to sleep for 11 seconds 00000100:00080000:1.0:1788891214.239205:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891214.239210:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788891214.239213:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891214.239216:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788891214.239299:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997451392 00000100:00100000:0.0:1788891214.239305:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997451392 00000100:00100000:0.0:1788891214.239358:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788891214.239368:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+15:23503:x1875787997451392:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891214.239380:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891214.239391:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae5000/0xa66601b03fd54be4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54bdd expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891214.239413:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae5000/0xa66601b03fd54be4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54bdd expref: 16 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891214.239423:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae5000/0xa66601b03fd54be4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54bdd expref: 16 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891214.239432:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5000, rc 0) 00000100:00100000:0.0:1788891214.239686:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+16:23503:x1875787997451392:12345-0@lo:101:mount.lustre.0 Request processed in 318us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891214.239693:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788891214.245477:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997451392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891214.245505:0:23503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250b69c6800/0xa66601b03fd54bdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54be4 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891214.245517:0:23503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250b69c6800/0xa66601b03fd54bdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54be4 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891214.246223:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997451520:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788891214.246288:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891214.246496:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508a529840 going to sleep for 11 seconds 00000100:00100000:3.0:1788891214.246802:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997451520 00000100:00100000:3.0:1788891214.246809:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997451520 00000100:00100000:3.0:1788891214.246862:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788891214.246871:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+16:23503:x1875787997451520:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788891214.246902:0:22768:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788891214.246919:0:22768:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788891214.246922:0:22768:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788891214.247019:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+16:23503:x1875787997451520:12345-0@lo:256:mount.lustre.0 Request processed in 149us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891214.247027:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788891214.247100:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997451520:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788891214.247891:0:23503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788891214.247918:0:23503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c6800/0xa66601b03fd54bdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54be4 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891214.247930:0:23503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250b69c6800/0xa66601b03fd54bdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54be4 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891214.247950:0:23503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff924f832d8800 from 1 10000000:01000000:1.0:1788891214.247953:0:23503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788891214.247982:0:23503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54beb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891214.247991:0:23503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54beb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891214.248001:0:23503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54beb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891214.248019:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997451648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788891214.248056:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891214.248089:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508a529840 going to sleep for 11 seconds 00000100:00100000:2.0:1788891214.248187:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997451648 00000100:00100000:2.0:1788891214.248193:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997451648 00000100:00100000:2.0:1788891214.248230:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788891214.248238:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+16:23503:x1875787997451648:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891214.248247:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891214.248260:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250813ed600/0xa66601b03fd54bf2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54beb expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.248280:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813ed600/0xa66601b03fd54bf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54beb expref: 17 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.248291:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250813ed600/0xa66601b03fd54bf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54beb expref: 17 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.248300:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ed600, rc 0) 00000100:00100000:2.0:1788891214.248442:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+17:23503:x1875787997451648:12345-0@lo:101:mount.lustre.0 Request processed in 204us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891214.248449:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788891214.248752:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997451648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891214.248766:0:23503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54beb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54bf2 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891214.248775:0:23503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54beb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54bf2 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788891214.249789:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:1.0:1788891214.250032:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788891214.250221:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788891214.250246:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1788891214.250263:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1788891214.250278:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1788891214.250290:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1788891214.250313:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1788891214.250384:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:1.0:1788891214.250415:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:1.0:1788891214.250429:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788891214.250442:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:1.0:1788891214.250453:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:1.0:1788891214.250474:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:1.0:1788891214.250479:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:1.0:1788891214.250746:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997451776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891214.250800:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891214.250878:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508a529c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788891214.250926:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997451776 00000100:00100000:3.0:1788891214.250932:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997451776 00000100:00100000:3.0:1788891214.251002:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788891214.251011:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+17:23503:x1875787997451776:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891214.251127:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+17:23503:x1875787997451776:12345-0@lo:501:mount.lustre.0 Request processed in 117us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891214.251135:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788891214.251215:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997451776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891214.251241:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997451904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788891214.251277:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891214.251423:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508a529c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788891214.251498:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997451904 00000100:00100000:2.0:1788891214.251503:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997451904 00000100:00100000:2.0:1788891214.251633:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788891214.251642:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+17:23503:x1875787997451904:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788891214.251724:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+17:23503:x1875787997451904:12345-0@lo:503:mount.lustre.0 Request processed in 83us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891214.251730:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788891214.251801:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997451904:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788891214.252136:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788891214.252201:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997452032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891214.252235:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891214.252266:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508a529840 going to sleep for 11 seconds 00000100:00100000:2.0:1788891214.252305:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997452032 00000100:00100000:2.0:1788891214.252309:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997452032 00000100:00100000:2.0:1788891214.252390:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788891214.252398:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+17:23503:x1875787997452032:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891214.252472:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+17:23503:x1875787997452032:12345-0@lo:502:mount.lustre.0 Request processed in 75us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891214.252479:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788891214.252623:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997452032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788891214.252770:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788891214.252794:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1788891214.252806:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1788891214.252818:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1788891214.252829:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1788891214.252841:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1788891214.252861:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1788891214.252874:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1788891214.252886:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788891214.252910:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1788891214.252923:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1788891214.252942:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997452160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891214.252974:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891214.252991:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508a529840 going to sleep for 11 seconds 00000100:00100000:2.0:1788891214.253050:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997452160 00000100:00100000:2.0:1788891214.253055:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997452160 00000100:00100000:2.0:1788891214.253074:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788891214.253079:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+17:23503:x1875787997452160:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891214.253147:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+17:23503:x1875787997452160:12345-0@lo:502:mount.lustre.0 Request processed in 67us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891214.253165:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788891214.253283:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997452160:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788891214.253318:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1788891214.253334:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788891214.254101:0:23516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891214.254111:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891214.254113:0:23516:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788891214.254121:0:23516:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff924f832d8800 00000020:00000080:2.0:1788891214.254123:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788891214.254131:0:23516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891214.254133:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891214.254135:0:23516:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788891214.254137:0:23516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891214.254140:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891214.254141:0:23516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788891214.254144:0:23516:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff924f832d8800 00000020:00000080:2.0:1788891214.254146:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788891214.254214:0:23516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891214.254217:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891214.254219:0:23516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788891214.254221:0:23516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891214.254224:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891214.254230:0:23516:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788891214.254235:0:23516:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff924f832d8800 00000020:00000080:2.0:1788891214.254237:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788891214.254263:0:23516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891214.254266:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891214.254268:0:23516:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788891214.254270:0:23516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891214.254273:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891214.254274:0:23516:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788891214.254277:0:23516:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff924f832d8800 00000020:00000080:2.0:1788891214.254279:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788891214.254299:0:23516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891214.254301:0:23516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891214.254303:0:23516:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788891214.254305:0:23516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1788891214.254494:0:23503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788891214.254518:0:23503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788891214.254568:0:23503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54beb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54bf2 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891214.254580:0:23503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54beb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54bf2 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891214.254627:0:23503:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788891214.254630:0:23503:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff924f832d8800 10000000:01000000:3.0:1788891214.254633:0:23503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff924f832d8800 10000000:01000000:3.0:1788891214.254637:0:23503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788891214.254642:0:23503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff924f832d8800 from 1 10000000:01000000:3.0:1788891214.254645:0:23503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788891214.254674:0:23503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd54bf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891214.254683:0:23503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd54bf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891214.254693:0:23503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd54bf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891214.254710:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997452288:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788891214.254762:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891214.254793:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250bab18300 going to sleep for 11 seconds 00000100:00100000:2.0:1788891214.259479:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997452288 00000100:00100000:2.0:1788891214.259491:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997452288 00000100:00100000:2.0:1788891214.259582:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788891214.259592:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+17:23503:x1875787997452288:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891214.259608:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891214.259626:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250813ec600/0xa66601b03fd54c00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54bf9 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.259652:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813ec600/0xa66601b03fd54c00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54bf9 expref: 18 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.259663:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250813ec600/0xa66601b03fd54c00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54bf9 expref: 18 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.259672:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ec600, rc 0) 00000100:00100000:2.0:1788891214.259739:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:23503:x1875787997452288:12345-0@lo:101:mount.lustre.0 Request processed in 149us (4976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891214.259752:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788891214.263479:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997452288:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891214.263506:0:23503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd54bf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54c00 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891214.263518:0:23503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd54bf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54c00 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788891214.266233:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1788891214.266643:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788891214.266851:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1788891214.266875:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1788891214.266888:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1788891214.266901:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1788891214.266913:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1788891214.266926:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1788891214.266938:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1788891214.266950:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1788891214.266961:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1788891214.266973:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1788891214.266985:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1788891214.266997:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1788891214.267008:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1788891214.267032:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1788891214.267047:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1788891214.267060:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1788891214.267071:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1788891214.267084:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1788891214.267098:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1788891214.267112:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1788891214.267125:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1788891214.267138:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1788891214.267173:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1788891214.267190:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1788891214.267202:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1788891214.267215:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1788891214.267227:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1788891214.267239:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1788891214.267251:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1788891214.267274:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1788891214.267287:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1788891214.267299:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1788891214.267311:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1788891214.267324:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1788891214.269670:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1788891214.269691:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1788891214.269704:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1788891214.269716:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1788891214.269727:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1788891214.269738:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1788891214.269750:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1788891214.269762:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1788891214.269774:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1788891214.269785:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1788891214.269797:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1788891214.269826:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1788891214.269840:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1788891214.269853:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1788891214.269999:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1788891214.270017:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1788891214.270033:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1788891214.270039:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1788891214.270147:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997452416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891214.270225:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891214.270282:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c0a149c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788891214.271083:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997452416 00000100:00100000:2.0:1788891214.271091:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997452416 00000100:00100000:2.0:1788891214.271140:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788891214.271150:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:23503:x1875787997452416:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891214.271458:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:23503:x1875787997452416:12345-0@lo:501:mount.lustre.0 Request processed in 308us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891214.271466:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788891214.275187:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997452416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891214.275246:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997452544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788891214.275308:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891214.275749:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8221ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788891214.275796:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997452544 00000100:00100000:2.0:1788891214.275803:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997452544 00000100:00100000:2.0:1788891214.275873:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788891214.275882:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+18:23503:x1875787997452544:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788891214.276024:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+18:23503:x1875787997452544:12345-0@lo:503:mount.lustre.0 Request processed in 143us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891214.276032:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788891214.276095:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997452544:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788891214.276942:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788891214.277007:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997452672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891214.277049:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891214.277078:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8221ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788891214.277124:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997452672 00000100:00100000:3.0:1788891214.277129:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997452672 00000100:00100000:3.0:1788891214.277172:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788891214.277179:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:23503:x1875787997452672:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891214.277258:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:23503:x1875787997452672:12345-0@lo:502:mount.lustre.0 Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891214.277265:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788891214.277434:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997452672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788891214.278489:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1788891214.278605:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:1.0:1788891214.278623:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:1.0:1788891214.278634:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:1.0:1788891214.278646:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:1.0:1788891214.278667:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:1.0:1788891214.278692:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:1.0:1788891214.278707:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:1.0:1788891214.278719:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:1.0:1788891214.278729:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:1.0:1788891214.278740:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:1.0:1788891214.278751:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:1.0:1788891214.278762:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:1.0:1788891214.278773:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:1.0:1788891214.278787:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:1.0:1788891214.278798:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:1.0:1788891214.278809:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:1.0:1788891214.278820:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:1.0:1788891214.278831:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:1.0:1788891214.278843:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:1.0:1788891214.278854:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:1.0:1788891214.278865:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:1.0:1788891214.278888:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:1.0:1788891214.278902:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:1.0:1788891214.278914:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:1.0:1788891214.278925:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:1.0:1788891214.278937:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:1.0:1788891214.278947:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:1.0:1788891214.278958:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:1.0:1788891214.278971:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:1.0:1788891214.278983:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:1.0:1788891214.278996:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:1.0:1788891214.279009:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:1.0:1788891214.279022:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:1.0:1788891214.279034:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:1.0:1788891214.279047:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:1.0:1788891214.279061:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:1.0:1788891214.279073:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:1.0:1788891214.279105:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:1.0:1788891214.279121:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:1.0:1788891214.279136:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:1.0:1788891214.279147:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:1.0:1788891214.279174:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:1.0:1788891214.279189:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:1.0:1788891214.279201:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:1.0:1788891214.279214:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:1.0:1788891214.279226:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:1.0:1788891214.279239:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:1.0:1788891214.279294:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997452800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891214.280172:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891214.280216:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8221ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788891214.280265:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997452800 00000100:00100000:2.0:1788891214.280271:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997452800 00000100:00100000:2.0:1788891214.280349:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788891214.280359:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:23503:x1875787997452800:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891214.280497:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:23503:x1875787997452800:12345-0@lo:502:mount.lustre.0 Request processed in 138us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891214.280505:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788891214.280702:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997452800:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788891214.280902:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1788891214.280929:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1788891214.280958:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997452928:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891214.280998:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891214.281020:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baab2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788891214.281109:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997452928 00000100:00100000:2.0:1788891214.281113:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997452928 00000100:00100000:2.0:1788891214.281142:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788891214.281148:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:23503:x1875787997452928:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891214.281227:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:23503:x1875787997452928:12345-0@lo:502:mount.lustre.0 Request processed in 78us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891214.281234:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788891214.281271:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997452928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788891214.281307:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1788891214.281314:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788891214.282461:0:23521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788891214.282477:0:23521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff92508f4119b8) 00000020:00000080:0.0:1788891214.282498:0:23521:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788891214.282644:0:23521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff924f832d8800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788891214.282648:0:23521:0:(tgt_mount.c:187:server_put_mount()) put mount ffff924f832d8800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788891214.282651:0:23521:0:(obd_mount.c:710:lustre_put_lsi()) put ffff924f832d8800 3 00010000:00080000:0.0:1788891214.282682:0:23521:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f832dd000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.126@tcp at head 00010000:00010000:0.0:1788891214.284695:0:23521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1788891214.284931:0:23521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788891214.284970:0:23521:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788891214.284982:0:23521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xa66601b03fd54c0e 00000100:00080000:0.0:1788891214.284991:0:23521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788891214.284997:0:23521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff924f832dd000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891214.285030:0:23521:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f8318f800 x1875787997453056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788891214.285133:0:23521:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788891214.285224:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875787997453056:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788891214.285294:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788891214.285391:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891214.285396:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788891214.285398:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891214.285401:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1788891214.285592:0:23521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1788891214.286171:0:23503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788891214.286204:0:23503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788891214.286221:0:23503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd54bf9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54c00 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.286231:0:23503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8ae00/0xa66601b03fd54bf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54c00 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788891214.286290:0:23503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788891214.286292:0:23503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788891214.286293:0:23503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788891214.286294:0:23503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788891214.286296:0:23503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788891214.286297:0:23503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788891214.286299:0:23503:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788891214.286300:0:23503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788891214.286302:0:23503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788891214.286306:0:23503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788891214.286308:0:23503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788891214.286309:0:23503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788891214.286310:0:23503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788891214.286311:0:23503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788891214.286312:0:23503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788891214.286313:0:23503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788891214.286315:0:23503:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788891214.286316:0:23503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788891214.286317:0:23503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788891214.286341:0:23503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788891214.286354:0:23503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4886a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997453184:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788891214.286400:0:23503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891214.286431:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997453184 00000100:00100000:2.0:1788891214.286437:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997453184 00000100:00100000:2.0:1788891214.286473:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788891214.286481:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:23503:x1875787997453184:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788891214.286505:0:22767:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788891214.286517:0:22767:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788891214.286743:0:23503:0:(client.c:2715:ptlrpc_set_wait()) set ffff92509006b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891214.288250:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997453056 00000100:00100000:0.0:1788891214.288261:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997453056 00000100:00100000:0.0:1788891214.288336:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788891214.288343:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1875787997453056:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788891214.288368:0:22772:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:0.0:1788891214.288413:0:22772:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa66601b03fd54c15 00000004:00100000:0.0:1788891214.288429:0:22772:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788891214.288458:0:22772:0:(import.c:65:import_set_state_nolock()) ffff9250bf769000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788891214.288556:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875787997453056:12345-0@lo:38:llog_process_th.0 Request processed in 212us (3262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891214.288564:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788891214.288648:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff924f8318f800 x1875787997453056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788891224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891214.288659:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788891214.288666:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788891214.288674:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788891214.288678:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788891214.288681:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f832dd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788891214.288687:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875787997453056:0@lo:38:llog_process_th.0 00000001:00100000:3.0:1788891214.290867:0:22753:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788891214.290959:0:22767:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788891214.290976:0:22767:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788891214.291082:0:22788:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788891214.291087:0:22788:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788891214.291109:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff925091a8b200/0xa66601b03fd54c1c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891214.291127:0:22788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925091a8ba00/0xa66601b03fd54b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54b19 expref: 18 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891214.291134:0:22788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250baae5000/0xa66601b03fd54be4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54bdd expref: 18 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891214.291142:0:22788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff925091a8b200/0xa66601b03fd54c1c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891214.291190:0:22788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250baae5000/0xa66601b03fd54be4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd54bdd expref: 18 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891214.291204:0:22788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250baae5000/0xa66601b03fd54be4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd54bdd expref: 18 pid: 22765 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891214.291219:0:22788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875787997453312:0@lo:104: 00000100:00100000:3.0:1788891214.291286:0:22788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788891214.291466:0:22788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925091a8ba00/0xa66601b03fd54b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd54b19 expref: 18 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891214.291475:0:22788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff925091a8ba00/0xa66601b03fd54b20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd54b19 expref: 18 pid: 22768 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891214.291484:0:22788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875787997453440:0@lo:104: 00000100:00100000:3.0:1788891214.291507:0:22788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891214.291565:0:22788:0:(client.c:2715:ptlrpc_set_wait()) set ffff925095be6300 going to sleep for 11 seconds 00000100:00100000:2.0:1788891214.291687:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997453312 00000100:00100000:2.0:1788891214.291693:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997453312 00000100:00100000:2.0:1788891214.291720:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997453440 00000100:00100000:2.0:1788891214.291722:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997453440 00000100:00100000:2.0:1788891214.291734:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788891214.291743:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad5d36d9-7941-4f84-88d2-361333de6068+4:22788:x1875787997453312:12345-0@lo:104: 00010000:00010000:2.0:1788891214.291754:0:22757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250b69c6800/0xa66601b03fd54bdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54be4 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.291821:0:22757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788891214.291827:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad5d36d9-7941-4f84-88d2-361333de6068+4:22788:x1875787997453312:12345-0@lo:104: Request processed in 85us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891214.291834:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788891214.291851:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788891214.291857:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad5d36d9-7941-4f84-88d2-361333de6068+3:22788:x1875787997453440:12345-0@lo:104: 00010000:00010000:2.0:1788891214.291864:0:22757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54b19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54b20 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.291894:0:22757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788891214.291898:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad5d36d9-7941-4f84-88d2-361333de6068+3:22788:x1875787997453440:12345-0@lo:104: Request processed in 43us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891214.291904:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788891214.291922:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788891214.291927:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250b69c6800/0xa66601b03fd54bdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54be4 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.291934:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6800 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891214.291938:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c6800/0xa66601b03fd54bdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd54be4 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.291946:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250b69c6800/0xa66601b03fd54bdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd54be4 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891214.291954:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c6800/0xa66601b03fd54bdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd54be4 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891214.291959:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788891214.291989:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250b69c6800/0xa66601b03fd54bdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54be4 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.291996:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891214.292016:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250b69c6800/0xa66601b03fd54bdd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54be4 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.292023:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250b69c6800/0xa66601b03fd54bdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54be4 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.292033:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891214.292036:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54b19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54b20 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.292042:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4e00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891214.292045:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54b19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd54b20 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.292052:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd54b20 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891214.292057:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd54b20 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891214.292062:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788891214.292073:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54b19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54b20 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.292079:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891214.292085:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54b19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54b20 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.292101:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54b19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54b20 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.292113:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891214.292114:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891214.292116:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891214.292123:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891214.292142:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad5d36d9-7941-4f84-88d2-361333de6068:3629:1875787997453568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891214.292180:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891214.292203:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788891214.292209:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad5d36d9-7941-4f84-88d2-361333de6068:3629:1875787997453696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891214.292227:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891214.292259:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997453568 00000100:00100000:2.0:1788891214.292263:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997453568 00010000:00010000:2.0:1788891214.292280:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250baae5000/0xa66601b03fd54be4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54bdd expref: 19 pid: 22765 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891214.292298:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997453696 00000100:00100000:2.0:1788891214.292301:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997453696 00010000:00010000:2.0:1788891214.292311:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925091a8ba00/0xa66601b03fd54b20 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54b19 expref: 20 pid: 22768 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891214.292338:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788891214.292344:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4886300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad5d36d9-7941-4f84-88d2-361333de6068+20:3629:x1875787997453568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891214.292353:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891214.292359:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250baae5000/0xa66601b03fd54be4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54bdd expref: 20 pid: 22765 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.292378:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250baae5000/0xa66601b03fd54be4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd54bdd expref: 20 pid: 22765 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.292393:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891214.292423:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4886300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad5d36d9-7941-4f84-88d2-361333de6068+20:3629:x1875787997453568:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891214.292429:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788891214.292442:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788891214.292449:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4884a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad5d36d9-7941-4f84-88d2-361333de6068+19:3629:x1875787997453696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891214.292456:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891214.292460:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925091a8ba00/0xa66601b03fd54b20 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54b19 expref: 19 pid: 22768 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.292469:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925091a8ba00/0xa66601b03fd54b20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd54b19 expref: 19 pid: 22768 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.292480:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff925091a8b200/0xa66601b03fd54c1c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.292487:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8b200/0xa66601b03fd54c1c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788891214.292497:0:22758:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001411431s 00010000:00010000:2.0:1788891214.292501:0:22758:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925091a8b200/0xa66601b03fd54c1c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.292507:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925091a8b200/0xa66601b03fd54c1c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.292618:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff925091a8b200/0xa66601b03fd54c1c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.292626:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff925091a8b200/0xa66601b03fd54c1c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.292631:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891214.292636:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff925091a8b200/0xa66601b03fd54c1c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.292643:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff925091a8b200/0xa66601b03fd54c1c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.292651:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff925091a8b200/0xa66601b03fd54c1c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891214.292661:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891214.292686:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4884a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad5d36d9-7941-4f84-88d2-361333de6068+19:3629:x1875787997453696:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891214.292693:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788891214.292729:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad5d36d9-7941-4f84-88d2-361333de6068:3629:1875787997453696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891214.292738:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad5d36d9-7941-4f84-88d2-361333de6068:3629:1875787997453568:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788891214.292956:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae5000/0xa66601b03fd54be4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd54bdd expref: 18 pid: 22765 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891214.292968:0:22788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875787997453312:0@lo:104: 00010000:00010000:3.0:1788891214.292979:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8ba00/0xa66601b03fd54b20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd54b19 expref: 17 pid: 22768 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891214.292987:0:22788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875787997453440:0@lo:104: 00010000:00010000:3.0:1788891214.293000:0:22788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff925091a8b200/0xa66601b03fd54c1c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891214.293009:0:22788:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff925091a8b200/0xa66601b03fd54c1c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891214.293015:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff925091a8b200/0xa66601b03fd54c1c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891214.293021:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8b200/0xa66601b03fd54c1c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891214.293219:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+16:23503:x1875787997453184:12345-0@lo:253:mount.lustre.0 Request processed in 6737us (6817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891214.293229:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788891214.293382:0:23503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4886a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:23503:1875787997453184:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788891214.293392:0:23503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788891214.293396:0:23503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788891214.293398:0:23503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788891214.293399:0:23503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891214.293400:0:23503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891214.293401:0:23503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891214.293403:0:23503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891214.293404:0:23503:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788891214.293406:0:23503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891214.293407:0:23503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788891214.293416:0:23503:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:3.0:1788891214.296209:0:23503:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788891214.296451:0:23526:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788891214.296465:0:23526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788891214.297270:0:23527:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788891214.297709:0:23503:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1788891214.297873:0:23527:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788891214.298552:0:23503:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788891214.298590:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788891214.298691:0:23528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23528:1875787997453824:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788891214.298755:0:23528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891214.298791:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997453824 00000100:00100000:0.0:1788891214.298797:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997453824 00000100:00100000:0.0:1788891214.298833:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788891214.298840:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23528:x1875787997453824:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788891214.298898:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23528:x1875787997453824:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 58us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891214.298905:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788891214.298924:0:23528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891214.298943:0:23528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23528:1875787997453824:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788891214.298967:0:23528:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788891214.298987:0:23528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23528:1875787997453952:0@lo:1000:lod0001_rec0000.0 00000004:00000080:3.0:1788891214.298999:0:23503:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788891214.299004:0:23503:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:0.0:1788891214.299012:0:23528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891214.299028:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997453952 00000100:00100000:0.0:1788891214.299031:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997453952 00000100:00100000:0.0:1788891214.299047:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788891214.299060:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23528:x1875787997453952:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788891214.299144:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23528:x1875787997453952:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 84us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891214.299151:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788891214.299196:0:23528:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8388da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788891214.299207:0:23528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23528:1875787997453952:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788891214.299246:0:23528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23528:1875787997454080:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788891214.299270:0:23528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891214.299298:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997454080 00000100:00100000:0.0:1788891214.299301:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997454080 00000100:00100000:0.0:1788891214.299333:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788891214.299339:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23528:x1875787997454080:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788891214.299368:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23528:x1875787997454080:12345-0@lo:900:lod0001_rec0000.0 Request processed in 29us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891214.299374:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788891214.299389:0:23528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4240 going to sleep for 11 seconds 00010000:00080000:0.0:1788891214.299401:0:23528:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff924f8318df80 x1875787997454080/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788891230 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891214.299412:0:23528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23528:1875787997454080:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788891214.299439:0:23528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23528:1875787997454208:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788891214.299459:0:23528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891214.299473:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997454208 00000100:00100000:0.0:1788891214.299476:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997454208 00000100:00100000:0.0:1788891214.299489:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788891214.299494:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23528:x1875787997454208:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788891214.299621:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23528:x1875787997454208:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 125us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891214.299627:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788891214.299640:0:23528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891214.299649:0:23528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23528:1875787997454208:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788891214.299717:0:23528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788891214.300198:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788891214.302797:0:23503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788891214.303690:0:23527:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788891214.303745:0:23527:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788891214.304412:0:23503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788891214.304445:0:23503:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788891214.304638:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788891214.305308:0:23528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00080000:10000000:3.0:1788891214.305391:0:23503:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000004:00080000:0.0:1788891214.305468:0:23528:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788891214.305473:0:23528:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1788891214.307003:0:23503:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1788891214.310132:0:23503:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788891214.310178:0:23503:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbbfc4189f988 00100000:10000000:3.0:1788891214.310186:0:23503:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788891214.310905:0:23503:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788891214.310931:0:23503:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788891214.310950:0:23503:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788891214.310971:0:23503:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788891214.312951:0:23503:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788891214.313166:0:23503:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788891214.395706:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891214.654224:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090298000 going to sleep for 0 seconds 00000100:00100000:1.0:1788891215.294148:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891205/real 1788891205] req@ffff924f8318d880 x1875787997446272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891215 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891215.294189:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff924f8318d880 x1875787997446272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891215 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891215.294201:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891205/real 1788891205] req@ffff9250bf73b480 x1875787997446144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891215 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891215.294213:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9250bf73b480 x1875787997446144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891215 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788891215.294230:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250900ed800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788891215.294253:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788891215.294257:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997446272:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788891215.294263:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250875b5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788891215.294268:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788891215.294271:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997446144:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788891215.296975:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788891215.296981:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788891215.296985:0:467:0:(import.c:65:import_set_state_nolock()) ffff925083eda000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891215.296997:0:467:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff925083eda000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891215.297020:0:467:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f8318d180 x1875787997454464/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788891215.297036:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891215.297039:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788891215.297041:0:467:0:(import.c:65:import_set_state_nolock()) ffff9250875b5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891215.297045:0:467:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 427 00000100:00080000:0.0:1788891215.297049:0:467:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788891215.297053:0:467:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9250875b5800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891215.297065:0:467:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f8318dc00 x1875787997454592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788891215.297074:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891215.297093:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788891215.297095:0:467:0:(import.c:65:import_set_state_nolock()) ffff9250900ed800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891215.297099:0:467:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 427 00000100:00080000:0.0:1788891215.297102:0:467:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788891215.297106:0:467:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9250900ed800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891215.297119:0:467:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f8318ea00 x1875787997454720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788891215.297165:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891215.297169:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788891215.297172:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891215.297175:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788891215.297212:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997455104:0@lo:400:kworker.0 00000100:00100000:0.0:1788891215.297286:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891215.297326:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788891215.297331:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997454976:0@lo:400:kworker.0 00000100:00100000:0.0:1788891215.297358:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891215.297391:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997455104 00000100:00100000:0.0:1788891215.297399:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997455104 00000100:00100000:0.0:1788891215.297447:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788891215.297456:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997455104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891215.297513:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997455104:12345-0@lo:400:kworker.0 Request processed in 58us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891215.297554:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788891215.297580:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997454976 00000100:00100000:0.0:1788891215.297583:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997454976 00000100:00100000:0.0:1788891215.297622:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788891215.297629:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997454976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891215.297663:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997454976:12345-0@lo:400:kworker.0 Request processed in 35us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891215.297668:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788891215.297707:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997454976:0@lo:400:kworker.0 00010000:00080000:0.0:1788891215.297718:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff924f8318d880 x1875787997455104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891215.297727:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997455104:0@lo:400:kworker.0 00000100:00100000:3.0:1788891215.297825:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997454848:0@lo:400:kworker.0 00000100:00100000:3.0:1788891215.297859:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891215.297886:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788891215.297892:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad5d36d9-7941-4f84-88d2-361333de6068:3628:1875787997454336:0@lo:400:kworker.0 00000100:00100000:3.0:1788891215.297919:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891215.297990:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997454848 00000100:00100000:0.0:1788891215.297995:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997454848 00000100:00100000:0.0:1788891215.298028:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788891215.298035:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997454848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891215.298071:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997454848:12345-0@lo:400:kworker.0 Request processed in 37us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891215.298077:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788891215.298101:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff924f8318f480 x1875787997454848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891215.298110:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997454848:0@lo:400:kworker.0 00000100:00100000:1.0:1788891215.298319:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997454336 00000100:00100000:1.0:1788891215.298324:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997454336 00000100:00100000:1.0:1788891215.298363:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788891215.298371:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+16:3628:x1875787997454336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891215.298416:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+16:3628:x1875787997454336:12345-0@lo:400:kworker.0 Request processed in 47us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891215.298422:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788891215.298458:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997454464:0@lo:38:kworker.0 00000100:00100000:1.0:1788891215.298486:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891215.298505:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997454592:0@lo:8:kworker.0 00000400:00000100:1.0:1788891215.298571:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875787997454592 offset 0 length 520: 4 00000100:00100000:1.0:1788891215.298584:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997454720:0@lo:8:kworker.0 00000400:00000100:1.0:1788891215.298597:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875787997454720 offset 0 length 520: 4 00000100:00100000:1.0:1788891215.298619:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997454464 00000100:00100000:1.0:1788891215.298622:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997454464 00000100:00100000:1.0:1788891215.298641:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788891215.298645:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3626:x1875787997454464:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788891215.298670:0:22778:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:1.0:1788891215.298705:0:22778:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd54c23 00000004:00100000:1.0:1788891215.298722:0:22778:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788891215.298729:0:22778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1788891215.298986:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad5d36d9-7941-4f84-88d2-361333de6068:3628:1875787997454336:0@lo:400:kworker.0 00000100:00080000:0.0:1788891215.304493:0:22778:0:(import.c:65:import_set_state_nolock()) ffff9250c12d9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788891215.304670:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1875787997454464:12345-0@lo:38:kworker.0 Request processed in 6021us (6181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891215.304682:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788891215.305909:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788891215.305922:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788891215.305928:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788891215.305932:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925083eda000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788891215.305956:0:3626:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000056ec5129): req@ffff924f8318d500 x1875787997448704/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891215.305981:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997454464:0@lo:38:kworker.0 00000100:00100000:0.0:1788891215.306198:0:22814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891215.306231:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090298000 going to sleep for 11 seconds 00000100:00100000:1.0:1788891215.306285:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997448704 00000100:00100000:1.0:1788891215.306291:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997448704 00000100:00100000:1.0:1788891215.306336:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788891215.306345:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22814:x1875787997448704:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788891215.306426:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22814:x1875787997448704:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 82us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891215.306433:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788891215.306459:0:22814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22814:1875787997448704:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788891215.306495:0:22814:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788891215.306554:0:22814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22814:1875787997455232:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788891215.306587:0:22814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891215.306613:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250ba9c4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788891215.306664:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788891215.306675:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997455360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788891215.306727:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891215.308987:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997455232 00000100:00100000:3.0:1788891215.308999:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997455232 00000100:00100000:3.0:1788891215.309039:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997455360 00000100:00100000:3.0:1788891215.309042:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997455360 00000100:00100000:3.0:1788891215.309058:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788891215.309066:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22814:x1875787997455232:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788891215.309257:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22814:x1875787997455232:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 190us (2669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891215.309265:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788891215.309281:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788891215.309287:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3628:x1875787997455360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788891215.309307:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788891215.309355:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3628:x1875787997455360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (2627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891215.309362:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788891215.309377:0:22814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22814:1875787997455232:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788891215.309477:0:22814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d0380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22814:1875787997455488:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788891215.309609:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997455360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788891215.309881:0:22814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891215.309904:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baa2be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788891215.309962:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997455488 00000100:00100000:3.0:1788891215.309967:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997455488 00000100:00100000:3.0:1788891215.309987:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788891215.309993:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22814:x1875787997455488:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788891215.310049:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22814:x1875787997455488:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 56us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891215.310067:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788891215.311222:0:22814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d0380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22814:1875787997455488:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788891215.311282:0:22814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788891215.313355:0:22814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788891215.313440:0:22814:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 10, retries 0 00000004:00080000:1.0:1788891215.313445:0:22814:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1788891215.356152:0:23529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788891215.419682:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788891216.316300:0:22770:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788891216.316309:0:22770:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff924f832d8800 from 12 10000000:01000000:0.0:1788891216.316315:0:22770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788891216.316364:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54c2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891216.316375:0:22770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54c2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891216.316386:0:22770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54c2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891216.316412:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997455616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788891216.316478:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891216.316543:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baab2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788891216.316558:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997455616 00000100:00100000:1.0:1788891216.316568:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997455616 00000100:00100000:1.0:1788891216.316624:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788891216.316636:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+16:22770:x1875787997455616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891216.316649:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891216.316664:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54c31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54c2a expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891216.316686:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54c31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54c2a expref: 17 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891216.316698:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54c31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54c2a expref: 17 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891216.316707:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6c00, rc 0) 00000100:00100000:1.0:1788891216.316755:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+17:22770:x1875787997455616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891216.316762:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788891216.316797:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997455616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788891216.316812:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54c2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54c31 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891216.316822:0:22770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54c2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54c31 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891216.316872:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997455744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788891216.316898:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891216.316925:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baab2180 going to sleep for 11 seconds 00000100:00100000:3.0:1788891216.320515:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997455744 00000100:00100000:3.0:1788891216.320566:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997455744 00000100:00100000:3.0:1788891216.320625:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788891216.320635:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+17:22770:x1875787997455744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788891216.320661:0:22765:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788891216.320677:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788891216.320680:0:22765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788891216.320833:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+17:22770:x1875787997455744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 198us (3932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891216.320841:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788891216.320897:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997455744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788891216.320957:0:22770:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788891216.320967:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54c2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54c31 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891216.320978:0:22770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54c2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54c31 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891216.320988:0:22770:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788891216.320991:0:22770:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9250b4f3c000 from 12 10000000:01000000:3.0:1788891216.320994:0:22770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788891216.321026:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54c38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891216.321035:0:22770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54c38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891216.321055:0:22770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54c38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891216.321076:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997455872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788891216.321109:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891216.321157:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f830ff540 going to sleep for 11 seconds 00000100:00100000:0.0:1788891216.321167:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997455872 00000100:00100000:0.0:1788891216.321172:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997455872 00000100:00100000:0.0:1788891216.321195:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788891216.321202:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+17:22770:x1875787997455872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788891216.321211:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891216.321227:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae4a00/0xa66601b03fd54c3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54c38 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891216.321250:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae4a00/0xa66601b03fd54c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54c38 expref: 18 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891216.321267:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae4a00/0xa66601b03fd54c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54c38 expref: 18 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891216.321278:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4a00, rc 0) 00000100:00100000:0.0:1788891216.321319:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+18:22770:x1875787997455872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891216.321326:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788891216.321483:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997455872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788891216.321495:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54c38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54c3f expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891216.321503:0:22770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54c38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54c3f expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891216.321563:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997456000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788891216.321595:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891216.321677:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f830ff540 going to sleep for 11 seconds 00000100:00100000:0.0:1788891216.321715:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997456000 00000100:00100000:0.0:1788891216.321719:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997456000 00000100:00100000:0.0:1788891216.321747:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788891216.321752:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:22770:x1875787997456000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788891216.321764:0:22767:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788891216.321778:0:22767:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788891216.321781:0:22767:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788891216.321855:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:22770:x1875787997456000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891216.321863:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788891216.321982:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997456000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788891216.322016:0:22770:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788891216.322023:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54c38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54c3f expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891216.322031:0:22770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54c38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54c3f expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788891216.381185:0:23529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788891216.447092:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788891217.318469:0:23771:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788891217.468628:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788891217.726898:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788891217.943742:0:23823:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788891217.943919:0:23823:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788891218.491749:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788891218.612909:0:23874:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788891218.613104:0:23874:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000080:0.0:1788891219.293094:0:23922:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebbe9c8e0 20000000:00000080:0.0:1788891219.293114:0:23922:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9250843e4800 uarg=0000000000000000 20000000:01000000:0.0:1788891219.293156:0:23922:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788891219.293164:0:23922:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788891219.293168:0:23922:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788891219.293631:0:23923:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788891219.293801:0:23922:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788891219.306567:0:23922:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788891219.308572:0:23922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9250baae5a00/0xa66601b03fd54c46 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891219.308883:0:23922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925091a8a200/0xa66601b03fd54aef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54ae8 expref: 17 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891219.308893:0:23922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250813ed600/0xa66601b03fd54bf2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54beb expref: 17 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891219.308900:0:23922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9250baae5a00/0xa66601b03fd54c46 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891219.308942:0:23922:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250813ed600/0xa66601b03fd54bf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd54beb expref: 17 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891219.308955:0:23922:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250813ed600/0xa66601b03fd54bf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd54beb expref: 17 pid: 22767 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891219.308983:0:23922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23922:1875787997456128:0@lo:104: 00000100:00100000:0.0:1788891219.309043:0:23922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891219.309222:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997456128 00000100:00100000:2.0:1788891219.309239:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997456128 00010000:00010000:0.0:1788891219.309368:0:23922:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925091a8a200/0xa66601b03fd54aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd54ae8 expref: 17 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891219.309378:0:23922:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff925091a8a200/0xa66601b03fd54aef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd54ae8 expref: 17 pid: 22768 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891219.309387:0:23922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23922:1875787997456256:0@lo:104: 00000100:00100000:2.0:1788891219.309409:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788891219.309415:0:23922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891219.309424:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad5d36d9-7941-4f84-88d2-361333de6068+3:23922:x1875787997456128:12345-0@lo:104: 00010000:00010000:2.0:1788891219.309443:0:22757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54beb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54bf2 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.309499:0:22757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788891219.309505:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad5d36d9-7941-4f84-88d2-361333de6068+3:23922:x1875787997456128:12345-0@lo:104: Request processed in 86us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891219.309512:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788891219.309708:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891219.309715:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54beb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54bf2 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891219.309723:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6000 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:3.0:1788891219.309727:0:22762:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54beb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd54bf2 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891219.309736:0:22762:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54beb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd54bf2 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788891219.309743:0:22762:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54beb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd54bf2 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891219.309748:0:22762:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788891219.309776:0:22762:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54beb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54bf2 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891219.309782:0:22762:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788891219.309800:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54beb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54bf2 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891219.309806:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54beb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54bf2 expref: -99 pid: 23503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891219.309818:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891219.309819:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891219.309821:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891219.309840:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad5d36d9-7941-4f84-88d2-361333de6068:3628:1875787997456384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788891219.309870:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891219.309920:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997456384 00000100:00100000:3.0:1788891219.309924:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997456384 00010000:00010000:3.0:1788891219.309944:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250813ed600/0xa66601b03fd54bf2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54beb expref: 18 pid: 22767 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891219.309966:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788891219.309973:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad5d36d9-7941-4f84-88d2-361333de6068+18:3628:x1875787997456384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788891219.309982:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891219.309988:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250813ed600/0xa66601b03fd54bf2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54beb expref: 18 pid: 22767 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891219.309997:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250813ed600/0xa66601b03fd54bf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd54beb expref: 18 pid: 22767 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891219.310012:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891219.310040:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad5d36d9-7941-4f84-88d2-361333de6068+18:3628:x1875787997456384:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891219.310046:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788891219.310091:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad5d36d9-7941-4f84-88d2-361333de6068:3628:1875787997456384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788891219.314577:0:23922:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8221c780 going to sleep for 11 seconds 00010000:00010000:0.0:1788891219.314627:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813ed600/0xa66601b03fd54bf2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd54beb expref: 17 pid: 22767 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891219.314637:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997456256 00000100:00100000:2.0:1788891219.314646:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997456256 00000100:00100000:0.0:1788891219.314646:0:23922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23922:1875787997456128:0@lo:104: 00000100:00100000:2.0:1788891219.314691:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788891219.314700:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad5d36d9-7941-4f84-88d2-361333de6068+3:23922:x1875787997456256:12345-0@lo:104: 00010000:00010000:2.0:1788891219.314715:0:22757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250baae4000/0xa66601b03fd54ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54aef expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.314921:0:22757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788891219.314928:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad5d36d9-7941-4f84-88d2-361333de6068+3:23922:x1875787997456256:12345-0@lo:104: Request processed in 230us (5516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891219.314948:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788891219.314969:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891219.314975:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250baae4000/0xa66601b03fd54ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54aef expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.314982:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4000 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:2.0:1788891219.314987:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250baae4000/0xa66601b03fd54ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd54aef expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.314996:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250baae4000/0xa66601b03fd54ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd54aef expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891219.315003:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250baae4000/0xa66601b03fd54ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd54aef expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891219.315009:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788891219.315043:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250baae4000/0xa66601b03fd54ae8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54aef expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.315049:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891219.315082:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250baae4000/0xa66601b03fd54ae8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54aef expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.315090:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250baae4000/0xa66601b03fd54ae8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54aef expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.315106:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891219.315108:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891219.315109:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891219.315124:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad5d36d9-7941-4f84-88d2-361333de6068:3629:1875787997456512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891219.315172:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891219.315212:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997456512 00000100:00100000:2.0:1788891219.315217:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997456512 00000100:00100000:3.0:1788891219.315232:0:23922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23922:1875787997456256:0@lo:104: 00010000:00010000:2.0:1788891219.315233:0:22760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925091a8a200/0xa66601b03fd54aef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54ae8 expref: 17 pid: 22768 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891219.315253:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788891219.315260:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad5d36d9-7941-4f84-88d2-361333de6068+17:3629:x1875787997456512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891219.315271:0:22760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891219.315276:0:22760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925091a8a200/0xa66601b03fd54aef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54ae8 expref: 17 pid: 22768 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.315299:0:22760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925091a8a200/0xa66601b03fd54aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd54ae8 expref: 17 pid: 22768 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.315313:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8a200/0xa66601b03fd54aef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd54ae8 expref: 17 pid: 22768 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.315326:0:22760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9250baae5a00/0xa66601b03fd54c46 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.315334:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae5a00/0xa66601b03fd54c46 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891219.315346:0:23922:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9250baae5a00/0xa66601b03fd54c46 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.315347:0:22760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250baae5a00/0xa66601b03fd54c46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.315355:0:22760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250baae5a00/0xa66601b03fd54c46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891219.315356:0:23922:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9250baae5a00/0xa66601b03fd54c46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.315362:0:22760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9250baae5a00/0xa66601b03fd54c46 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891219.315363:0:23922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9250baae5a00/0xa66601b03fd54c46 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.315373:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9250baae5a00/0xa66601b03fd54c46 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.315378:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5a00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891219.315381:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9250baae5a00/0xa66601b03fd54c46 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.315388:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9250baae5a00/0xa66601b03fd54c46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.315396:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9250baae5a00/0xa66601b03fd54c46 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.315403:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae5a00/0xa66601b03fd54c46 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891219.315413:0:22760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891219.315443:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad5d36d9-7941-4f84-88d2-361333de6068+16:3629:x1875787997456512:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891219.315450:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788891219.315476:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad5d36d9-7941-4f84-88d2-361333de6068:3629:1875787997456512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788891219.515970:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891219.580368:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788891219.580389:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997456640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788891219.580457:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891219.580513:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997456640 00000100:00100000:0.0:1788891219.580538:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997456640 00000100:00100000:0.0:1788891219.580591:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788891219.580602:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997456640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788891219.580638:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446297600 avail 1300058112 00000100:00100000:0.0:1788891219.580689:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997456640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891219.580698:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788891219.580753:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997456640:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788891220.539680:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891220.603834:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997456768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788891220.603914:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788891220.604497:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1788891220.604502:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1788891220.604503:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788891220.604509:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891220.604512:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788891220.604514:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad5d36d9-7941-4f84-88d2-361333de6068:3627:1875787997456896:0@lo:400:kworker.0 00000100:00100000:2.0:1788891220.604616:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788891220.604622:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891220.604627:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788891220.604630:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891220.604633:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788891220.604661:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997456768 00000100:00100000:2.0:1788891220.604677:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997456768 00000100:00100000:2.0:1788891220.604726:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788891220.604735:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3627:x1875787997456768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788891220.604766:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788891220.604806:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3627:x1875787997456768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891220.604813:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788891220.604836:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997456896 00000100:00100000:2.0:1788891220.604840:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997456896 00000100:00100000:3.0:1788891220.604894:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997457024:0@lo:400:kworker.0 00000100:00100000:3.0:1788891220.604926:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891220.604981:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788891220.604992:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875787997457280:0@lo:400:kworker.0 00000100:00100000:2.0:1788891220.605090:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788891220.605098:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+16:3627:x1875787997456896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891220.605137:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+16:3627:x1875787997456896:12345-0@lo:400:kworker.0 Request processed in 40us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891220.605144:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788891220.605200:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad5d36d9-7941-4f84-88d2-361333de6068:3627:1875787997456896:0@lo:400:kworker.0 00000100:00100000:2.0:1788891220.605224:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997456768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788891220.606026:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788891220.606047:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085872d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997457152:0@lo:400:kworker.0 00000100:00100000:3.0:1788891220.606083:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891220.606193:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997457152 00000100:00100000:2.0:1788891220.606200:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997457152 00000100:00100000:2.0:1788891220.606275:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788891220.606283:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997457152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891220.606330:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997457152:12345-0@lo:400:kworker.0 Request processed in 49us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891220.606337:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788891220.606412:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085872d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997457152:0@lo:400:kworker.0 00000100:00100000:0.0:1788891220.607131:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997457024 00000100:00100000:0.0:1788891220.607139:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997457024 00000100:00100000:0.0:1788891220.607191:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788891220.607199:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997457024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891220.607252:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997457024:12345-0@lo:400:kworker.0 Request processed in 55us (2324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891220.607261:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788891220.607266:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff925085873480 x1875787997457024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891220.607288:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891220.607294:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997457024:0@lo:400:kworker.0 00000100:00100000:3.0:1788891220.607359:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997457280 00000100:00100000:3.0:1788891220.607365:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997457280 00000100:00100000:3.0:1788891220.607399:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788891220.607407:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875787997457280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891220.607455:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875787997457280:12345-0@lo:400:kworker.0 Request processed in 49us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891220.607461:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788891220.607954:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff925085873800 x1875787997457280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891220.607965:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875787997457280:0@lo:400:kworker.0 00000001:00100000:3.0:1788891220.610731:0:23504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:0.0:1788891220.734079:0:22770:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788891220.734088:0:22770:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff924f832d8800 from 13 10000000:01000000:0.0:1788891220.734093:0:22770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788891220.734152:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd54c4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891220.734164:0:22770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd54c4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891220.734176:0:22770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd54c4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891220.734205:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085873800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997457408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788891220.734276:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891220.734323:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8221c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788891220.734426:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997457408 00000100:00100000:2.0:1788891220.734434:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997457408 00000100:00100000:2.0:1788891220.734489:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788891220.734499:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+16:22770:x1875787997457408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891220.734513:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891220.734656:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250813ed200/0xa66601b03fd54c54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54c4d expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891220.734680:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813ed200/0xa66601b03fd54c54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54c4d expref: 17 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891220.734690:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250813ed200/0xa66601b03fd54c54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54c4d expref: 17 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891220.734700:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ed200, rc 0) 00000100:00100000:2.0:1788891220.734746:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+17:22770:x1875787997457408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 249us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891220.734753:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788891220.735061:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085873800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997457408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788891220.735078:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd54c4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54c54 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891220.735089:0:22770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd54c4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54c54 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891220.735156:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997457536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788891220.735189:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891220.735214:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c125a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788891220.736368:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997457536 00000100:00100000:2.0:1788891220.736379:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997457536 00000100:00100000:2.0:1788891220.736423:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788891220.736431:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+17:22770:x1875787997457536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788891220.736586:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+17:22770:x1875787997457536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891220.736594:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788891220.736642:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997457536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788891220.736683:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997457664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788891220.736726:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891220.736750:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baa2b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788891220.736761:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997457664 00000100:00100000:2.0:1788891220.736764:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997457664 00000100:00100000:2.0:1788891220.736780:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788891220.736786:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+17:22770:x1875787997457664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788891220.736862:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+17:22770:x1875787997457664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891220.736869:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788891220.736904:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997457664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788891220.737668:0:24018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788891220.737720:0:22770:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788891220.737739:0:22770:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788891220.737748:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd54c4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54c54 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891220.737758:0:22770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd54c4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54c54 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891220.737768:0:22770:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788891220.737770:0:22770:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9250b4f3c000 from 13 10000000:01000000:2.0:1788891220.737773:0:22770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788891220.737798:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd54c5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891220.737807:0:22770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd54c5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891220.737822:0:22770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd54c5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891220.737837:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997457792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788891220.737869:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891220.737884:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baa2bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788891220.737896:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997457792 00000100:00100000:2.0:1788891220.737900:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997457792 00000100:00100000:2.0:1788891220.737917:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788891220.737922:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+17:22770:x1875787997457792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891220.737930:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891220.737941:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250813ec400/0xa66601b03fd54c62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54c5b expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891220.737960:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250813ec400/0xa66601b03fd54c62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54c5b expref: 18 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891220.737970:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250813ec400/0xa66601b03fd54c62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54c5b expref: 18 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891220.737978:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250813ec400, rc 0) 00000100:00100000:2.0:1788891220.738002:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:22770:x1875787997457792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891220.738009:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788891220.738046:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997457792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891220.738056:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd54c5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54c62 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891220.738071:0:22770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd54c5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54c62 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891220.738107:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997457920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788891220.738129:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891220.738139:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baa2bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788891220.738148:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997457920 00000100:00100000:2.0:1788891220.738151:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997457920 00000100:00100000:2.0:1788891220.738164:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788891220.738169:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:22770:x1875787997457920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788891220.738232:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:22770:x1875787997457920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891220.738238:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788891220.738259:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997457920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788891220.738278:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997458048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788891220.738306:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891220.738317:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baa2bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788891220.738326:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997458048 00000100:00100000:2.0:1788891220.738328:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997458048 00000100:00100000:2.0:1788891220.738341:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788891220.738346:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:22770:x1875787997458048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788891220.738400:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:22770:x1875787997458048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 53us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891220.738406:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788891220.738439:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997458048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788891220.741074:0:24019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788891220.741142:0:22770:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788891220.741162:0:22770:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788891220.741173:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd54c5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54c62 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891220.741184:0:22770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd54c5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54c62 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891221.563673:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891222.595437:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891223.611703:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788891223.836805:0:24269:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788891223.836809:0:24269:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788891223.836811:0:24269:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788891223.836921:0:24269:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9250908d6000 00000020:01000004:2.0:1788891223.836938:0:24269:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788891223.836952:0:24269:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788891223.836980:0:24269:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff925091acb370) 00000020:00000080:2.0:1788891223.836998:0:24269:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788891223.876553:0:24269:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788891223.879668:0:24269:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788891223.879937:0:24269:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788891223.880153:0:24269:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788891223.880372:0:24269:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788891223.880580:0:24269:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788891223.880796:0:24269:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:1.0:1788891223.881788:0:24269:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788891223.882022:0:24269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788891223.882035:0:24269:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788891223.882048:0:24269:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa66601b03fd54c70 00000020:01000004:1.0:1788891223.882055:0:24269:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788891223.882078:0:24269:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788891223.882081:0:24269:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788891223.882088:0:24269:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788891223.882093:0:24269:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788891223.882104:0:24269:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9250ba5999b8) 00000020:00000080:1.0:1788891223.882114:0:24269:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1788891223.883223:0:24269:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788891223.883378:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788891223.883384:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788891223.888562:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788891223.888692:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788891223.889866:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788891223.889874:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788891223.891894:0:24269:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788891223.892112:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788891223.892119:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788891223.892913:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788891223.892925:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788891223.906933:0:24269:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788891223.907248:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788891223.907255:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788891223.908780:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788891223.908791:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788891223.909508:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788891223.909515:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788891223.912007:0:24269:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788891223.912342:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788891223.912349:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788891223.914322:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788891223.914339:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788891223.958473:0:24269:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788891223.958830:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788891223.958837:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788891223.960005:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788891223.960013:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788891223.960416:0:24269:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788891223.960446:0:24269:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788891223.960453:0:24269:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788891223.970200:0:24269:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788891223.970242:0:24269:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.126@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788891223.970246:0:24269:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788891223.970253:0:24269:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788891223.970255:0:24269:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788891223.970256:0:24269:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788891223.970257:0:24269:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788891223.970258:0:24269:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788891223.970259:0:24269:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788891223.970261:0:24269:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788891223.970262:0:24269:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788891223.970266:0:24269:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788891223.970268:0:24269:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788891223.970269:0:24269:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788891223.970270:0:24269:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788891223.970271:0:24269:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788891223.970272:0:24269:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788891223.970273:0:24269:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788891223.970274:0:24269:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788891223.970275:0:24269:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788891223.970276:0:24269:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788891223.970303:0:24269:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788891223.970323:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997458176:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788891223.970396:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891223.970453:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c20789c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891223.970519:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997458176 00000100:00100000:3.0:1788891223.970552:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997458176 00000100:00100000:3.0:1788891223.970613:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788891223.970622:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:24269:x1875787997458176:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788891223.970653:0:22767:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788891223.970656:0:22767:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788891223.970660:0:22767:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788891223.971000:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:24269:x1875787997458176:12345-0@lo:253:mount.lustre.0 Request processed in 378us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891223.971009:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788891223.971116:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997458176:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788891223.971127:0:24269:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788891223.971130:0:24269:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788891223.971131:0:24269:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788891223.971142:0:24269:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788891223.971144:0:24269:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788891223.971145:0:24269:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788891223.971146:0:24269:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788891223.971147:0:24269:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788891223.971148:0:24269:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788891223.971149:0:24269:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788891223.971168:0:24269:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9250908d6000 from lustre-OST0000 10000000:01000000:2.0:1788891223.971190:0:24269:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788891223.971193:0:24269:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788891223.971200:0:24269:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff925090b24d28 local copy 00010000:00010000:2.0:1788891223.971216:0:24269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5600/0xa66601b03fd54a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54a32 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891223.971312:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997458304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891223.971339:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891223.971475:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c20789c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891223.971680:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997458304 00000100:00100000:1.0:1788891223.971685:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997458304 00000100:00100000:1.0:1788891223.971759:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788891223.971768:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+18:24269:x1875787997458304:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891223.971850:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+18:24269:x1875787997458304:12345-0@lo:501:mount.lustre.0 Request processed in 84us (510us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788891223.971858:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788891223.971912:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997458304:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788891223.971924:0:24269:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788891223.971942:0:24269:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788891223.971948:0:24269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5600/0xa66601b03fd54a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54a32 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891223.971957:0:24269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae5600/0xa66601b03fd54a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54a32 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891223.971994:0:24269:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9250908d6000 10000000:01000000:2.0:1788891223.971999:0:24269:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788891223.972004:0:24269:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788891223.972007:0:24269:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788891223.972011:0:24269:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788891223.972014:0:24269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788891223.972035:0:24269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd54c7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891223.972043:0:24269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd54c7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891223.972053:0:24269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd54c7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891223.972076:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997458432:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788891223.972101:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891223.972264:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c20789c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891223.972325:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997458432 00000100:00100000:3.0:1788891223.972330:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997458432 00000100:00100000:3.0:1788891223.972351:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788891223.972357:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+18:24269:x1875787997458432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891223.972367:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891223.972379:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8ba00/0xa66601b03fd54c85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54c7e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891223.972401:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8ba00/0xa66601b03fd54c85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54c7e expref: 19 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891223.972411:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8ba00/0xa66601b03fd54c85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54c7e expref: 19 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891223.972421:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8ba00, rc 0) 00000100:00100000:3.0:1788891223.972461:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+19:24269:x1875787997458432:12345-0@lo:101:mount.lustre.0 Request processed in 104us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891223.972467:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788891223.972553:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997458432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891223.972565:0:24269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd54c7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54c85 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891223.972574:0:24269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd54c7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54c85 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788891223.973421:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1788891223.973957:0:24269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788891223.974211:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788891223.974235:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788891223.974248:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788891223.974260:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788891223.974273:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788891223.974286:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788891223.974299:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788891223.974313:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788891223.974325:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788891223.974339:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788891223.974353:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1788891223.974365:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1788891223.974383:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1788891223.974388:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1788891223.974450:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997458560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891223.974508:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891223.974566:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff925095c43540 going to sleep for 11 seconds 00000100:00100000:3.0:1788891223.974685:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997458560 00000100:00100000:3.0:1788891223.974692:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997458560 00000100:00100000:3.0:1788891223.974723:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788891223.974738:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+19:24269:x1875787997458560:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891223.974858:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+19:24269:x1875787997458560:12345-0@lo:501:mount.lustre.0 Request processed in 121us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891223.974865:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788891223.974948:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997458560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891223.974991:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997458688:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788891223.975030:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891223.975100:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff925095c43540 going to sleep for 11 seconds 00000100:00100000:1.0:1788891223.975212:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997458688 00000100:00100000:1.0:1788891223.975217:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997458688 00000100:00100000:3.0:1788891223.975258:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788891223.975266:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+19:24269:x1875787997458688:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788891223.976302:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+19:24269:x1875787997458688:12345-0@lo:503:mount.lustre.0 Request processed in 1032us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891223.976311:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788891223.976397:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4887100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997458688:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788891223.976874:0:24269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788891223.976959:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997458816:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891223.977021:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891223.977307:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fb840 going to sleep for 11 seconds 00000100:00100000:0.0:1788891223.977360:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997458816 00000100:00100000:0.0:1788891223.977367:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997458816 00000100:00100000:0.0:1788891223.977400:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788891223.977409:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+19:24269:x1875787997458816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891223.977854:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+19:24269:x1875787997458816:12345-0@lo:502:mount.lustre.0 Request processed in 445us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891223.977872:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788891223.978018:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997458816:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891223.978282:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788891223.978314:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788891223.978327:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788891223.978341:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788891223.978355:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788891223.978368:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788891223.978382:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788891223.978396:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788891223.978410:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1788891223.978441:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1788891223.978458:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788891223.978471:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788891223.978502:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997458944:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891223.978827:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891223.978893:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fb840 going to sleep for 11 seconds 00000100:00100000:0.0:1788891223.978926:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997458944 00000100:00100000:0.0:1788891223.978933:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997458944 00000100:00100000:0.0:1788891223.979012:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788891223.979021:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+19:24269:x1875787997458944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891223.979114:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+19:24269:x1875787997458944:12345-0@lo:502:mount.lustre.0 Request processed in 94us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891223.979120:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788891223.979244:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997458944:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788891223.979291:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1788891223.979301:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1788891223.979948:0:24286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788891223.979958:0:24286:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788891223.979975:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891223.979978:0:24286:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788891223.979984:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788891223.979997:0:24286:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff925091accd28) 00000020:00000080:2.0:1788891223.980018:0:24286:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788891223.980024:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788891223.980087:0:24286:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9250908d6000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788891223.980095:0:24286:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788891223.980100:0:24286:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa66601b03fd54c93 00010000:00010000:2.0:1788891223.983846:0:24286:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788891223.984295:0:24286:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:2.0:1788891223.985712:0:24286:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1788891223.986876:0:24286:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788891223.986887:0:24286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891223.986900:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891223.986902:0:24286:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788891223.986906:0:24286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788891223.986908:0:24286:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1788891223.986910:0:24286:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788891223.986911:0:24286:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788891223.986913:0:24286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788891223.986915:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891223.986917:0:24286:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788891223.986919:0:24286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891223.986922:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891223.986923:0:24286:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788891223.986926:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788891223.986928:0:24286:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788891223.986930:0:24286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891223.986933:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891223.986934:0:24286:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788891223.986936:0:24286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891223.986938:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891223.986939:0:24286:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788891223.986942:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788891223.986978:0:24286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891223.986981:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891223.986982:0:24286:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788891223.986986:0:24286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1788891223.989330:0:24269:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788891223.989379:0:24269:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788891223.989408:0:24269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd54c7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54c85 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891223.989421:0:24269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250813eda00/0xa66601b03fd54c7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54c85 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891223.989490:0:24269:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9250908d6000 from 1 10000000:01000000:2.0:1788891223.989494:0:24269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788891223.989565:0:24269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd54c9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891223.989575:0:24269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd54c9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891223.989587:0:24269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd54c9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891223.989626:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997459072:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788891223.989696:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891223.989738:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baab2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788891223.989799:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997459072 00000100:00100000:3.0:1788891223.989806:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997459072 00000100:00100000:3.0:1788891223.989854:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788891223.989863:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+19:24269:x1875787997459072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891223.989877:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891223.989888:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8a000/0xa66601b03fd54ca1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54c9a expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891223.989912:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8a000/0xa66601b03fd54ca1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54c9a expref: 20 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891223.989922:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8a000/0xa66601b03fd54ca1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54c9a expref: 20 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891223.989931:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8a000, rc 0) 00000100:00100000:3.0:1788891223.989983:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+20:24269:x1875787997459072:12345-0@lo:101:mount.lustre.0 Request processed in 120us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891223.989990:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788891223.990113:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997459072:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891223.990127:0:24269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd54c9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54ca1 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891223.990201:0:24269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd54c9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54ca1 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788891223.991130:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788891223.991398:0:24269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788891223.991618:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788891223.991643:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788891223.991659:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788891223.991673:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788891223.991688:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788891223.991720:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788891223.991736:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788891223.991750:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788891223.991764:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788891223.991778:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788891223.991793:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788891223.991810:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788891223.991816:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788891223.991888:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997459200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891223.991941:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891223.992086:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997459200 00000100:00100000:0.0:1788891223.992094:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997459200 00000100:00100000:0.0:1788891223.992156:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788891223.992165:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+20:24269:x1875787997459200:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891223.992291:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+20:24269:x1875787997459200:12345-0@lo:501:mount.lustre.0 Request processed in 122us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891223.992299:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788891223.992772:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baab2240 going to sleep for 11 seconds 00000100:00100000:2.0:1788891223.992801:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997459200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891223.992835:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997459328:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788891223.992877:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891223.992905:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997459328 00000100:00100000:2.0:1788891223.992909:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997459328 00000100:00100000:2.0:1788891223.992943:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788891223.992950:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+20:24269:x1875787997459328:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788891223.993036:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+20:24269:x1875787997459328:12345-0@lo:503:mount.lustre.0 Request processed in 85us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891223.993042:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788891223.993079:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baab2240 going to sleep for 11 seconds 00000100:00100000:2.0:1788891223.993092:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997459328:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788891223.993452:0:24269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788891223.993508:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997459456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891223.993568:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891223.993592:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997459456 00000100:00100000:2.0:1788891223.993596:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997459456 00000100:00100000:2.0:1788891223.993616:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788891223.993623:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+20:24269:x1875787997459456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891223.993692:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+20:24269:x1875787997459456:12345-0@lo:502:mount.lustre.0 Request processed in 70us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891223.993699:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788891223.993733:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baab2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788891223.993745:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997459456:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788891223.993924:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788891223.993958:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788891223.993989:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788891223.994002:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788891223.994013:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788891223.994026:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788891223.994040:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788891223.994068:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788891223.994084:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788891223.994098:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788891223.994113:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788891223.994134:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997459584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891223.994168:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891223.994190:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997459584 00000100:00100000:2.0:1788891223.994194:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997459584 00000100:00100000:2.0:1788891223.994212:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788891223.994218:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+20:24269:x1875787997459584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891223.994278:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+20:24269:x1875787997459584:12345-0@lo:502:mount.lustre.0 Request processed in 59us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891223.994285:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788891223.994314:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baab2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788891223.994327:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4884700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997459584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788891223.994366:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788891223.994374:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788891223.995189:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891223.995201:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891223.995203:0:24290:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788891223.995212:0:24290:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9250908d6000 00000020:00000080:0.0:1788891223.995215:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788891223.995224:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891223.995226:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891223.995228:0:24290:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788891223.995230:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891223.995233:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891223.995234:0:24290:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788891223.995237:0:24290:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9250908d6000 00000020:00000080:0.0:1788891223.995239:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788891223.995339:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891223.995343:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891223.995344:0:24290:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788891223.995347:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891223.995350:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891223.995351:0:24290:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788891223.995354:0:24290:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9250908d6000 00000020:00000080:0.0:1788891223.995357:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788891223.996600:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891223.996609:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891223.996611:0:24290:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788891223.996615:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891223.996618:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891223.996619:0:24290:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788891223.996624:0:24290:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9250908d6000 00000020:00000080:0.0:1788891223.996626:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788891223.996667:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891223.996670:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891223.996672:0:24290:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788891223.996676:0:24290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788891224.001917:0:24269:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788891224.001978:0:24269:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788891224.002004:0:24269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd54c9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54ca1 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891224.002031:0:24269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd54c9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54ca1 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891224.002125:0:24269:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788891224.002128:0:24269:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9250908d6000 10000000:01000000:3.0:1788891224.002191:0:24269:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9250908d6000 10000000:01000000:3.0:1788891224.002197:0:24269:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788891224.002204:0:24269:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9250908d6000 from 1 10000000:01000000:3.0:1788891224.002206:0:24269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788891224.002242:0:24269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54ca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891224.002251:0:24269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54ca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891224.002261:0:24269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54ca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891224.002286:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997459712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788891224.002356:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891224.002395:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788891224.002481:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997459712 00000100:00100000:2.0:1788891224.002488:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997459712 00000100:00100000:2.0:1788891224.002563:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788891224.002573:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+20:24269:x1875787997459712:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891224.002587:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891224.002605:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925081523400/0xa66601b03fd54caf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54ca8 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891224.002627:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925081523400/0xa66601b03fd54caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54ca8 expref: 21 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891224.002636:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925081523400/0xa66601b03fd54caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54ca8 expref: 21 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891224.002644:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925081523400, rc 0) 00000100:00100000:2.0:1788891224.002683:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+21:24269:x1875787997459712:12345-0@lo:101:mount.lustre.0 Request processed in 112us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891224.002689:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788891224.004281:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997459712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891224.004305:0:24269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54ca8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54caf expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891224.004317:0:24269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54ca8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54caf expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788891224.005654:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788891224.005918:0:24269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788891224.006097:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788891224.006123:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788891224.006203:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788891224.006221:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788891224.006235:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788891224.006250:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788891224.006266:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788891224.006278:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788891224.006291:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788891224.006303:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788891224.006317:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788891224.006345:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788891224.006361:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788891224.006375:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788891224.006387:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788891224.006399:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788891224.006412:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788891224.006425:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788891224.006439:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788891224.006451:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788891224.006464:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788891224.006475:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788891224.006488:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788891224.006503:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788891224.006519:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788891224.006555:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788891224.006571:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788891224.006602:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788891224.006623:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788891224.006651:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788891224.006665:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788891224.006680:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788891224.006695:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788891224.006713:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788891224.006733:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788891224.006751:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788891224.006767:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788891224.006782:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788891224.006800:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788891224.006817:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788891224.006835:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788891224.006853:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788891224.006871:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788891224.006903:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788891224.006924:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788891224.006942:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788891224.006975:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788891224.006993:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788891224.007111:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788891224.007129:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788891224.008270:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788891224.008284:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788891224.008394:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997459840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891224.008465:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891224.008570:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788891224.014307:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997459840 00000100:00100000:0.0:1788891224.014331:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997459840 00000100:00100000:0.0:1788891224.014385:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788891224.014395:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+21:24269:x1875787997459840:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891224.014576:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+21:24269:x1875787997459840:12345-0@lo:501:mount.lustre.0 Request processed in 181us (6109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891224.014584:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788891224.016388:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997459840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891224.016448:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997459968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788891224.016520:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891224.017198:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788891224.017224:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997459968 00000100:00100000:3.0:1788891224.017229:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997459968 00000100:00100000:3.0:1788891224.017271:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788891224.017280:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+21:24269:x1875787997459968:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788891224.017389:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+21:24269:x1875787997459968:12345-0@lo:503:mount.lustre.0 Request processed in 109us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891224.017396:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788891224.017447:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997459968:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788891224.017915:0:24269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788891224.018008:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997460096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891224.018050:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891224.018073:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788891224.019908:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997460096 00000100:00100000:2.0:1788891224.019921:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997460096 00000100:00100000:2.0:1788891224.019985:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788891224.019995:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+21:24269:x1875787997460096:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891224.020585:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+21:24269:x1875787997460096:12345-0@lo:502:mount.lustre.0 Request processed in 589us (2532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891224.020600:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788891224.020788:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997460096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891224.021053:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788891224.021085:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788891224.021101:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788891224.021117:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788891224.021131:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788891224.021235:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788891224.021253:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788891224.021270:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788891224.021284:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788891224.021296:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788891224.021312:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788891224.021326:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788891224.021341:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788891224.021357:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788891224.021373:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788891224.021396:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788891224.021411:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788891224.021426:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788891224.021441:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788891224.021455:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788891224.021470:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788891224.023311:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788891224.023364:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788891224.023383:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788891224.023397:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1788891224.023411:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1788891224.023425:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1788891224.023437:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1788891224.023450:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1788891224.023462:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1788891224.023476:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1788891224.023489:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1788891224.023784:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1788891224.023803:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1788891224.023818:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1788891224.023831:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1788891224.023844:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1788891224.023875:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1788891224.023890:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1788891224.023902:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1788891224.023913:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1788891224.023925:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1788891224.023936:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1788891224.023947:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1788891224.023958:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1788891224.024014:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1788891224.024027:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1788891224.024039:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1788891224.024106:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997460224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891224.024251:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891224.024345:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fb480 going to sleep for 11 seconds 00000100:00100000:1.0:1788891224.024405:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997460224 00000100:00100000:1.0:1788891224.024413:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997460224 00000100:00100000:1.0:1788891224.024509:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788891224.024697:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+21:24269:x1875787997460224:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891224.024814:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+21:24269:x1875787997460224:12345-0@lo:502:mount.lustre.0 Request processed in 296us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891224.024821:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788891224.024908:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997460224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891224.025114:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1788891224.025154:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1788891224.025180:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997460352:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891224.025221:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891224.025754:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788891224.025814:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997460352 00000100:00100000:2.0:1788891224.025820:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997460352 00000100:00100000:2.0:1788891224.025848:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788891224.025855:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+21:24269:x1875787997460352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891224.025999:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+21:24269:x1875787997460352:12345-0@lo:502:mount.lustre.0 Request processed in 144us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891224.026007:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788891224.029070:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997460352:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891224.029634:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1788891224.029650:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788891224.040357:0:24296:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788891224.040374:0:24296:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9250ba59b370) 00000020:00000080:1.0:1788891224.040398:0:24296:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788891224.040479:0:24296:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9250908d6000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788891224.040484:0:24296:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9250908d6000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788891224.040486:0:24296:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9250908d6000 3 00010000:00080000:1.0:1788891224.040519:0:24296:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f83107800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1788891224.042833:0:24296:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788891224.043110:0:24296:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788891224.043219:0:24296:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788891224.043234:0:24296:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa66601b03fd54cbd 00000100:00080000:1.0:1788891224.043247:0:24296:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788891224.043258:0:24296:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff924f83107800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891224.043298:0:24296:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f833d0380 x1875787997460480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788891224.043331:0:24296:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788891224.043452:0:21261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891224.043458:0:21261:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788891224.043461:0:21261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891224.043465:0:21261:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788891224.043497:0:21261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891224.043500:0:21261:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788891224.043503:0:21261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891224.043506:0:21261:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788891224.043624:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997460608:0@lo:400:kworker.0 00000100:00100000:1.0:1788891224.043696:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891224.043729:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788891224.043734:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875787997460992:0@lo:400:kworker.0 00000100:00100000:1.0:1788891224.043755:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891224.043808:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997460864:0@lo:400:kworker.0 00000100:00100000:1.0:1788891224.043833:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891224.043850:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788891224.043855:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997460736:0@lo:400:kworker.0 00000100:00100000:1.0:1788891224.043876:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891224.043913:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997460992 00000100:00100000:1.0:1788891224.043920:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997460992 00000100:00100000:1.0:1788891224.043958:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997460736 00000100:00100000:1.0:1788891224.043973:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997460736 00000100:00100000:1.0:1788891224.043993:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788891224.044002:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875787997460992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891224.044057:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875787997460992:12345-0@lo:400:kworker.0 Request processed in 56us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891224.044064:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788891224.044080:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788891224.044086:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997460736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891224.044116:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997460736:12345-0@lo:400:kworker.0 Request processed in 30us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891224.044128:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788891224.044235:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9250bf73aa00 x1875787997460736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891224.044248:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997460736:0@lo:400:kworker.0 00010000:00080000:1.0:1788891224.044275:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9250bf738e00 x1875787997460992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891224.044284:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875787997460992:0@lo:400:kworker.0 00000100:00100000:2.0:1788891224.044379:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1875787997460480:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788891224.044415:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891224.044574:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997460608 00000100:00100000:2.0:1788891224.044577:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997460608 00000100:00100000:2.0:1788891224.044595:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997460864 00000100:00100000:2.0:1788891224.044597:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997460864 00000100:00100000:2.0:1788891224.044608:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788891224.044613:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997460608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891224.044653:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997460608:12345-0@lo:400:kworker.0 Request processed in 39us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891224.044659:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788891224.044672:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788891224.044679:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997460864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891224.044710:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997460864:12345-0@lo:400:kworker.0 Request processed in 32us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891224.044716:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788891224.044739:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997460480 00000100:00100000:2.0:1788891224.044742:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997460480 00000100:00100000:2.0:1788891224.044754:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788891224.044758:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875787997460480:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788891224.044779:0:22774:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:2.0:1788891224.044810:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa66601b03fd54cc4 00000004:00100000:2.0:1788891224.044825:0:22774:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788891224.044852:0:22774:0:(import.c:65:import_set_state_nolock()) ffff924f81edc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788891224.044887:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875787997460480:12345-0@lo:38:llog_process_th.0 Request processed in 127us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891224.044893:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788891224.044927:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff924f833d0380 x1875787997460480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788891234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891224.044936:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788891224.044943:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788891224.044950:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788891224.044955:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788891224.044957:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f83107800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788891224.044977:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3626:1875787997460480:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788891224.045003:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997460864:0@lo:400:kworker.0 00000100:00100000:2.0:1788891224.045022:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997460608:0@lo:400:kworker.0 00000020:01000004:2.0:1788891224.045363:0:24296:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788891224.045378:0:24296:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9250baa6b370) 00000020:00000080:2.0:1788891224.045396:0:24296:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788891224.045486:0:24296:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9250908d6000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788891224.045491:0:24296:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9250908d6000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788891224.045494:0:24296:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9250908d6000 3 00010000:00080000:2.0:1788891224.045825:0:24296:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f832de000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.126@tcp at head 00010000:00010000:2.0:1788891224.048002:0:24296:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788891224.048286:0:24296:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788891224.048332:0:24296:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788891224.048345:0:24296:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xa66601b03fd54cd2 00000100:00080000:2.0:1788891224.048354:0:24296:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788891224.048360:0:24296:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff924f832de000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1788891224.048392:0:24296:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9250a4886d80 x1875787997461120/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788891224.048471:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3626:1875787997461120:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788891224.048583:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788891224.048674:0:24296:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788891224.048703:0:21261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788891224.048707:0:21261:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788891224.048710:0:21261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788891224.048713:0:21261:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788891224.048717:0:21261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788891224.048719:0:21261:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788891224.048722:0:21261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788891224.048724:0:21261:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788891224.048876:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997461120 00000100:00100000:0.0:1788891224.048886:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997461120 00000100:00100000:0.0:1788891224.048932:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788891224.048940:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875787997461120:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788891224.048986:0:22774:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:0.0:1788891224.049015:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xa66601b03fd54cd9 00000004:00100000:0.0:1788891224.049030:0:22774:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788891224.049060:0:22774:0:(import.c:65:import_set_state_nolock()) ffff924f8386c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788891224.061282:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875787997461120:12345-0@lo:38:llog_process_th.0 Request processed in 12328us (12685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891224.061300:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788891224.061792:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9250a4886d80 x1875787997461120/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788891234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891224.061814:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788891224.061828:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788891224.061837:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788891224.061841:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788891224.061845:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f832de000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788891224.061852:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3626:1875787997461120:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788891224.062606:0:24296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1788891224.062668:0:24269:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788891224.062706:0:24269:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788891224.062865:0:24269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54ca8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54caf expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891224.062876:0:24269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8aa00/0xa66601b03fd54ca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54caf expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788891224.062925:0:24269:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788891224.062928:0:24269:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788891224.062930:0:24269:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891224.062931:0:24269:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891224.062933:0:24269:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891224.062935:0:24269:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891224.062936:0:24269:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788891224.062938:0:24269:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891224.062940:0:24269:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788891224.062944:0:24269:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788891224.062946:0:24269:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788891224.062948:0:24269:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788891224.062949:0:24269:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891224.062951:0:24269:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891224.062952:0:24269:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891224.062953:0:24269:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891224.062955:0:24269:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788891224.062970:0:24269:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891224.062972:0:24269:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788891224.062995:0:24269:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788891224.063014:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997461248:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788891224.063081:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891224.063118:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788891224.063390:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997461248 00000100:00100000:2.0:1788891224.063397:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997461248 00000100:00100000:2.0:1788891224.063434:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788891224.063442:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+21:24269:x1875787997461248:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788891224.063470:0:22765:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788891224.063482:0:22765:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788891224.072053:0:22765:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788891224.072066:0:22765:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788891224.072365:0:22788:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788891224.072377:0:22788:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788891224.072404:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff925091a8b000/0xa66601b03fd54ce0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891224.072428:0:22788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54c31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54c2a expref: 21 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891224.072436:0:22788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250baae4a00/0xa66601b03fd54c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54c38 expref: 21 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891224.072445:0:22788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff925091a8b000/0xa66601b03fd54ce0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891224.072489:0:22788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250baae4a00/0xa66601b03fd54c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd54c38 expref: 21 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891224.072507:0:22788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250baae4a00/0xa66601b03fd54c3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd54c38 expref: 21 pid: 22768 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891224.072543:0:22788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875787997461376:0@lo:104: 00000100:00100000:3.0:1788891224.072620:0:22788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788891224.072679:0:22788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54c31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd54c2a expref: 21 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891224.072688:0:22788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54c31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd54c2a expref: 21 pid: 22767 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891224.072705:0:22788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf738380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875787997461504:0@lo:104: 00000100:00100000:3.0:1788891224.072730:0:22788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891224.072746:0:22788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250830fbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788891224.072772:0:22756:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788891224.072792:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997461376 00000100:00100000:3.0:1788891224.072798:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997461376 00000100:00100000:3.0:1788891224.072831:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997461504 00000100:00100000:3.0:1788891224.072833:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997461504 00000100:00100000:3.0:1788891224.072846:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788891224.072853:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad5d36d9-7941-4f84-88d2-361333de6068+4:22788:x1875787997461376:12345-0@lo:104: 00010000:00010000:3.0:1788891224.072864:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54c38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54c3f expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891224.072911:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788891224.072917:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad5d36d9-7941-4f84-88d2-361333de6068+4:22788:x1875787997461376:12345-0@lo:104: Request processed in 64us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891224.072924:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788891224.072944:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788891224.072950:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bb27d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad5d36d9-7941-4f84-88d2-361333de6068+3:22788:x1875787997461504:12345-0@lo:104: 00010000:00010000:3.0:1788891224.072958:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54c2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54c31 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891224.073010:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788891224.073015:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bb27d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad5d36d9-7941-4f84-88d2-361333de6068+3:22788:x1875787997461504:12345-0@lo:104: Request processed in 66us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891224.073021:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788891224.073055:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788891224.073066:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54c38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54c3f expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891224.073074:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b200 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:3.0:1788891224.073078:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54c38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd54c3f expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891224.073086:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54c38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd54c3f expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788891224.073094:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54c38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd54c3f expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891224.073098:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1788891224.073101:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788891224.073134:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54c38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54c3f expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891224.073140:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788891224.073168:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54c38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54c3f expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891224.073175:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54c38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54c3f expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891224.073186:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891224.073188:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891224.073189:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891224.073214:0:22788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875787997461376:0@lo:104: 00000100:00100000:3.0:1788891224.073222:0:22788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875787997461504:0@lo:104: 00010000:00010000:3.0:1788891224.073245:0:22788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff925091a8b000/0xa66601b03fd54ce0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891224.073633:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+21:24269:x1875787997461248:12345-0@lo:253:mount.lustre.0 Request processed in 10190us (10551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891224.073642:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788891224.073694:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf738000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:24269:1875787997461248:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788891224.073704:0:24269:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788891224.073707:0:24269:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788891224.073709:0:24269:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788891224.073710:0:24269:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891224.073712:0:24269:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891224.073713:0:24269:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891224.073715:0:24269:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891224.073716:0:24269:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788891224.073719:0:24269:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891224.073720:0:24269:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788891224.073731:0:24269:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788891224.073954:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad5d36d9-7941-4f84-88d2-361333de6068:3628:1875787997461632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788891224.074015:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891224.074087:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997461632 00000100:00100000:0.0:1788891224.074093:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997461632 00010000:00010000:0.0:1788891224.074118:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250baae4a00/0xa66601b03fd54c3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54c38 expref: 21 pid: 22768 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891224.074157:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788891224.074164:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085872300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad5d36d9-7941-4f84-88d2-361333de6068+21:3628:x1875787997461632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788891224.074177:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891224.074182:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250baae4a00/0xa66601b03fd54c3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54c38 expref: 21 pid: 22768 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891224.074194:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250baae4a00/0xa66601b03fd54c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd54c38 expref: 21 pid: 22768 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891224.074211:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae4a00/0xa66601b03fd54c3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd54c38 expref: 21 pid: 22768 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891224.074226:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891224.074264:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085872300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad5d36d9-7941-4f84-88d2-361333de6068+20:3628:x1875787997461632:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891224.074271:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788891224.074315:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad5d36d9-7941-4f84-88d2-361333de6068:3628:1875787997461632:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1788891224.079235:0:24269:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:3.0:1788891224.081194:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891224.081199:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891224.081202:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891224.081221:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54c2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54c31 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891224.081235:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5200 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:0.0:1788891224.081239:0:22762:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54c2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd54c31 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891224.081250:0:22762:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54c2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd54c31 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788891224.081259:0:22762:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54c2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd54c31 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891224.081266:0:22762:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788891224.081322:0:22762:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54c2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54c31 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891224.081329:0:22762:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788891224.081372:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54c2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54c31 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891224.081380:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54c2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54c31 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891224.081400:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891224.081402:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891224.081410:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891224.081489:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788891224.081511:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad5d36d9-7941-4f84-88d2-361333de6068:3630:1875787997461760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891224.081609:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891224.081674:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997461760 00000100:00100000:2.0:1788891224.081682:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997461760 00010000:00010000:2.0:1788891224.081709:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54c31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54c2a expref: 20 pid: 22767 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891224.081745:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788891224.081753:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925086ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad5d36d9-7941-4f84-88d2-361333de6068+20:3630:x1875787997461760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891224.081766:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891224.081778:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54c31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54c2a expref: 20 pid: 22767 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891224.081789:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54c31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd54c2a expref: 20 pid: 22767 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891224.081803:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54c31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd54c2a expref: 20 pid: 22767 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891224.081818:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff925091a8b000/0xa66601b03fd54ce0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891224.081826:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8b000/0xa66601b03fd54ce0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788891224.081840:0:22758:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009464703s 00010000:00010000:2.0:1788891224.081845:0:22758:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925091a8b000/0xa66601b03fd54ce0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891224.081852:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff925091a8b000/0xa66601b03fd54ce0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891224.081859:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff925091a8b000/0xa66601b03fd54ce0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891224.081865:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff925091a8b000/0xa66601b03fd54ce0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891224.081869:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b000 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891224.081874:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff925091a8b000/0xa66601b03fd54ce0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891224.081890:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff925091a8b000/0xa66601b03fd54ce0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891224.081908:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff925091a8b000/0xa66601b03fd54ce0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891224.081919:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891224.081971:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925086ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad5d36d9-7941-4f84-88d2-361333de6068+19:3630:x1875787997461760:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891224.081980:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788891224.082035:0:22788:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff925091a8b000/0xa66601b03fd54ce0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891224.082046:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff925091a8b000/0xa66601b03fd54ce0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891224.082049:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad5d36d9-7941-4f84-88d2-361333de6068:3630:1875787997461760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891224.082061:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8b000/0xa66601b03fd54ce0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788891224.083670:0:24269:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788891224.083678:0:24269:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788891224.083727:0:24269:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788891224.083775:0:24269:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788891224.083794:0:24269:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788891224.083817:0:24269:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788891224.084624:0:24269:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788891224.084842:0:24269:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788891224.637213:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891224.701027:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788891224.701054:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997461888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788891224.701135:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891224.701185:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997461888 00000100:00100000:0.0:1788891224.701192:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997461888 00000100:00100000:0.0:1788891224.701233:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788891224.701241:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997461888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788891224.701273:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446297600 avail 1300058112 00000100:00100000:0.0:1788891224.701327:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997461888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891224.701334:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788891224.701376:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997461888:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1788891224.756972:0:24351:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788891224.757271:0:24351:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788891225.084827:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891214/real 1788891214] req@ffff9250a4884e00 x1875787997451264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891224 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891225.084857:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9250a4884e00 x1875787997451264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891224 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891225.085209:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891214/real 1788891214] req@ffff9250a4887b80 x1875787997451136/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891224 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891225.085224:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9250a4887b80 x1875787997451136/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891224 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788891225.085263:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925083ec8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788891225.085284:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788891225.085289:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997451264:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788891225.085294:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925088697800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788891225.085299:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788891225.085302:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997451136:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788891225.085599:0:21261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891225.085604:0:21261:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788891225.085606:0:21261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891225.085608:0:21261:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788891225.085966:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad5d36d9-7941-4f84-88d2-361333de6068:3627:1875787997462016:0@lo:400:kworker.0 00000100:00100000:2.0:1788891225.086038:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891225.086092:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997462144:0@lo:400:kworker.0 00000100:00100000:0.0:1788891225.086199:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891225.086252:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997462144 00000100:00100000:0.0:1788891225.086260:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997462144 00000100:00100000:0.0:1788891225.086308:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788891225.086317:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997462144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891225.086373:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997462144:12345-0@lo:400:kworker.0 Request processed in 58us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891225.086381:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788891225.086418:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997462144:0@lo:400:kworker.0 00000100:00080000:1.0:1788891225.086475:0:21261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891225.086479:0:21261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788891225.086482:0:21261:0:(import.c:65:import_set_state_nolock()) ffff925088697800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788891225.086486:0:21261:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 436 00000100:00080000:1.0:1788891225.086490:0:21261:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788891225.086495:0:21261:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff925088697800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891225.086515:0:21261:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f833d3800 x1875787997462528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788891225.086622:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997462400:0@lo:400:kworker.0 00000100:00100000:2.0:1788891225.086663:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891225.086683:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788891225.086689:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997462272:0@lo:400:kworker.0 00000100:00100000:2.0:1788891225.086725:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891225.086758:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997462272 00000100:00100000:2.0:1788891225.086762:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997462272 00000100:00100000:2.0:1788891225.086789:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788891225.086797:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997462272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891225.086834:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1875787997462272:12345-0@lo:400:kworker.0 Request processed in 37us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891225.086840:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788891225.086882:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f833d1500 x1875787997462272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891225.086892:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3630:1875787997462272:0@lo:400:kworker.0 00000100:00100000:2.0:1788891225.086922:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997462400 00000100:00100000:2.0:1788891225.086926:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997462400 00000100:00100000:2.0:1788891225.086960:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788891225.086967:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997462400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891225.087002:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997462400:12345-0@lo:400:kworker.0 Request processed in 36us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891225.087009:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788891225.087035:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997462400:0@lo:400:kworker.0 00000100:00100000:0.0:1788891225.087147:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997462016 00000100:00100000:0.0:1788891225.087152:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997462016 00000100:00100000:0.0:1788891225.087176:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788891225.087191:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+19:3627:x1875787997462016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891225.087231:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+19:3627:x1875787997462016:12345-0@lo:400:kworker.0 Request processed in 42us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891225.087238:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1788891225.087305:0:21261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891225.087309:0:21261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788891225.087311:0:21261:0:(import.c:65:import_set_state_nolock()) ffff925083ec8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788891225.087315:0:21261:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 436 00000100:00080000:1.0:1788891225.087318:0:21261:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788891225.087323:0:21261:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff925083ec8800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891225.087346:0:21261:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f833d2300 x1875787997462656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788891225.087376:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997462528:0@lo:8:kworker.0 00000100:00100000:1.0:1788891225.087387:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788891225.087395:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875787997462784:0@lo:400:kworker.0 00000100:00100000:3.0:1788891225.087410:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891225.087420:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891225.087439:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997462656:0@lo:8:kworker.0 00000100:00100000:3.0:1788891225.087468:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891225.087506:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997462528 00000100:00100000:3.0:1788891225.087510:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997462528 00000100:00100000:3.0:1788891225.087558:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997462656 00000100:00100000:3.0:1788891225.087562:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997462656 00000100:00100000:0.0:1788891225.087580:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788891225.087585:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1875787997462528:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788891225.087610:0:24276:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:0.0:1788891225.087637:0:24276:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd54ce7 00002000:00100000:0.0:1788891225.087651:0:24276:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff924f82213000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788891225.087656:0:24276:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788891225.087658:0:24276:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788891225.087808:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997462784 00000100:00100000:1.0:1788891225.087813:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997462784 00000100:00100000:1.0:1788891225.087849:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788891225.087858:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875787997462784:12345-0@lo:400:kworker.0 00002000:00080000:0.0:1788891225.087863:0:24276:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788891225.087892:0:24276:0:(import.c:65:import_set_state_nolock()) ffff92509095d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788891225.088264:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad5d36d9-7941-4f84-88d2-361333de6068:3627:1875787997462016:0@lo:400:kworker.0 00000100:00100000:0.0:1788891225.089239:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3626:x1875787997462528:12345-0@lo:8:kworker.0 Request processed in 1650us (1827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891225.089247:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788891225.089269:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788891225.089275:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1875787997462656:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788891225.089294:0:24276:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1788891225.089339:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f833d3800 x1875787997462528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788891240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891225.089351:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788891225.089367:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788891225.089376:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788891225.089381:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788891225.089384:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925088697800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788891225.089407:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788891225.089414:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997462528:0@lo:8:kworker.0 00000004:00080000:3.0:1788891225.089617:0:23512:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788891225.089702:0:23512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 447334178811ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788891225.089709:0:23512:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:2.0:1788891225.090370:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f833d1c00 x1875787997462784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891225.090383:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875787997462784:0@lo:400:kworker.0 00000100:00100000:2.0:1788891225.090448:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997462912:0@lo:400:kworker.0 00000100:00100000:2.0:1788891225.090501:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891225.090583:0:22772:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788891225.090593:0:22772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788891225.091304:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997463040:0@lo:400:kworker.0 00000100:00100000:2.0:1788891225.091345:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891225.091383:0:22773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788891225.091391:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997462912 00000100:00100000:2.0:1788891225.091398:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997462912 00000100:00100000:2.0:1788891225.091442:0:22773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788891225.091448:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997463040 00000100:00100000:2.0:1788891225.091451:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997463040 00000100:00100000:2.0:1788891225.091464:0:22773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788891225.091472:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788891225.091492:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875787997462912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891225.091738:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875787997462912:12345-0@lo:400:kworker.0 Request processed in 248us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891225.091745:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788891225.091761:0:22773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788891225.091768:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788891225.091774:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997463040:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788891225.091781:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788891225.091786:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788891225.091806:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997463040:12345-0@lo:400:kworker.0 Request processed in 33us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891225.091812:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788891225.091840:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250a4885180 x1875787997463040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891225.091851:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997463040:0@lo:400:kworker.0 00010000:00080000:2.0:1788891225.091896:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250a4886300 x1875787997462912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891225.091904:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997462912:0@lo:400:kworker.0 00000004:00080000:2.0:1788891225.092108:0:23513:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788891225.092246:0:23513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4885180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23513:1875787997463296:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788891225.092280:0:23513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891225.092305:0:24274:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788891225.092305:0:23513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250925c53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891225.092312:0:24274:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788891225.092318:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997463168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788891225.092342:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891225.092428:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997463168 00000100:00100000:3.0:1788891225.092433:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997463168 00000100:00100000:3.0:1788891225.092461:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788891225.092611:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3630:x1875787997463168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788891225.092627:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923517440 avail 3691995136 00000100:00100000:3.0:1788891225.092670:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3630:x1875787997463168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891225.092675:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788891225.092691:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788891225.092712:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250a4886300 x1875787997463168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891225.092720:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875787997462784:12345-0@lo:400:kworker.0 Request processed in 1000us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891225.092728:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997463168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788891225.092747:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788891225.092768:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997463296 00000100:00100000:3.0:1788891225.092772:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997463296 00000100:00100000:3.0:1788891225.092971:0:24371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788891225.093012:0:24371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23513:x1875787997463296:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788891225.093339:0:23504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:3.0:1788891225.098273:0:24371:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788891225.098286:0:24371:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788891225.098444:0:24371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23513:x1875787997463296:12345-0@lo:7:osp-pre-0-1.0 Request processed in 5457us (6157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891225.098456:0:24371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788891225.100813:0:23513:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9250a4885180 x1875787997463296/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788891241 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891225.100835:0:23513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4885180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23513:1875787997463296:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788891225.100853:0:23513:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788891225.100898:0:23513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23513:1875787997463424:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788891225.101102:0:23513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891225.101147:0:23513:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f821d7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891225.101244:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997463424 00000100:00100000:3.0:1788891225.101252:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997463424 00000100:00100000:3.0:1788891225.101310:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788891225.101321:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23513:x1875787997463424:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788891225.101350:0:24274:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788891225.101391:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23513:x1875787997463424:12345-0@lo:5:osp-pre-0-1.0 Request processed in 72us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891225.101398:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788891225.102623:0:23513:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f833d1500 x1875787997463424/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788891241 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891225.102641:0:23513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23513:1875787997463424:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788891225.102654:0:23513:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788891225.102699:0:23513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23513:1875787997463552:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788891225.102743:0:23513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891225.102784:0:23513:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f821d7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891225.103203:0:24371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997463552 00000100:00100000:3.0:1788891225.103211:0:24371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997463552 00000100:00100000:3.0:1788891225.103260:0:24371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788891225.103271:0:24371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23513:x1875787997463552:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788891225.103309:0:24371:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:1.0:1788891225.125666:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1875787997462656:12345-0@lo:8:kworker.0 Request processed in 36383us (38190us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788891225.125688:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788891225.125778:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925083ec8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788891225.125784:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788891225.125788:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997462656:0@lo:8:kworker.0 00000001:00080000:0.0:1788891225.156712:0:24270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1788891225.156728:0:24270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788891225.156880:0:24371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23513:x1875787997463552:12345-0@lo:5:osp-pre-0-1.0 Request processed in 53608us (54132us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788891225.156893:0:24371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788891225.157019:0:23513:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f833d1500 x1875787997463552/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788891241 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891225.157039:0:23513:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788891225.157047:0:23513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23513:1875787997463552:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788891225.157063:0:23513:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1788891225.157180:0:23513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23513:1875787997463680:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788891225.157219:0:23513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891225.157249:0:23513:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f821d7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891225.157313:0:22784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997463680 00000100:00100000:0.0:1788891225.157325:0:22784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997463680 00000100:00100000:0.0:1788891225.157381:0:22784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788891225.157390:0:22784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23513:x1875787997463680:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788891225.157438:0:22784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23513:x1875787997463680:12345-0@lo:900:osp-pre-0-1.0 Request processed in 48us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891225.157445:0:22784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788891225.157503:0:23513:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f833d1500 x1875787997463680/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788891241 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891225.157514:0:23513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23513:1875787997463680:0@lo:900:osp-pre-0-1.0 10000000:01000000:3.0:1788891225.211755:0:22770:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788891225.211763:0:22770:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff924f832d8800 from 13 10000000:01000000:3.0:1788891225.211767:0:22770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788891225.211814:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54cee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891225.211826:0:22770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54cee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891225.211838:0:22770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54cee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891225.211869:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997463808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788891225.211952:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891225.212000:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090b93b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788891225.212061:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997463808 00000100:00100000:2.0:1788891225.212070:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997463808 00000100:00100000:2.0:1788891225.212130:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788891225.212139:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+19:22770:x1875787997463808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891225.212154:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891225.212168:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925081523200/0xa66601b03fd54cf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54cee expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891225.212195:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925081523200/0xa66601b03fd54cf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54cee expref: 20 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891225.212207:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925081523200/0xa66601b03fd54cf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54cee expref: 20 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891225.212216:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925081523200, rc 0) 00000100:00100000:2.0:1788891225.212264:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+20:22770:x1875787997463808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891225.212271:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788891225.212386:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997463808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788891225.212401:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54cee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54cf5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891225.212410:0:22770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54cee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54cf5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891225.212459:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997463936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788891225.212488:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891225.212508:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090b93b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788891225.212622:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997463936 00000100:00100000:2.0:1788891225.212628:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997463936 00000100:00100000:2.0:1788891225.212649:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788891225.212656:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+20:22770:x1875787997463936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788891225.212669:0:22768:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788891225.212685:0:22768:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788891225.212688:0:22768:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788891225.212894:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+20:22770:x1875787997463936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 237us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891225.212902:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788891225.213442:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997463936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788891225.213515:0:22770:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788891225.213560:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54cee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54cf5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891225.213569:0:22770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54cee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54cf5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891225.213579:0:22770:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788891225.213581:0:22770:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9250b4f3c000 from 13 10000000:01000000:1.0:1788891225.213583:0:22770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788891225.213605:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54cfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891225.213612:0:22770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54cfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891225.213632:0:22770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54cfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891225.213648:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997464064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788891225.213681:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891225.213707:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f821d7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891225.216361:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997464064 00000100:00100000:0.0:1788891225.216378:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997464064 00000100:00100000:0.0:1788891225.216433:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788891225.216443:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+20:22770:x1875787997464064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788891225.216461:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891225.216479:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae5000/0xa66601b03fd54d03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54cfc expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891225.216508:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae5000/0xa66601b03fd54d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54cfc expref: 21 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891225.216519:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae5000/0xa66601b03fd54d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54cfc expref: 21 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891225.216546:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5000, rc 0) 00000100:00100000:0.0:1788891225.216633:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+21:22770:x1875787997464064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (2950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891225.216640:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788891225.217349:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997464064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891225.217373:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54cfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54d03 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891225.217385:0:22770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54cfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54d03 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891225.217474:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997464192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788891225.219718:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891225.219769:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f821d7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891225.219792:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997464192 00000100:00100000:1.0:1788891225.219801:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997464192 00000100:00100000:1.0:1788891225.219851:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788891225.219861:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+21:22770:x1875787997464192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788891225.219889:0:22768:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788891225.219909:0:22768:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788891225.219912:0:22768:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1788891225.220037:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+21:22770:x1875787997464192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 178us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891225.220046:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788891225.220101:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997464192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788891225.220165:0:22770:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788891225.220176:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54cfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54d03 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891225.220186:0:22770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54cfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54d03 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891225.660127:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891225.729333:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788891225.729357:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997464320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788891225.729440:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891225.729485:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997464320 00000100:00100000:2.0:1788891225.729493:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997464320 00000100:00100000:2.0:1788891225.729566:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788891225.729577:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997464320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788891225.729610:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788891225.729735:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997464320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 159us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891225.729743:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788891225.729878:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997464320:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788891226.620993:0:23529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788891226.684770:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891227.707946:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788891227.964232:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1788891228.498198:0:24643:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788891228.733363:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788891229.190723:0:24695:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788891229.190928:0:24695:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788891229.757003:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788891229.803810:0:24745:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788891229.804011:0:24745:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788891229.819644:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788891229.819667:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997464448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788891229.819734:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891229.819814:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997464448 00000100:00100000:0.0:1788891229.819822:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997464448 00000100:00100000:0.0:1788891229.819885:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788891229.819895:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997464448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788891229.819929:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446297600 avail 1300058112 00000100:00100000:0.0:1788891229.819975:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997464448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891229.819981:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788891229.820028:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997464448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788891230.204467:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891215/real 1788891215] req@ffff924f8318dc00 x1875787997454592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891230 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891230.204500:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff924f8318dc00 x1875787997454592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891230 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891230.204511:0:3626:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891215/real 1788891215] req@ffff924f8318ea00 x1875787997454720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891230 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891230.204554:0:3626:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff924f8318ea00 x1875787997454720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891230 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788891230.204598:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250875b5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788891230.204615:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788891230.204619:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997454592:0@lo:8:kworker.0 00000100:00080000:3.0:1788891230.204625:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250900ed800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788891230.204629:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788891230.204632:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997454720:0@lo:8:kworker.0 00000100:00080000:0.0:1788891230.204824:0:21261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891230.204829:0:21261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788891230.204832:0:21261:0:(import.c:65:import_set_state_nolock()) ffff9250875b5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891230.204837:0:21261:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:0.0:1788891230.204853:0:21261:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788891230.204861:0:21261:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9250875b5800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891230.204883:0:21261:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff925085871f80 x1875787997464832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788891230.204907:0:21261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891230.204910:0:21261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788891230.204912:0:21261:0:(import.c:65:import_set_state_nolock()) ffff9250900ed800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891230.204914:0:21261:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:0.0:1788891230.204917:0:21261:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788891230.204920:0:21261:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9250900ed800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891230.204931:0:21261:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff925085870700 x1875787997464960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788891230.204987:0:21261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891230.204990:0:21261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788891230.204992:0:21261:0:(import.c:65:import_set_state_nolock()) ffff925083ec8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891230.204996:0:21261:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 447 00000100:00080000:0.0:1788891230.204998:0:21261:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788891230.205002:0:21261:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff925083ec8800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1788891230.205013:0:21261:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff925085872a00 x1875787997465344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788891230.205058:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997465088:0@lo:400:kworker.0 00000100:00100000:0.0:1788891230.205136:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891230.205198:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997465728:0@lo:400:kworker.0 00000100:00100000:0.0:1788891230.205224:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891230.205250:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788891230.205255:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997465216:0@lo:400:kworker.0 00000100:00100000:0.0:1788891230.205284:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891230.205324:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997465088 00000100:00100000:0.0:1788891230.205332:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997465088 00000100:00100000:0.0:1788891230.205372:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997465728 00000100:00100000:0.0:1788891230.205376:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997465728 00000100:00100000:0.0:1788891230.205408:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788891230.205418:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997465088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891230.205469:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1875787997465088:12345-0@lo:400:kworker.0 Request processed in 52us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891230.205477:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788891230.205492:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788891230.205508:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997465728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891230.205553:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997464704:0@lo:400:kworker.0 00000100:00100000:0.0:1788891230.205571:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1875787997465728:12345-0@lo:400:kworker.0 Request processed in 64us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891230.205579:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788891230.205594:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891230.205610:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997465216 00000100:00100000:0.0:1788891230.205615:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997465216 00000100:00100000:3.0:1788891230.205631:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1875787997465600:0@lo:400:kworker.0 00000100:00100000:0.0:1788891230.205652:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788891230.205663:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997465216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891230.205664:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891230.205689:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788891230.205697:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad5d36d9-7941-4f84-88d2-361333de6068:3630:1875787997464576:0@lo:400:kworker.0 00000100:00100000:0.0:1788891230.205707:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997465216:12345-0@lo:400:kworker.0 Request processed in 47us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891230.205714:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788891230.205730:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891230.205738:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997465600 00000100:00100000:0.0:1788891230.205743:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997465600 00000100:00100000:3.0:1788891230.205761:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997465472:0@lo:400:kworker.0 00000100:00100000:0.0:1788891230.205774:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788891230.205783:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875787997465600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891230.205809:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891230.205824:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1875787997465600:12345-0@lo:400:kworker.0 Request processed in 42us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891230.205831:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788891230.205832:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997465472 00000100:00100000:2.0:1788891230.205836:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997465472 00010000:00080000:3.0:1788891230.205855:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925085872680 x1875787997465600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891230.205868:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788891230.205870:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3630:1875787997465600:0@lo:400:kworker.0 00000100:00100000:0.0:1788891230.205878:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997465472:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788891230.205901:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788891230.205908:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788891230.205912:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788891230.205920:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997465472:12345-0@lo:400:kworker.0 Request processed in 44us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891230.205926:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997464704 00000100:00100000:0.0:1788891230.205927:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788891230.205933:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997464704 00010000:00080000:0.0:1788891230.205968:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925085873b80 x1875787997465216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788891246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891230.205973:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788891230.205980:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997465216:0@lo:400:kworker.0 00000100:00100000:3.0:1788891230.205994:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997464704:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788891230.206006:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925085871500 x1875787997465088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891230.206016:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3627:1875787997465088:0@lo:400:kworker.0 00010000:00080000:0.0:1788891230.206026:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925085873100 x1875787997465728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891230.206034:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3627:1875787997465728:0@lo:400:kworker.0 00000100:00100000:0.0:1788891230.206072:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997464576 00000100:00100000:0.0:1788891230.206075:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997464576 00000100:00100000:0.0:1788891230.206098:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788891230.206104:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+21:3630:x1875787997464576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891230.206133:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+21:3630:x1875787997464576:12345-0@lo:400:kworker.0 Request processed in 29us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891230.206140:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788891230.206671:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997464704:12345-0@lo:400:kworker.0 Request processed in 681us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891230.206680:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788891230.206711:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad5d36d9-7941-4f84-88d2-361333de6068:3630:1875787997464576:0@lo:400:kworker.0 00010000:00080000:3.0:1788891230.206724:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925085871180 x1875787997465472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891230.206734:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997465472:0@lo:400:kworker.0 00000100:00100000:3.0:1788891230.206743:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997464704:0@lo:400:kworker.0 00000100:00100000:1.0:1788891230.211678:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997464832:0@lo:8:kworker.0 00000100:00100000:1.0:1788891230.211751:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891230.211799:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997464960:0@lo:8:kworker.0 00000100:00100000:1.0:1788891230.211823:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891230.211856:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997465344:0@lo:8:kworker.0 00000100:00100000:0.0:1788891230.211867:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997464832 00000100:00100000:0.0:1788891230.211874:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997464832 00000100:00100000:1.0:1788891230.211876:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891230.211905:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997464960 00000100:00100000:1.0:1788891230.211906:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997465344 00000100:00100000:1.0:1788891230.211908:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997465344 00000100:00100000:0.0:1788891230.211908:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997464960 00000100:00100000:0.0:1788891230.211921:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788891230.211927:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1875787997464832:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788891230.211962:0:24276:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:0.0:1788891230.211993:0:24276:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd54d0a 00002000:00100000:0.0:1788891230.212006:0:24276:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9250bcffe800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788891230.212010:0:24276:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788891230.212013:0:24276:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788891230.212082:0:24276:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788891230.212113:0:24276:0:(import.c:65:import_set_state_nolock()) ffff9250bcffc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788891230.212164:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3626:x1875787997464832:12345-0@lo:8:kworker.0 Request processed in 236us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891230.212666:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788891230.212673:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3626:x1875787997464960:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788891230.212687:0:24275:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788891230.212718:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3626:x1875787997464960:12345-0@lo:8:kworker.0 Request processed in 45us (894us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788891230.212725:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788891230.214284:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788891230.214300:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3626:x1875787997465344:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788891230.214319:0:24275:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788891230.214378:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3626:x1875787997465344:12345-0@lo:8:kworker.0 Request processed in 78us (2499us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788891230.214385:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788891230.214436:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff925085871f80 x1875787997464832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788891250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891230.214447:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788891230.214456:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788891230.214464:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788891230.214469:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788891230.214472:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250875b5800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788891230.214487:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788891230.214492:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997464832:0@lo:8:kworker.0 00000100:00080000:1.0:1788891230.214504:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250900ed800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788891230.214507:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788891230.214510:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997464960:0@lo:8:kworker.0 00000100:00080000:1.0:1788891230.214518:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925083ec8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788891230.214790:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788891230.214794:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997465344:0@lo:8:kworker.0 00000004:00080000:1.0:1788891230.214872:0:22797:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:1.0:1788891230.214895:0:22797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a65500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22797:1875787997465984:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788891230.214931:0:22797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891230.214949:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250878bda80 going to sleep for 11 seconds 00000004:00080000:1.0:1788891230.214968:0:22796:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788891230.215056:0:22796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 452459532025ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788891230.215062:0:22796:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788891230.215085:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f833d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997465856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788891230.215112:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891230.215272:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997465856 00000100:00100000:1.0:1788891230.215280:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997465856 00000100:00100000:1.0:1788891230.215323:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788891230.215329:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3628:x1875787997465856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788891230.215353:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788891230.215391:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3628:x1875787997465856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891230.215397:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788891230.215412:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788891230.215433:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f833d0e00 x1875787997465856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891230.215449:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f833d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997465856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788891230.215468:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997465984 00000100:00100000:1.0:1788891230.215471:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997465984 00000100:00100000:1.0:1788891230.215494:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788891230.215500:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:22797:x1875787997465984:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788891230.216611:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:2.0:1788891230.219920:0:22753:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788891230.221910:0:24275:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788891230.221924:0:24275:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1788891230.221930:0:24275:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00002000:00010000:2.0:1788891230.230756:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.230770:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bd01453/0xa66601b03fd54d11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.230789:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.230795:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.230801:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bd01453/0xa66601b03fd54d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.230834:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bd01453/0xa66601b03fd54d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.230854:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bd01453/0xa66601b03fd54d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.230862:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bd01453/0xa66601b03fd54d11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.230893:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891230.231189:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891230.231197:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bd01453/0xa66601b03fd54d11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.231207:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891230.231212:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bd01453/0xa66601b03fd54d11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.231229:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bd01453/0xa66601b03fd54d11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.231251:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bd01453/0xa66601b03fd54d11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.231258:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bd01453/0xa66601b03fd54d11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.231279:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891230.231281:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891230.231283:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788891230.231448:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.231454:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002514ddb5/0xa66601b03fd54d18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.231464:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.231467:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.231471:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002514ddb5/0xa66601b03fd54d18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.231480:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002514ddb5/0xa66601b03fd54d18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.231488:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002514ddb5/0xa66601b03fd54d18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.231508:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002514ddb5/0xa66601b03fd54d18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.231706:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788891230.232030:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.232036:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4f83e64/0xa66601b03fd54d1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.232046:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.232049:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.232053:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f83e64/0xa66601b03fd54d1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.232061:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4f83e64/0xa66601b03fd54d1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.232070:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4f83e64/0xa66601b03fd54d1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.232077:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f83e64/0xa66601b03fd54d1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.232220:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788891230.232230:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002514ddb5/0xa66601b03fd54d18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.232239:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891230.232244:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002514ddb5/0xa66601b03fd54d18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.232253:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002514ddb5/0xa66601b03fd54d18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.232270:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002514ddb5/0xa66601b03fd54d18 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.232279:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002514ddb5/0xa66601b03fd54d18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.232313:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891230.232317:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4f83e64/0xa66601b03fd54d1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.232324:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522a00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891230.232327:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4f83e64/0xa66601b03fd54d1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.232335:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4f83e64/0xa66601b03fd54d1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.232346:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4f83e64/0xa66601b03fd54d1f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.232352:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.232354:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.232356:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.232423:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788891230.232429:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4f83e64/0xa66601b03fd54d1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891230.232867:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.232873:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4af717/0xa66601b03fd54d26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.232883:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.232886:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.232891:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db4af717/0xa66601b03fd54d26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.232901:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db4af717/0xa66601b03fd54d26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.232909:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db4af717/0xa66601b03fd54d26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.232915:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db4af717/0xa66601b03fd54d26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.233113:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891230.233119:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db4af717/0xa66601b03fd54d26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.233127:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522c00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891230.233130:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4af717/0xa66601b03fd54d26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.233149:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db4af717/0xa66601b03fd54d26 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.233161:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db4af717/0xa66601b03fd54d26 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.233169:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.233171:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.233172:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.233229:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788891230.233235:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db4af717/0xa66601b03fd54d26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891230.233518:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.233686:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084af974a/0xa66601b03fd54d2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.233704:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.233708:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.233712:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084af974a/0xa66601b03fd54d2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.233723:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084af974a/0xa66601b03fd54d2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.233730:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084af974a/0xa66601b03fd54d2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.233738:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084af974a/0xa66601b03fd54d2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.233796:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891230.233810:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:2.0:1788891230.234130:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.234136:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d09a5d/0xa66601b03fd54d34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.234144:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.234147:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.234151:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d09a5d/0xa66601b03fd54d34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.234160:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d09a5d/0xa66601b03fd54d34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.234178:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d09a5d/0xa66601b03fd54d34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.234184:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d09a5d/0xa66601b03fd54d34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.234210:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891230.234216:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d09a5d/0xa66601b03fd54d34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.234223:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081523600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891230.234227:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d09a5d/0xa66601b03fd54d34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.234235:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d09a5d/0xa66601b03fd54d34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.234249:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d09a5d/0xa66601b03fd54d34 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.234257:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.234259:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.234261:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891230.234293:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084af974a/0xa66601b03fd54d2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.234300:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925081522e00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891230.234304:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084af974a/0xa66601b03fd54d2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.234311:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084af974a/0xa66601b03fd54d2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.234323:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084af974a/0xa66601b03fd54d2d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.234343:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084af974a/0xa66601b03fd54d2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.234359:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891230.234360:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891230.234362:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.234421:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788891230.234427:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d09a5d/0xa66601b03fd54d34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891230.234866:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.234871:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011c95775/0xa66601b03fd54d3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.234881:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.234884:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.234888:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011c95775/0xa66601b03fd54d3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.234897:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011c95775/0xa66601b03fd54d3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.234904:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011c95775/0xa66601b03fd54d3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.234919:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011c95775/0xa66601b03fd54d3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.235108:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891230.235114:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011c95775/0xa66601b03fd54d3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.235122:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587b000 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891230.235125:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011c95775/0xa66601b03fd54d3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.235133:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011c95775/0xa66601b03fd54d3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.235145:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011c95775/0xa66601b03fd54d3b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.235154:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.235155:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.235157:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.235217:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788891230.235223:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011c95775/0xa66601b03fd54d3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891230.235577:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.235584:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ad4a5c5/0xa66601b03fd54d42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.235593:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.235695:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.235700:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ad4a5c5/0xa66601b03fd54d42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.235711:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ad4a5c5/0xa66601b03fd54d42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.235718:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ad4a5c5/0xa66601b03fd54d42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.235726:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ad4a5c5/0xa66601b03fd54d42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.235917:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891230.235923:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ad4a5c5/0xa66601b03fd54d42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.235930:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587a600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891230.235934:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ad4a5c5/0xa66601b03fd54d42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.235941:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ad4a5c5/0xa66601b03fd54d42 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.235962:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ad4a5c5/0xa66601b03fd54d42 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.235970:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.235971:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.235973:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.236086:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788891230.236091:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ad4a5c5/0xa66601b03fd54d42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891230.236367:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.236373:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc09bdc2/0xa66601b03fd54d49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.236382:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.236385:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.236389:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc09bdc2/0xa66601b03fd54d49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.236398:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc09bdc2/0xa66601b03fd54d49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.236405:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc09bdc2/0xa66601b03fd54d49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.236412:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc09bdc2/0xa66601b03fd54d49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.236451:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891230.236457:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc09bdc2/0xa66601b03fd54d49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.236464:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587be00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891230.236468:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc09bdc2/0xa66601b03fd54d49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.236474:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc09bdc2/0xa66601b03fd54d49 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.236486:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc09bdc2/0xa66601b03fd54d49 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.236493:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891230.236494:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891230.236496:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.236765:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788891230.236771:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc09bdc2/0xa66601b03fd54d49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891230.237091:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.237098:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003590de88/0xa66601b03fd54d50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.237108:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.237112:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.237116:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003590de88/0xa66601b03fd54d50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.237126:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003590de88/0xa66601b03fd54d50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.237134:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003590de88/0xa66601b03fd54d50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.237141:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003590de88/0xa66601b03fd54d50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.237175:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891230.237181:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003590de88/0xa66601b03fd54d50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.237189:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587a400 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891230.237192:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003590de88/0xa66601b03fd54d50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.237199:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003590de88/0xa66601b03fd54d50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.237211:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003590de88/0xa66601b03fd54d50 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.237219:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.237220:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.237222:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.237281:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788891230.237286:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003590de88/0xa66601b03fd54d50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891230.237567:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.237573:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54d57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.237591:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.237594:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.237702:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54d57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.237712:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54d57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.237720:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54d57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.237726:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54d57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.237822:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891230.237827:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54d57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.237855:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587ba00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891230.237858:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54d57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.237865:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54d57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.237876:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54d57 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.237883:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.237885:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.237887:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.237945:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788891230.237951:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54d57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891230.238293:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.238299:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54d5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.238308:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.238312:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.238315:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54d5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.238337:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54d5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.238346:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54d5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.238352:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54d5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.238381:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891230.238387:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54d5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.238404:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587ac00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891230.238408:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54d5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.238416:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54d5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.238427:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54d5e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.238436:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891230.238437:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891230.238438:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.238497:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788891230.238503:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54d5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891230.238959:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.238965:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.238975:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.238979:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.238983:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.238993:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.239074:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.239083:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.239189:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891230.239196:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.239204:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587ae00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891230.239208:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.239216:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.239229:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d65 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.239246:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.239247:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.239249:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.239310:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788891230.239315:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891230.239873:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.239880:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.239890:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.239894:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.239899:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.239909:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.239917:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.239938:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.240052:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891230.240057:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.240065:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587a200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891230.240069:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.240076:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.240088:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d6c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.240096:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.240098:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.240099:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.240207:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788891230.240212:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891230.240551:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.240557:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ff636f0/0xa66601b03fd54d73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.240565:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.240568:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.240572:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ff636f0/0xa66601b03fd54d73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.240580:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ff636f0/0xa66601b03fd54d73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.240588:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ff636f0/0xa66601b03fd54d73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.240704:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ff636f0/0xa66601b03fd54d73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.240762:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891230.240768:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ff636f0/0xa66601b03fd54d73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.240775:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587b200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891230.240778:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ff636f0/0xa66601b03fd54d73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.240786:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ff636f0/0xa66601b03fd54d73 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.240798:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ff636f0/0xa66601b03fd54d73 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.240880:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891230.240883:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891230.240885:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.240956:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788891230.240961:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ff636f0/0xa66601b03fd54d73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891230.241276:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.241282:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072deef3a/0xa66601b03fd54d7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.241290:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.241293:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.241297:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072deef3a/0xa66601b03fd54d7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.241306:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072deef3a/0xa66601b03fd54d7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.241314:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072deef3a/0xa66601b03fd54d7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.241321:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072deef3a/0xa66601b03fd54d7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.241354:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891230.241359:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072deef3a/0xa66601b03fd54d7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.241366:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587b600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891230.241369:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072deef3a/0xa66601b03fd54d7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.241383:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072deef3a/0xa66601b03fd54d7a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.241395:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072deef3a/0xa66601b03fd54d7a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.241402:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.241404:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.241406:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.241473:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788891230.241478:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072deef3a/0xa66601b03fd54d7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891230.241891:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.241897:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54d81 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.241904:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.241907:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.241912:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54d81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.241920:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54d81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.241927:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54d81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.241934:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54d81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.242064:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891230.242070:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54d81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.242077:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587b800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891230.242080:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54d81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.242087:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54d81 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.242098:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54d81 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.242161:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891230.242163:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891230.242165:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.242225:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788891230.242231:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54d81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891230.242488:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.242494:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54d88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.242511:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.242514:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.242519:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54d88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.242663:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54d88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.242672:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54d88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.242678:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54d88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.242763:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891230.242770:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54d88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.242777:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587b400 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891230.242780:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54d88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.242788:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54d88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.242802:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54d88 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.242810:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891230.242811:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891230.242813:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.242939:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788891230.242944:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54d88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891230.243509:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.243516:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54d8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.243736:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.243739:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.243745:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54d8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.243768:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54d8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.243776:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54d8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.243782:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54d8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.243873:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891230.243881:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54d8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.243895:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587a800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891230.243899:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54d8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.243906:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54d8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.243920:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54d8f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.243927:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.243929:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.243931:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.246112:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788891230.246126:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54d8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891230.246505:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788891230.248168:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.248182:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.248197:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.248203:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.248210:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.248224:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.248249:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.248256:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.248334:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891230.248630:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891230.248638:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.248652:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587a200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891230.248658:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.248668:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.248685:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d96 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.248692:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b90b48ad/0xa66601b03fd54d96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.248712:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891230.248715:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891230.248717:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788891230.249029:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.249037:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.249047:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.249050:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.249055:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.249065:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.249073:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.249080:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.249114:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788891230.249927:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.249935:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54da4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.249946:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.249949:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.249954:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54da4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.249964:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54da4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.249973:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54da4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.249981:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54da4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.249999:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788891230.250010:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788891230.250015:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.250023:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587ae00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891230.250034:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.250043:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.250056:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d9d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.250064:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54d9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.250081:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891230.250085:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54da4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.250092:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587ac00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891230.250095:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54da4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.250102:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54da4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.250111:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54da4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.250118:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54da4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.250137:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.250138:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.250140:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891230.250307:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788891230.251299:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.251308:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54dab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.251320:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.251324:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.251328:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54dab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.251340:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54dab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.251349:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54dab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.251356:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54dab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.251378:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891230.251556:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891230.251564:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54dab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.251571:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587ba00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891230.251575:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54dab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.251594:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54dab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.251608:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54dab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.251616:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc43ef82/0xa66601b03fd54dab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.251633:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891230.251634:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891230.251636:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788891230.252736:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.252746:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54db2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.252769:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.252773:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.252777:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54db2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.252789:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54db2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.252797:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54db2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.252805:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54db2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.252820:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891230.252829:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891230.252834:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54db2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.252854:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587a800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891230.252858:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54db2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.252865:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54db2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.252889:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54db2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.252897:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d999113c/0xa66601b03fd54db2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.252910:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.252912:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.252914:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891230.254500:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891230.254512:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd54db9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.254596:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1788891230.254600:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891230.254607:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd54db9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.254620:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd54db9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.254629:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd54db9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.254646:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd54db9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.254664:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891230.254905:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891230.254912:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd54db9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.254919:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5400 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891230.254923:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd54db9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.254930:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd54db9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.254945:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd54db9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.254951:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d47e3a63/0xa66601b03fd54db9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.254988:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.254990:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.254992:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891230.257324:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891230.257337:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54dc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.257354:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1788891230.257359:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891230.257367:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.257382:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.257393:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.257401:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.257419:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891230.257432:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891230.257439:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.257455:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4e00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891230.257460:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.257470:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54dc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.257490:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54dc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.257498:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e6c7359/0xa66601b03fd54dc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.257516:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891230.257519:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891230.257539:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891230.258915:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891230.258926:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54dc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.258938:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1788891230.258942:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891230.258947:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.258959:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.258975:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.258996:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.259017:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891230.259081:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891230.259089:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.259099:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891230.259103:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.259113:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54dc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.259128:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54dc7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.259136:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042edfa69/0xa66601b03fd54dc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.259153:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.259156:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.259158:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788891230.261768:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.261782:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54dce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.261810:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.261815:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.261821:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54dce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.261834:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54dce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.261861:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54dce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.261869:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54dce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.261985:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891230.261995:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54dce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.262005:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587ac00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891230.262010:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54dce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.262019:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54dce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.262037:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54dce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.262054:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891230.262056:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891230.262057:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891230.262084:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891230.262091:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e3ea656/0xa66601b03fd54dce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891230.262642:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.262648:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54dd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.262658:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.262662:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.262666:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.262687:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.262696:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.262703:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.262724:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891230.262869:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891230.262882:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.262890:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587ae00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891230.262894:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.262903:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54dd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.262916:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54dd5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.262925:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000109aac80/0xa66601b03fd54dd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.262940:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891230.262943:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891230.262944:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788891230.263436:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.263443:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54ddc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.263453:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.263456:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.263460:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54ddc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.263469:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54ddc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.263476:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54ddc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.263493:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54ddc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.263517:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891230.263691:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891230.263699:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54ddc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.263707:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587b400 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891230.263711:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54ddc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.263720:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54ddc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.263733:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54ddc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.263747:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063973d8e/0xa66601b03fd54ddc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891230.263765:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.263767:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891230.263768:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788891230.264127:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891230.264133:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54de3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.264142:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788891230.264145:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891230.264149:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54de3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.264158:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54de3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.264166:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54de3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.264173:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54de3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891230.264190:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788891230.264220:0:24275:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00010000:00010000:0.0:1788891230.264282:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891230.264289:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54de3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.264298:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587b800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891230.264301:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54de3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891230.264318:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22797:x1875787997465984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 48812us (49382us total) trans 0 rc 0/0 00010000:00010000:0.0:1788891230.264325:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54de3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891230.264343:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788891230.264346:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54de3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.264356:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5fbd725/0xa66601b03fd54de3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891230.264375:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891230.264378:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891230.264380:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891230.264411:0:22797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a65500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22797:1875787997465984:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788891230.264428:0:22797:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:2.0:1788891230.264478:0:22797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4886a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22797:1875787997466112:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788891230.264516:0:22797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891230.264567:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f822f56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788891230.264584:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997466112 00000100:00100000:2.0:1788891230.264589:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997466112 00000100:00100000:2.0:1788891230.264628:0:24371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788891230.264636:0:24371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22797:x1875787997466112:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788891230.264672:0:24371:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:0.0:1788891230.273465:0:24270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1788891230.273515:0:24270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788891230.273797:0:24371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22797:x1875787997466112:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9156us (9276us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788891230.273809:0:24371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788891230.273824:0:22797:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1788891230.273833:0:22797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4886a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22797:1875787997466112:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788891230.273862:0:22797:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:3.0:1788891230.333172:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997466240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788891230.333272:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891230.333403:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997466240 00000100:00100000:2.0:1788891230.333412:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997466240 00000100:00100000:2.0:1788891230.333484:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788891230.333493:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997466240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788891230.333514:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788891230.333588:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997466240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891230.333597:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788891230.333707:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997466240:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788891230.779750:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891230.847069:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997466368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788891230.847145:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891230.847244:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997466368 00000100:00100000:0.0:1788891230.847252:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997466368 00000100:00100000:0.0:1788891230.847306:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788891230.847317:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997466368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788891230.847355:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788891230.847415:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997466368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891230.847423:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788891230.847470:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997466368:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788891231.805200:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891232.827646:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891233.852365:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788891234.487478:0:25091:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788891234.487482:0:25091:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788891234.487483:0:25091:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788891234.487633:0:25091:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9250841ad000 00000020:01000004:3.0:1788891234.487650:0:25091:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788891234.487664:0:25091:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788891234.487677:0:25091:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff924f81ed0000) 00000020:00000080:3.0:1788891234.487694:0:25091:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788891234.538783:0:25091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788891234.539458:0:25091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788891234.539800:0:25091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788891234.539982:0:25091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788891234.540227:0:25091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788891234.540407:0:25091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788891234.540641:0:25091:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1788891234.542947:0:25091:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788891234.543159:0:25091:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788891234.543174:0:25091:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788891234.543186:0:25091:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa66601b03fd54df1 00000020:01000004:2.0:1788891234.543194:0:25091:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788891234.543218:0:25091:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788891234.543221:0:25091:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788891234.543228:0:25091:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788891234.543270:0:25091:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788891234.543275:0:25091:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788891234.551787:0:25091:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788891234.551830:0:25091:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.126@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788891234.551834:0:25091:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788891234.551840:0:25091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788891234.551841:0:25091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891234.551842:0:25091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891234.551843:0:25091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891234.551845:0:25091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891234.551846:0:25091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788891234.551848:0:25091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891234.551849:0:25091:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788891234.551852:0:25091:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788891234.551854:0:25091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788891234.551856:0:25091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788891234.551856:0:25091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891234.551857:0:25091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891234.551858:0:25091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891234.551859:0:25091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891234.551860:0:25091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788891234.551861:0:25091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891234.551862:0:25091:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788891234.551887:0:25091:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788891234.551909:0:25091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997466496:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788891234.552033:0:25091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891234.552144:0:25091:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f838476c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891234.552189:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997466496 00000100:00100000:1.0:1788891234.552197:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997466496 00000100:00100000:1.0:1788891234.552291:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788891234.552301:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+21:25091:x1875787997466496:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788891234.552330:0:22767:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788891234.552334:0:22767:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788891234.552338:0:22767:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788891234.552631:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+21:25091:x1875787997466496:12345-0@lo:253:mount.lustre.0 Request processed in 331us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891234.552639:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788891234.552728:0:25091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997466496:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788891234.552739:0:25091:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788891234.552742:0:25091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788891234.552743:0:25091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788891234.552744:0:25091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891234.552745:0:25091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891234.552746:0:25091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891234.552747:0:25091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891234.552749:0:25091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788891234.552750:0:25091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891234.552751:0:25091:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788891234.552780:0:25091:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9250841ad000 from lustre-OST0001 10000000:01000000:3.0:1788891234.552803:0:25091:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788891234.552806:0:25091:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788891234.552813:0:25091:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff925090b24d28 local copy 00010000:00010000:3.0:1788891234.552831:0:25091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5600/0xa66601b03fd54a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54a32 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891234.552929:0:25091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997466624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891234.552969:0:25091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891234.553198:0:25091:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847540 going to sleep for 11 seconds 00000100:00100000:0.0:1788891234.553250:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997466624 00000100:00100000:0.0:1788891234.553256:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997466624 00000100:00100000:1.0:1788891234.553303:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788891234.553311:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+21:25091:x1875787997466624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891234.553384:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+21:25091:x1875787997466624:12345-0@lo:501:mount.lustre.0 Request processed in 73us (413us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788891234.553391:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788891234.553447:0:25091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997466624:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788891234.553461:0:25091:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788891234.553478:0:25091:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788891234.553484:0:25091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5600/0xa66601b03fd54a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54a32 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891234.553493:0:25091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae5600/0xa66601b03fd54a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54a32 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891234.553520:0:25091:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9250841ad000 10000000:01000000:3.0:1788891234.553547:0:25091:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788891234.553554:0:25091:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788891234.553556:0:25091:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788891234.553561:0:25091:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788891234.553563:0:25091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788891234.553586:0:25091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd54df8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891234.553593:0:25091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd54df8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891234.553604:0:25091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd54df8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891234.553630:0:25091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997466752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788891234.553658:0:25091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891234.553834:0:25091:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847540 going to sleep for 11 seconds 00000100:00100000:2.0:1788891234.556331:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997466752 00000100:00100000:2.0:1788891234.556346:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997466752 00000100:00100000:2.0:1788891234.556433:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788891234.556446:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+21:25091:x1875787997466752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891234.556463:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891234.556482:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92508587b400/0xa66601b03fd54dff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54df8 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891234.556510:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92508587b400/0xa66601b03fd54dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54df8 expref: 22 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891234.556535:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92508587b400/0xa66601b03fd54dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54df8 expref: 22 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891234.556546:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92508587b400, rc 0) 00000100:00100000:2.0:1788891234.556675:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+22:25091:x1875787997466752:12345-0@lo:101:mount.lustre.0 Request processed in 230us (3013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891234.556683:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788891234.557043:0:25091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997466752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891234.557064:0:25091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd54df8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54dff expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891234.557077:0:25091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd54df8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54dff expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788891234.558146:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1788891234.558850:0:25091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788891234.560840:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788891234.560886:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788891234.560902:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788891234.560917:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788891234.561003:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788891234.561022:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788891234.561036:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788891234.561048:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788891234.561060:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1788891234.561083:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1788891234.561089:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1788891234.561194:0:25091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997466880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891234.561264:0:25091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891234.561354:0:25091:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847000 going to sleep for 11 seconds 00000100:00100000:2.0:1788891234.561397:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997466880 00000100:00100000:2.0:1788891234.561404:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997466880 00000100:00100000:2.0:1788891234.561498:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788891234.561508:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+22:25091:x1875787997466880:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891234.561684:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+22:25091:x1875787997466880:12345-0@lo:501:mount.lustre.0 Request processed in 178us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891234.561692:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788891234.561799:0:25091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997466880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891234.561843:0:25091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997467008:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788891234.561881:0:25091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891234.562115:0:25091:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847000 going to sleep for 11 seconds 00000100:00100000:0.0:1788891234.562186:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997467008 00000100:00100000:0.0:1788891234.562192:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997467008 00000100:00100000:0.0:1788891234.562217:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788891234.562223:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+22:25091:x1875787997467008:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891234.562861:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+22:25091:x1875787997467008:12345-0@lo:503:mount.lustre.0 Request processed in 636us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891234.562869:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788891234.562981:0:25091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997467008:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788891234.563375:0:25091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788891234.563452:0:25091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997467136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891234.563498:0:25091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891234.563545:0:25091:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847540 going to sleep for 11 seconds 00000100:00100000:0.0:1788891234.563607:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997467136 00000100:00100000:0.0:1788891234.563612:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997467136 00000100:00100000:0.0:1788891234.563637:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788891234.563643:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+22:25091:x1875787997467136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891234.563994:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+22:25091:x1875787997467136:12345-0@lo:502:mount.lustre.0 Request processed in 350us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891234.564002:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788891234.564087:0:25091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997467136:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891234.564328:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788891234.564363:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788891234.564383:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788891234.564404:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788891234.564445:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788891234.564467:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788891234.564484:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788891234.564504:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788891234.564553:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1788891234.564636:0:25091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997467264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891234.564677:0:25091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891234.564764:0:25091:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847540 going to sleep for 11 seconds 00000100:00100000:2.0:1788891234.564832:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997467264 00000100:00100000:2.0:1788891234.564838:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997467264 00000100:00100000:0.0:1788891234.564915:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788891234.564923:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+22:25091:x1875787997467264:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891234.565055:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+22:25091:x1875787997467264:12345-0@lo:502:mount.lustre.0 Request processed in 133us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891234.565063:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788891234.565175:0:25091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997467264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891234.565215:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1788891234.565223:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788891234.566016:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788891234.566025:0:25095:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788891234.566031:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891234.566033:0:25095:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788891234.566040:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788891234.566055:0:25095:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9250ba598000) 00000020:00000080:1.0:1788891234.566078:0:25095:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788891234.566085:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788891234.566178:0:25095:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9250841ad000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788891234.566186:0:25095:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788891234.566193:0:25095:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa66601b03fd54e0d 00010000:00010000:0.0:1788891234.569847:0:25095:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1788891234.570322:0:25095:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934601 00080000:10000000:0.0:1788891234.571692:0:25095:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1788891234.572918:0:25095:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788891234.572997:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891234.573011:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891234.573013:0:25095:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788891234.573018:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891234.573022:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891234.573024:0:25095:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788891234.573027:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788891234.573028:0:25095:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788891234.573031:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891234.573033:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891234.573034:0:25095:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788891234.573036:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891234.573039:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891234.573040:0:25095:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788891234.573043:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788891234.573067:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891234.573070:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891234.573071:0:25095:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788891234.573074:0:25095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1788891234.575052:0:25091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788891234.575093:0:25091:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788891234.576029:0:25091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd54df8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54dff expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891234.576043:0:25091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8a800/0xa66601b03fd54df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54dff expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891234.576051:0:25091:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9250841ad000 from 1 10000000:01000000:3.0:1788891234.576054:0:25091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788891234.576092:0:25091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a600/0xa66601b03fd54e14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891234.576101:0:25091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff925091a8a600/0xa66601b03fd54e14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891234.576111:0:25091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff925091a8a600/0xa66601b03fd54e14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891234.576136:0:25091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997467392:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788891234.576200:0:25091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891234.576283:0:25091:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891234.578667:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997467392 00000100:00100000:0.0:1788891234.578680:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997467392 00000100:00100000:0.0:1788891234.578803:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788891234.578814:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+22:25091:x1875787997467392:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891234.578831:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891234.578848:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae4000/0xa66601b03fd54e1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54e14 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.578874:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae4000/0xa66601b03fd54e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54e14 expref: 23 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.578886:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae4000/0xa66601b03fd54e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54e14 expref: 23 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.578894:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae4000, rc 0) 00000100:00100000:0.0:1788891234.579162:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+23:25091:x1875787997467392:12345-0@lo:101:mount.lustre.0 Request processed in 350us (2960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891234.579170:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788891234.579254:0:25091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997467392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891234.579272:0:25091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff925091a8a600/0xa66601b03fd54e14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54e1b expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891234.579282:0:25091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff925091a8a600/0xa66601b03fd54e14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54e1b expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788891234.582571:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1788891234.582861:0:25091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788891234.583048:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788891234.583079:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788891234.583096:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788891234.583110:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788891234.583122:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788891234.583135:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788891234.583148:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788891234.583160:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788891234.583191:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788891234.583205:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1788891234.583217:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1788891234.583234:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1788891234.583239:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1788891234.583316:0:25091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997467520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891234.583379:0:25091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891234.584074:0:25091:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f838470c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891234.584161:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997467520 00000100:00100000:0.0:1788891234.584168:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997467520 00000100:00100000:0.0:1788891234.584211:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788891234.584220:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+23:25091:x1875787997467520:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891234.584347:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+23:25091:x1875787997467520:12345-0@lo:501:mount.lustre.0 Request processed in 127us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891234.584355:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788891234.584450:0:25091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997467520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891234.584486:0:25091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997467648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788891234.584557:0:25091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891234.584579:0:25091:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f838470c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891234.584650:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997467648 00000100:00100000:0.0:1788891234.584654:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997467648 00000100:00100000:0.0:1788891234.584673:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788891234.584678:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+23:25091:x1875787997467648:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891234.584751:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+23:25091:x1875787997467648:12345-0@lo:503:mount.lustre.0 Request processed in 72us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891234.584770:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788891234.584863:0:25091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997467648:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788891234.585224:0:25091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788891234.585283:0:25091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997467776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891234.585321:0:25091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891234.585345:0:25091:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f83847cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891234.585426:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997467776 00000100:00100000:1.0:1788891234.585432:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997467776 00000100:00100000:1.0:1788891234.585469:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788891234.585477:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+23:25091:x1875787997467776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891234.585650:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+23:25091:x1875787997467776:12345-0@lo:502:mount.lustre.0 Request processed in 173us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891234.585657:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788891234.585689:0:25091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997467776:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788891234.585879:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788891234.585906:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788891234.585920:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788891234.586006:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788891234.586022:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788891234.586036:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788891234.586049:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788891234.586061:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1788891234.586074:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788891234.586088:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1788891234.586114:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1788891234.586138:0:25091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997467904:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891234.586174:0:25091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891234.586207:0:25091:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788891234.586255:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997467904 00000100:00100000:3.0:1788891234.586260:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997467904 00000100:00100000:3.0:1788891234.586292:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788891234.586299:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+23:25091:x1875787997467904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891234.586392:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+23:25091:x1875787997467904:12345-0@lo:502:mount.lustre.0 Request processed in 92us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891234.586399:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788891234.586474:0:25091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997467904:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788891234.586510:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1788891234.586518:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788891234.587172:0:25099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891234.587180:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891234.587183:0:25099:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788891234.587190:0:25099:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9250841ad000 00000020:00000080:0.0:1788891234.587192:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788891234.587199:0:25099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891234.587201:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891234.587203:0:25099:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788891234.587205:0:25099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891234.587207:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891234.587209:0:25099:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788891234.587212:0:25099:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9250841ad000 00000020:00000080:0.0:1788891234.587214:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788891234.587278:0:25099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891234.587282:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891234.587283:0:25099:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788891234.587285:0:25099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891234.587288:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891234.587289:0:25099:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788891234.587293:0:25099:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9250841ad000 00000020:00000080:0.0:1788891234.587295:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788891234.587313:0:25099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891234.587315:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891234.587317:0:25099:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788891234.587319:0:25099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891234.587329:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891234.587331:0:25099:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788891234.587334:0:25099:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9250841ad000 00000020:00000080:0.0:1788891234.587336:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788891234.587360:0:25099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891234.587364:0:25099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891234.587365:0:25099:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788891234.587368:0:25099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1788891234.587406:0:25091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788891234.587431:0:25091:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788891234.587448:0:25091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff925091a8a600/0xa66601b03fd54e14 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54e1b expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.587459:0:25091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff925091a8a600/0xa66601b03fd54e14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54e1b expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891234.587500:0:25091:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788891234.587503:0:25091:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9250841ad000 10000000:01000000:0.0:1788891234.587506:0:25091:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9250841ad000 10000000:01000000:0.0:1788891234.587510:0:25091:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788891234.587515:0:25091:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9250841ad000 from 1 10000000:01000000:0.0:1788891234.587518:0:25091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788891234.587571:0:25091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5a00/0xa66601b03fd54e22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.587579:0:25091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae5a00/0xa66601b03fd54e22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.587588:0:25091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae5a00/0xa66601b03fd54e22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891234.587606:0:25091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997468032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891234.587653:0:25091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891234.587685:0:25091:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788891234.587691:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997468032 00000100:00100000:1.0:1788891234.587699:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997468032 00000100:00100000:1.0:1788891234.588707:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788891234.588722:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+23:25091:x1875787997468032:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891234.588736:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891234.588763:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c6600/0xa66601b03fd54e29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54e22 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891234.588793:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c6600/0xa66601b03fd54e29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54e22 expref: 24 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891234.588805:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c6600/0xa66601b03fd54e29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54e22 expref: 24 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891234.588815:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6600, rc 0) 00000100:00100000:1.0:1788891234.588875:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+24:25091:x1875787997468032:12345-0@lo:101:mount.lustre.0 Request processed in 158us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891234.588884:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788891234.589032:0:25091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997468032:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891234.589048:0:25091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae5a00/0xa66601b03fd54e22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54e29 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.589057:0:25091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae5a00/0xa66601b03fd54e22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54e29 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788891234.592233:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1788891234.592554:0:25091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788891234.592772:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788891234.592798:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788891234.592814:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788891234.592830:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788891234.592848:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788891234.592863:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788891234.592878:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788891234.592894:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788891234.592909:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788891234.592924:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788891234.594719:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788891234.594742:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788891234.594770:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788891234.594788:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788891234.594820:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788891234.594836:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788891234.594849:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788891234.594863:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788891234.594875:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788891234.594888:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788891234.594913:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788891234.595601:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788891234.595635:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788891234.595655:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788891234.595668:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1788891234.595681:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1788891234.595693:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1788891234.595705:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1788891234.595717:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1788891234.595731:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1788891234.595773:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1788891234.595791:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1788891234.595803:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1788891234.595815:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1788891234.595828:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1788891234.595841:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1788891234.595853:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1788891234.595866:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1788891234.595878:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1788891234.595891:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1788891234.595903:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1788891234.595916:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1788891234.597032:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1788891234.597062:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1788891234.597076:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1788891234.597089:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1788891234.597119:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1788891234.597134:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788891234.597295:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788891234.597316:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788891234.597334:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788891234.597339:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788891234.597460:0:25091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997468160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891234.597571:0:25091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891234.597616:0:25091:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788891234.597691:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997468160 00000100:00100000:2.0:1788891234.597698:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997468160 00000100:00100000:2.0:1788891234.597752:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788891234.597771:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+24:25091:x1875787997468160:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891234.597886:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+24:25091:x1875787997468160:12345-0@lo:501:mount.lustre.0 Request processed in 116us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891234.597893:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788891234.599413:0:25091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997468160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891234.599463:0:25091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997468288:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891234.599536:0:25091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891234.599572:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997468288 00000100:00100000:0.0:1788891234.599577:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997468288 00000100:00100000:0.0:1788891234.599614:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788891234.599622:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+24:25091:x1875787997468288:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891234.599715:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+24:25091:x1875787997468288:12345-0@lo:503:mount.lustre.0 Request processed in 93us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891234.599722:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788891234.599786:0:25091:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788891234.599799:0:25091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997468288:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788891234.600220:0:25091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788891234.600293:0:25091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997468416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891234.600331:0:25091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891234.602855:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997468416 00000100:00100000:1.0:1788891234.602868:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997468416 00000100:00100000:0.0:1788891234.602887:0:25091:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788891234.602998:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788891234.603011:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+24:25091:x1875787997468416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891234.603168:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+24:25091:x1875787997468416:12345-0@lo:502:mount.lustre.0 Request processed in 160us (2836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891234.603177:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788891234.604061:0:25091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997468416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788891234.604276:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788891234.604308:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788891234.604324:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788891234.604338:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788891234.604352:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788891234.604366:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788891234.604388:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788891234.604402:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788891234.604432:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788891234.604448:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788891234.604462:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788891234.604476:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788891234.604488:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788891234.604500:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788891234.604511:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788891234.606039:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788891234.606079:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788891234.606095:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788891234.606108:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788891234.606121:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788891234.606135:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788891234.606148:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788891234.606160:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788891234.606175:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788891234.606207:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788891234.606224:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788891234.606238:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788891234.606252:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788891234.606267:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788891234.606281:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788891234.606293:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788891234.606305:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788891234.606321:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788891234.606335:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788891234.606350:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788891234.606363:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788891234.606377:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788891234.606388:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788891234.606398:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788891234.606421:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788891234.606449:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788891234.606466:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788891234.606481:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788891234.606495:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788891234.606508:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788891234.607655:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788891234.607708:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788891234.607725:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788891234.607801:0:25091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997468544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891234.607883:0:25091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891234.608846:0:25091:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788891234.613083:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997468544 00000100:00100000:2.0:1788891234.613098:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997468544 00000100:00100000:2.0:1788891234.613157:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788891234.613169:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+24:25091:x1875787997468544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891234.613354:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+24:25091:x1875787997468544:12345-0@lo:502:mount.lustre.0 Request processed in 187us (5470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891234.613362:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788891234.613605:0:25091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997468544:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788891234.613881:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788891234.613909:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788891234.615282:0:25091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4887480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997468672:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891234.615352:0:25091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891234.615705:0:25091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250878bda80 going to sleep for 11 seconds 00000100:00100000:0.0:1788891234.615749:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997468672 00000100:00100000:0.0:1788891234.615768:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997468672 00000100:00100000:0.0:1788891234.615853:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788891234.615862:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+24:25091:x1875787997468672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891234.615980:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+24:25091:x1875787997468672:12345-0@lo:502:mount.lustre.0 Request processed in 118us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891234.615987:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788891234.616136:0:25091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4887480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997468672:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788891234.616202:0:25091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788891234.616216:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788891234.622702:0:25104:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788891234.622731:0:25104:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff924f83263370) 00000020:00000080:1.0:1788891234.622768:0:25104:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788891234.622869:0:25104:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9250841ad000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788891234.622874:0:25104:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9250841ad000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788891234.622877:0:25104:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9250841ad000 3 00010000:00080000:1.0:1788891234.622909:0:25104:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f83380800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1788891234.626746:0:25104:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788891234.627081:0:25104:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788891234.627198:0:25104:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788891234.627211:0:25104:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa66601b03fd54e37 00000100:00080000:1.0:1788891234.627223:0:25104:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788891234.627230:0:25104:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff924f83380800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891234.627268:0:25104:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83a66300 x1875787997468800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788891234.627298:0:25104:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788891234.627358:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891234.627362:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788891234.627364:0:467:0:(import.c:65:import_set_state_nolock()) ffff9250900ed800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788891234.627369:0:467:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 452 00000100:00080000:1.0:1788891234.627374:0:467:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788891234.627379:0:467:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9250900ed800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891234.627392:0:467:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83a65180 x1875787997469184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788891234.627550:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891234.627555:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788891234.627557:0:467:0:(import.c:65:import_set_state_nolock()) ffff925083ec8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788891234.627561:0:467:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 452 00000100:00080000:1.0:1788891234.627564:0:467:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788891234.627568:0:467:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff925083ec8800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891234.627580:0:467:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f83a67b80 x1875787997469696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788891234.627624:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997468928:0@lo:400:kworker.0 00000100:00100000:1.0:1788891234.627695:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891234.627730:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997469568:0@lo:400:kworker.0 00000100:00100000:1.0:1788891234.627766:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891234.627789:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788891234.627795:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997469056:0@lo:400:kworker.0 00000100:00100000:1.0:1788891234.627817:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891234.627833:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997469824:0@lo:400:kworker.0 00000100:00100000:1.0:1788891234.627855:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891234.627884:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997469312:0@lo:400:kworker.0 00000100:00100000:1.0:1788891234.627910:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891234.627927:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997469952:0@lo:400:kworker.0 00000100:00100000:1.0:1788891234.627951:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891234.627969:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788891234.627974:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997469440:0@lo:400:kworker.0 00000100:00100000:1.0:1788891234.628075:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891234.628098:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997470080:0@lo:400:kworker.0 00000100:00100000:1.0:1788891234.628196:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891234.628245:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997468928 00000100:00100000:1.0:1788891234.628252:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997468928 00000100:00100000:1.0:1788891234.628284:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997469440 00000100:00100000:1.0:1788891234.628287:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997469440 00000100:00100000:1.0:1788891234.628303:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788891234.628310:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997468928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891234.628363:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997468928:12345-0@lo:400:kworker.0 Request processed in 53us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891234.628371:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788891234.628386:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788891234.628392:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997469440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891234.628501:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997469440:12345-0@lo:400:kworker.0 Request processed in 108us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891234.628508:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788891234.628544:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997469824 00000100:00100000:1.0:1788891234.628548:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997469824 00000100:00100000:1.0:1788891234.628565:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997469312 00000100:00100000:1.0:1788891234.628567:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997469312 00000100:00100000:1.0:1788891234.628575:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997469952 00000100:00100000:1.0:1788891234.628577:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997469952 00000100:00100000:1.0:1788891234.628609:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997470080 00000100:00100000:1.0:1788891234.628613:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997470080 00000100:00100000:1.0:1788891234.628629:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788891234.628635:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997469824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891234.628668:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1875787997469824:12345-0@lo:400:kworker.0 Request processed in 32us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891234.628680:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788891234.628693:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788891234.628699:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997469312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891234.628729:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997469312:12345-0@lo:400:kworker.0 Request processed in 30us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891234.628735:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788891234.628746:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788891234.628763:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f833d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997469952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891234.628791:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f833d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997469952:12345-0@lo:400:kworker.0 Request processed in 39us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891234.628796:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788891234.628809:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788891234.628814:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997470080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891234.628839:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997470080:12345-0@lo:400:kworker.0 Request processed in 25us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891234.628844:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788891234.628849:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1875787997468800:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788891234.628874:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788891234.628878:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788891234.628882:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891234.628903:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997469440:0@lo:400:kworker.0 00000100:00100000:0.0:1788891234.628907:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997469184:0@lo:8:kworker.0 00010000:00080000:1.0:1788891234.628914:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83a64700 x1875787997470080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891234.628924:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997470080:0@lo:400:kworker.0 00010000:00080000:1.0:1788891234.628933:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83a65f80 x1875787997469312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891234.628952:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997469312:0@lo:400:kworker.0 00000100:00100000:0.0:1788891234.628954:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788891234.628964:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83a64380 x1875787997469952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891234.628972:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997469952:0@lo:400:kworker.0 00000100:00100000:0.0:1788891234.628972:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997469696:0@lo:8:kworker.0 00000100:00100000:0.0:1788891234.628993:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891234.629020:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997469568 00000100:00100000:0.0:1788891234.629024:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997469568 00000100:00100000:0.0:1788891234.629051:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997469056 00000100:00100000:0.0:1788891234.629059:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997469056 00010000:00080000:1.0:1788891234.629076:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83a67100 x1875787997469824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891234.629076:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997469184 00000100:00100000:0.0:1788891234.629079:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997469184 00000100:00100000:0.0:1788891234.629086:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997469696 00000100:00100000:1.0:1788891234.629087:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3627:1875787997469824:0@lo:400:kworker.0 00000100:00100000:0.0:1788891234.629087:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997469696 00000100:00100000:0.0:1788891234.629096:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788891234.629101:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997468928:0@lo:400:kworker.0 00000100:00100000:0.0:1788891234.629101:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997469568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891234.629200:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997469568:12345-0@lo:400:kworker.0 Request processed in 98us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891234.629207:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788891234.629219:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788891234.629225:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997469056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891234.629252:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997469056:12345-0@lo:400:kworker.0 Request processed in 28us (1435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891234.629257:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788891234.629268:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788891234.629272:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1875787997469184:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788891234.629329:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1875787997469184:12345-0@lo:8:kworker.0 Request processed in 55us (373us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788891234.629335:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788891234.629346:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000020:01000004:1.0:1788891234.629349:0:25104:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00100000:0.0:1788891234.629349:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1875787997469696:12345-0@lo:8:kworker.0 00000020:00000080:1.0:1788891234.629365:0:25104:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff924f83260000) 00000100:00100000:0.0:1788891234.629376:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1875787997469696:12345-0@lo:8:kworker.0 Request processed in 25us (382us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788891234.629381:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000020:00000080:1.0:1788891234.629383:0:25104:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:0.0:1788891234.629407:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788891234.629413:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250900ed800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788891234.629417:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788891234.629426:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997469184:0@lo:8:kworker.0 00000100:00100000:0.0:1788891234.629437:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788891234.629440:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925083ec8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788891234.629443:0:3626:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788891234.629446:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997469696:0@lo:8:kworker.0 00000100:00080000:0.0:1788891234.629465:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891234.629472:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997468800 00000100:00100000:0.0:1788891234.629476:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997468800 00000100:00100000:0.0:1788891234.629494:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788891234.629497:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3626:x1875787997468800:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788891234.629513:0:24370:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 456 last 0 00000020:01000004:1.0:1788891234.629546:0:25104:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9250841ad000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788891234.629550:0:25104:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9250841ad000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788891234.629553:0:25104:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9250841ad000 3 00000020:00000080:0.0:1788891234.629568:0:24370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa66601b03fd54e45 00000004:00100000:0.0:1788891234.629583:0:24370:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:1.0:1788891234.629586:0:25104:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924f83387000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.126@tcp at head 00000100:00080000:0.0:1788891234.629609:0:24370:0:(import.c:65:import_set_state_nolock()) ffff9250bcffe000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788891234.629646:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875787997468800:12345-0@lo:38:llog_process_th.0 Request processed in 147us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891234.629653:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788891234.629679:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f83a66300 x1875787997468800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788891244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891234.629688:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788891234.629693:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1788891234.629700:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788891234.629704:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788891234.629706:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f83380800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788891234.629711:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3626:1875787997468800:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788891234.629744:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997469056:0@lo:400:kworker.0 00000100:00100000:0.0:1788891234.629767:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997469568:0@lo:400:kworker.0 00010000:00010000:1.0:1788891234.631623:0:25104:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788891234.631886:0:25104:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788891234.631929:0:25104:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788891234.631942:0:25104:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xa66601b03fd54e4c 00000100:00080000:1.0:1788891234.631952:0:25104:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788891234.631958:0:25104:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff924f83387000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891234.631990:0:25104:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f84293100 x1875787997470208/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788891234.632036:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3626:1875787997470208:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788891234.632103:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891234.632177:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997470208 00000100:00100000:1.0:1788891234.632183:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997470208 00000100:00100000:1.0:1788891234.632211:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788891234.632218:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3626:x1875787997470208:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788891234.632241:0:22774:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:1.0:1788891234.632269:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xa66601b03fd54e53 00000004:00100000:1.0:1788891234.632282:0:22774:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788891234.632309:0:22774:0:(import.c:65:import_set_state_nolock()) ffff924f83381000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788891234.632357:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875787997470208:12345-0@lo:38:llog_process_th.0 Request processed in 137us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891234.632364:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788891234.632400:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff924f84293100 x1875787997470208/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788891244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891234.632422:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788891234.632429:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788891234.632436:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788891234.632439:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788891234.632442:0:3626:0:(import.c:65:import_set_state_nolock()) ffff924f83387000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788891234.632447:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3626:1875787997470208:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788891234.632465:0:25104:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1788891234.634772:0:25104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1788891234.635086:0:25091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788891234.635186:0:25091:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788891234.635205:0:25091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5a00/0xa66601b03fd54e22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54e29 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891234.635217:0:25091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae5a00/0xa66601b03fd54e22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54e29 expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788891234.635265:0:25091:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788891234.635267:0:25091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788891234.635269:0:25091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788891234.635270:0:25091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788891234.635271:0:25091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788891234.635272:0:25091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788891234.635274:0:25091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788891234.635276:0:25091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788891234.635277:0:25091:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788891234.635281:0:25091:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788891234.635284:0:25091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788891234.635285:0:25091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788891234.635286:0:25091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788891234.635287:0:25091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788891234.635288:0:25091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788891234.635289:0:25091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788891234.635294:0:25091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788891234.635295:0:25091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788891234.635296:0:25091:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788891234.635318:0:25091:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788891234.635468:0:25091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4887480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997470336:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788891234.635553:0:25091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891234.635591:0:25091:0:(client.c:2715:ptlrpc_set_wait()) set ffff925095c98a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788891234.636809:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997470336 00000100:00100000:3.0:1788891234.636819:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997470336 00000100:00100000:3.0:1788891234.636862:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788891234.636871:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+24:25091:x1875787997470336:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788891234.636898:0:22765:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788891234.636914:0:22765:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788891234.638210:0:22765:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788891234.638223:0:22765:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788891234.638398:0:22788:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788891234.638403:0:22788:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788891234.638493:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9250b69c7800/0xa66601b03fd54e5a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891234.638514:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+24:25091:x1875787997470336:12345-0@lo:253:mount.lustre.0 Request processed in 1641us (2958us total) trans 0 rc 0/0 00010000:00010000:1.0:1788891234.638590:0:22788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925081523200/0xa66601b03fd54cf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54cee expref: 24 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891234.638599:0:22788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250baae5000/0xa66601b03fd54d03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54cfc expref: 24 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891234.638606:0:22788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9250b69c7800/0xa66601b03fd54e5a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891234.638638:0:22788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250baae5000/0xa66601b03fd54d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd54cfc expref: 24 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891234.638649:0:22788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250baae5000/0xa66601b03fd54d03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd54cfc expref: 24 pid: 22767 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891234.638661:0:22788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84293100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875787997470464:0@lo:104: 00000100:00100000:1.0:1788891234.638697:0:22788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788891234.638788:0:22788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925081523200/0xa66601b03fd54cf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd54cee expref: 24 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891234.638796:0:22788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff925081523200/0xa66601b03fd54cf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd54cee expref: 24 pid: 22765 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891234.638804:0:22788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84290a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875787997470592:0@lo:104: 00000100:00100000:1.0:1788891234.638825:0:22788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891234.638877:0:22788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250985406c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891234.638908:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997470464 00000100:00100000:2.0:1788891234.638913:0:25091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4887480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad5d36d9-7941-4f84-88d2-361333de6068:25091:1875787997470336:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788891234.638914:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997470464 00000100:00100000:0.0:1788891234.638948:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997470592 00000100:00100000:0.0:1788891234.638951:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997470592 00000100:00100000:0.0:1788891234.638964:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788891234.638972:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84293b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad5d36d9-7941-4f84-88d2-361333de6068+4:22788:x1875787997470464:12345-0@lo:104: 00010000:00010000:0.0:1788891234.638983:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54cfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54d03 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891234.639047:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 10000000:01000000:2.0:1788891234.639099:0:25091:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788891234.639103:0:25091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788891234.639105:0:25091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788891234.639106:0:25091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788891234.639108:0:25091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788891234.639109:0:25091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788891234.639110:0:25091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788891234.639112:0:25091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788891234.639114:0:25091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788891234.639115:0:25091:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788891234.639131:0:25091:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788891234.639145:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788891234.639151:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84293b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad5d36d9-7941-4f84-88d2-361333de6068+4:22788:x1875787997470464:12345-0@lo:104: Request processed in 181us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891234.639158:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788891234.639171:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788891234.639176:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84291880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad5d36d9-7941-4f84-88d2-361333de6068+3:22788:x1875787997470592:12345-0@lo:104: 00010000:00010000:0.0:1788891234.639183:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54cee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54cf5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.639214:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788891234.639219:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84291880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad5d36d9-7941-4f84-88d2-361333de6068+3:22788:x1875787997470592:12345-0@lo:104: Request processed in 43us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891234.639224:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788891234.639241:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788891234.639247:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54cfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54d03 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.639264:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6000 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:0.0:1788891234.639267:0:22762:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54cfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd54d03 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.639275:0:22762:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54cfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd54d03 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788891234.639281:0:22762:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54cfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd54d03 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891234.639286:0:22762:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788891234.639313:0:22762:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54cfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54d03 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.639320:0:22762:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788891234.639339:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54cfc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54d03 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.639346:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250b69c6000/0xa66601b03fd54cfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54d03 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.639356:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891234.639359:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54cee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54cf5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.639364:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b200 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:0.0:1788891234.639367:0:22762:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54cee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd54cf5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.639383:0:22762:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54cee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd54cf5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788891234.639389:0:22762:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54cee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd54cf5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891234.639395:0:22762:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788891234.639422:0:22762:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54cee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54cf5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.639428:0:22762:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788891234.639435:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54cee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54cf5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.639441:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8b200/0xa66601b03fd54cee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54cf5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.639453:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891234.639455:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891234.639457:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891234.639475:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad5d36d9-7941-4f84-88d2-361333de6068:3627:1875787997470720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788891234.639503:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891234.639545:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788891234.639552:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad5d36d9-7941-4f84-88d2-361333de6068:3627:1875787997470848:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788891234.639563:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891234.639573:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891234.639609:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997470720 00000100:00100000:0.0:1788891234.639613:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997470848 00000100:00100000:3.0:1788891234.639614:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997470720 00000100:00100000:0.0:1788891234.639616:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997470848 00010000:00010000:3.0:1788891234.639631:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250baae5000/0xa66601b03fd54d03 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54cfc expref: 25 pid: 22767 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.639631:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925081523200/0xa66601b03fd54cf5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54cee expref: 25 pid: 22765 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891234.639653:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788891234.639656:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788891234.639659:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085870700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad5d36d9-7941-4f84-88d2-361333de6068+25:3627:x1875787997470720:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788891234.639662:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085871f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad5d36d9-7941-4f84-88d2-361333de6068+25:3627:x1875787997470848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788891234.639669:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891234.639669:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891234.639674:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250baae5000/0xa66601b03fd54d03 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54cfc expref: 25 pid: 22767 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.639674:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925081523200/0xa66601b03fd54cf5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54cee expref: 25 pid: 22765 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891234.639685:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250baae5000/0xa66601b03fd54d03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd54cfc expref: 25 pid: 22767 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891234.639816:0:22788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84293100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875787997470464:0@lo:104: 00000100:00100000:1.0:1788891234.639825:0:22788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84290a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875787997470592:0@lo:104: 00010000:00010000:0.0:1788891234.639862:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925081523200/0xa66601b03fd54cf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd54cee expref: 25 pid: 22765 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.639875:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925081523200/0xa66601b03fd54cf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd54cee expref: 25 pid: 22765 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891234.639888:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891234.639926:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085871f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad5d36d9-7941-4f84-88d2-361333de6068+24:3627:x1875787997470848:12345-0@lo:103:ldlm_bl.0 Request processed in 264us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891234.639933:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788891234.640007:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad5d36d9-7941-4f84-88d2-361333de6068:3627:1875787997470848:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788891234.640171:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae5000/0xa66601b03fd54d03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd54cfc expref: 23 pid: 22767 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891234.640172:0:22788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9250b69c7800/0xa66601b03fd54e5a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891234.640185:0:22759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9250b69c7800/0xa66601b03fd54e5a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891234.640192:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c7800/0xa66601b03fd54e5a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788891234.640204:0:22759:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009464703s 00010000:00010000:3.0:1788891234.640208:0:22759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250b69c7800/0xa66601b03fd54e5a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891234.640215:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9250b69c7800/0xa66601b03fd54e5a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891234.640221:0:22759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9250b69c7800/0xa66601b03fd54e5a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891234.640226:0:22759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9250b69c7800/0xa66601b03fd54e5a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891234.640231:0:22759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891234.640235:0:22759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9250b69c7800/0xa66601b03fd54e5a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891234.640241:0:22759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9250b69c7800/0xa66601b03fd54e5a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891234.640284:0:22759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9250b69c7800/0xa66601b03fd54e5a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891234.640300:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891234.640335:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085870700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad5d36d9-7941-4f84-88d2-361333de6068+22:3627:x1875787997470720:12345-0@lo:103:ldlm_bl.0 Request processed in 676us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891234.640341:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788891234.640375:0:22788:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9250b69c7800/0xa66601b03fd54e5a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891234.640383:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9250b69c7800/0xa66601b03fd54e5a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891234.640390:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c7800/0xa66601b03fd54e5a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891234.640415:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad5d36d9-7941-4f84-88d2-361333de6068:3627:1875787997470720:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1788891234.641269:0:25091:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788891234.644355:0:25091:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788891234.644364:0:25091:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788891234.644404:0:25091:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788891234.644446:0:25091:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788891234.644467:0:25091:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788891234.644489:0:25091:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788891234.645601:0:25091:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788891234.645841:0:25091:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788891234.875776:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891234.939762:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788891234.941704:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997470976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788891234.941788:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891234.941992:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997470976 00000100:00100000:1.0:1788891234.942001:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997470976 00000100:00100000:1.0:1788891234.942056:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788891234.942066:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997470976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788891234.942100:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446297600 avail 1300058112 00000100:00100000:1.0:1788891234.942155:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997470976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891234.942163:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788891234.942212:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997470976:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1788891235.278595:0:25157:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788891235.279420:0:25157:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788891235.452773:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997471104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788891235.452852:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891235.452979:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997471104 00000100:00100000:2.0:1788891235.452986:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997471104 00000100:00100000:2.0:1788891235.453030:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788891235.453040:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997471104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788891235.453069:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788891235.453125:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997471104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891235.453133:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788891235.453187:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997471104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788891235.453244:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250a4886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997471232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788891235.453274:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891235.453346:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997471232 00000100:00100000:2.0:1788891235.453351:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997471232 00000100:00100000:2.0:1788891235.453386:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788891235.453395:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997471232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788891235.453406:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788891235.453451:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997471232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891235.453460:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788891235.453573:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250a4886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997471232:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788891235.899955:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891235.964745:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997471360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788891235.964833:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891235.965030:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997471360 00000100:00100000:0.0:1788891235.965038:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997471360 00000100:00100000:0.0:1788891235.965101:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788891235.965111:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997471360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788891235.965147:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788891235.965254:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997471360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891235.965281:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788891235.965483:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997471360:0@lo:41:osp-pre-1-0.0 10000000:01000000:0.0:1788891236.029230:0:22770:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788891236.029238:0:22770:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff924f832d8800 from 14 10000000:01000000:0.0:1788891236.029244:0:22770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788891236.029293:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54e61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891236.029304:0:22770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54e61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891236.029316:0:22770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54e61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891236.029343:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085870000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997471488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788891236.029415:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891236.029557:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788891236.029683:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997471488 00000100:00100000:1.0:1788891236.029692:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997471488 00000100:00100000:1.0:1788891236.029800:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788891236.029811:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+22:22770:x1875787997471488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891236.029836:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891236.029852:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c7a00/0xa66601b03fd54e68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54e61 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891236.029891:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c7a00/0xa66601b03fd54e68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54e61 expref: 23 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891236.029902:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c7a00/0xa66601b03fd54e68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54e61 expref: 23 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891236.029911:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7a00, rc 0) 00000100:00100000:1.0:1788891236.029961:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+23:22770:x1875787997471488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891236.029968:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788891236.030041:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085870000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997471488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788891236.030060:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54e61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54e68 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891236.030069:0:22770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54e61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54e68 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891236.030126:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085870000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997471616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788891236.030160:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891236.030208:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997471616 00000100:00100000:0.0:1788891236.030209:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788891236.030212:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997471616 00000100:00100000:3.0:1788891236.030244:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788891236.030251:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+23:22770:x1875787997471616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788891236.030264:0:22765:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788891236.030282:0:22765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788891236.030285:0:22765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1788891236.030376:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+23:22770:x1875787997471616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891236.030384:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788891236.030446:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085870000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997471616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788891236.030500:0:22770:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788891236.030505:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54e61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54e68 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891236.030510:0:22770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae5200/0xa66601b03fd54e61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54e68 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891236.030516:0:22770:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788891236.030517:0:22770:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9250b4f3c000 from 14 10000000:01000000:0.0:1788891236.030518:0:22770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788891236.030561:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54e6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891236.030566:0:22770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54e6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891236.030572:0:22770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54e6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891236.030579:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085870000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997471744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788891236.030596:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891236.030612:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788891236.030646:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997471744 00000100:00100000:1.0:1788891236.030650:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997471744 00000100:00100000:1.0:1788891236.030680:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788891236.030687:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+23:22770:x1875787997471744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891236.030699:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891236.030706:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c6800/0xa66601b03fd54e76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd54e6f expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891236.030721:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c6800/0xa66601b03fd54e76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd54e6f expref: 24 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891236.030744:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c6800/0xa66601b03fd54e76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54e6f expref: 24 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891236.030752:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6800, rc 0) 00000100:00100000:1.0:1788891236.030791:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+24:22770:x1875787997471744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891236.030807:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788891236.030878:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085870000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997471744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788891236.030889:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54e6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54e76 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891236.030896:0:22770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54e6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd54e76 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891236.030941:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085870000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997471872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788891236.030968:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891236.030994:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508540a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788891236.031034:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997471872 00000100:00100000:2.0:1788891236.031040:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997471872 00000100:00100000:2.0:1788891236.031070:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788891236.031084:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+24:22770:x1875787997471872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788891236.031096:0:22767:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788891236.031106:0:22767:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788891236.031109:0:22767:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788891236.031193:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+24:22770:x1875787997471872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891236.031199:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788891236.031276:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085870000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997471872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788891236.031312:0:22770:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788891236.031317:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54e6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54e76 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891236.031324:0:22770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae4e00/0xa66601b03fd54e6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd54e76 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788891236.861150:0:23529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788891236.925056:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788891237.182177:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788891237.952292:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788891238.751641:0:25446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788891238.971710:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788891239.493040:0:25498:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788891239.493356:0:25498:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788891239.995737:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891240.059841:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788891240.059868:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997472000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788891240.060106:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891240.060197:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997472000 00000100:00100000:0.0:1788891240.060205:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997472000 00000100:00100000:0.0:1788891240.060471:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788891240.060483:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997472000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788891240.060516:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446297600 avail 1300058112 00000100:00100000:0.0:1788891240.060591:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997472000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (485us total) trans 0 rc 0/0 00000100:00080000:1.0:1788891240.060971:0:21261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891240.060976:0:21261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788891240.060980:0:21261:0:(import.c:65:import_set_state_nolock()) ffff9250900ed800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788891240.060988:0:21261:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9250900ed800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891240.061008:0:21261:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f84290380 x1875787997472512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788891240.061046:0:21261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788891240.061049:0:21261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788891240.061051:0:21261:0:(import.c:65:import_set_state_nolock()) ffff925083ec8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788891240.061056:0:21261:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff925083ec8800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1788891240.061065:0:21261:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924f84292300 x1875787997472896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788891240.061109:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997472384:0@lo:400:kworker.0 00000100:00100000:1.0:1788891240.061141:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891240.061169:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997473152:0@lo:400:kworker.0 00000100:00100000:1.0:1788891240.061191:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891240.061209:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788891240.061214:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997472256:0@lo:400:kworker.0 00000100:00100000:1.0:1788891240.061231:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891240.061245:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875787997473024:0@lo:400:kworker.0 00000100:00100000:1.0:1788891240.061260:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891240.061283:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1875787997473536:0@lo:400:kworker.0 00000100:00100000:1.0:1788891240.061300:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891240.061336:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997472512:0@lo:8:kworker.0 00000100:00100000:1.0:1788891240.061357:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891240.061371:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997472896:0@lo:8:kworker.0 00000100:00100000:1.0:1788891240.061386:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891240.061409:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997472384 00000100:00100000:1.0:1788891240.061413:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997472384 00000100:00100000:1.0:1788891240.061445:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997472512 00000100:00100000:1.0:1788891240.061448:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997472512 00000100:00100000:1.0:1788891240.061457:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997472896 00000100:00100000:1.0:1788891240.061459:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997472896 00000100:00100000:1.0:1788891240.061468:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788891240.061474:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997472384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891240.061507:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997472384:12345-0@lo:400:kworker.0 Request processed in 33us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891240.061513:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788891240.061547:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788891240.061551:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1875787997472512:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788891240.061573:0:24276:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:1.0:1788891240.061597:0:24276:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa66601b03fd54e7d 00002000:00100000:1.0:1788891240.061609:0:24276:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff924f83387800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788891240.061613:0:24276:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788891240.061615:0:24276:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788891240.061793:0:24276:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788891240.061815:0:24276:0:(import.c:65:import_set_state_nolock()) ffff924f83384000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788891240.061852:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3626:x1875787997472512:12345-0@lo:8:kworker.0 Request processed in 299us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891240.061864:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788891240.061877:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788891240.061881:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3626:x1875787997472896:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788891240.061901:0:24276:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:1.0:1788891240.061916:0:24276:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa66601b03fd54e84 00002000:00100000:1.0:1788891240.061923:0:24276:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff924f83386000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788891240.061926:0:24276:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788891240.061928:0:24276:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788891240.061941:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997472640:0@lo:400:kworker.0 00002000:00080000:1.0:1788891240.061952:0:24276:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788891240.061968:0:24276:0:(import.c:65:import_set_state_nolock()) ffff924f83383800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788891240.061981:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891240.062012:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3626:x1875787997472896:12345-0@lo:8:kworker.0 Request processed in 127us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891240.062013:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997473280:0@lo:400:kworker.0 00000100:00100000:1.0:1788891240.062026:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788891240.062046:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997473152 00000100:00100000:2.0:1788891240.062050:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891240.062052:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997473152 00000100:00100000:2.0:1788891240.062072:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788891240.062077:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997473024 00000100:00100000:1.0:1788891240.062080:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997473024 00000100:00100000:2.0:1788891240.062082:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad5d36d9-7941-4f84-88d2-361333de6068:3629:1875787997472128:0@lo:400:kworker.0 00000100:00100000:1.0:1788891240.062091:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997473536 00000100:00100000:1.0:1788891240.062094:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997473536 00000100:00100000:1.0:1788891240.062109:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997472640 00000100:00100000:1.0:1788891240.062112:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997472640 00000100:00100000:2.0:1788891240.062118:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891240.062124:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997473280 00000100:00100000:1.0:1788891240.062127:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997473280 00000100:00100000:1.0:1788891240.062146:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788891240.062153:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875787997473152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891240.062156:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997472768:0@lo:400:kworker.0 00000100:00100000:2.0:1788891240.062205:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891240.062210:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1875787997473152:12345-0@lo:400:kworker.0 Request processed in 56us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891240.062226:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997473408:0@lo:400:kworker.0 00000100:00100000:1.0:1788891240.062231:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788891240.062247:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788891240.062254:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875787997473024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891240.062261:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891240.062286:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997472768 00000100:00100000:2.0:1788891240.062290:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997472768 00000100:00100000:1.0:1788891240.062293:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875787997473024:12345-0@lo:400:kworker.0 Request processed in 39us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891240.062302:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788891240.062315:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997473408 00000100:00100000:1.0:1788891240.062318:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997473408 00000100:00100000:2.0:1788891240.062323:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788891240.062333:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997472768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891240.062340:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788891240.062349:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875787997473536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891240.062381:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997472768:12345-0@lo:400:kworker.0 Request processed in 50us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891240.062387:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875787997473536:12345-0@lo:400:kworker.0 Request processed in 38us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891240.062393:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788891240.062401:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788891240.062410:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997472640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891240.062415:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788891240.062436:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997472640:12345-0@lo:400:kworker.0 Request processed in 27us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891240.062444:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788891240.062450:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788891240.062458:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788891240.062463:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997473280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891240.062469:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250a4886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997473408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891240.062502:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997473408:12345-0@lo:400:kworker.0 Request processed in 38us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891240.062508:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788891240.062540:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250a4885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997473280:12345-0@lo:400:kworker.0 Request processed in 63us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891240.062549:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788891240.062559:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788891240.062564:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788891240.062573:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788891240.062578:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997472128 00000100:00100000:2.0:1788891240.062583:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997472128 00010000:00080000:1.0:1788891240.062603:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84290380 x1875787997472512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788891265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891240.062615:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1788891240.062619:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00100000:2.0:1788891240.062625:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+24:3629:x1875787997472128:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788891240.062627:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788891240.062634:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788891240.062637:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9250900ed800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788891240.062664:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788891240.062670:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3626:1875787997472512:0@lo:8:kworker.0 00000100:00100000:2.0:1788891240.062680:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+24:3629:x1875787997472128:12345-0@lo:400:kworker.0 Request processed in 57us (562us total) trans 0 rc 0/0 00010000:00080000:1.0:1788891240.062687:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84292300 x1875787997472896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788891265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891240.062692:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1788891240.062703:0:3626:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788891240.062709:0:3626:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788891240.062712:0:3626:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788891240.062714:0:3626:0:(import.c:65:import_set_state_nolock()) ffff925083ec8800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788891240.062726:0:3626:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788891240.062729:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3626:1875787997472896:0@lo:8:kworker.0 00000004:00080000:2.0:1788891240.062750:0:22799:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000004:00080000:1.0:1788891240.062768:0:23515:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788891240.062773:0:22799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22799:1875787997473920:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788891240.062789:0:23515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a66d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23515:1875787997474048:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788891240.062808:0:22799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891240.062826:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997473664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788891240.062834:0:22799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250989a09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891240.062855:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891240.062859:0:23515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891240.062884:0:23515:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8221c9c0 going to sleep for 11 seconds 00010000:00080000:1.0:1788891240.062893:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84292680 x1875787997473024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891240.062900:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997473664 00000100:00100000:2.0:1788891240.062905:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997473664 00000100:00100000:1.0:1788891240.062905:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875787997473024:0@lo:400:kworker.0 00010000:00080000:1.0:1788891240.062921:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83a64a80 x1875787997473536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891240.062939:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1875787997473536:0@lo:400:kworker.0 00000100:00100000:2.0:1788891240.062947:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788891240.062957:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997472384:0@lo:400:kworker.0 00000100:00100000:2.0:1788891240.062958:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1875787997473664:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788891240.062975:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84291500 x1875787997473152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:2.0:1788891240.062982:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788891240.062986:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3628:1875787997473152:0@lo:400:kworker.0 00000100:00100000:2.0:1788891240.063031:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1875787997473664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891240.063049:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:1.0:1788891240.063052:0:22798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 4 count 2 00000100:00100000:2.0:1788891240.063074:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997473920 00000100:00100000:2.0:1788891240.063078:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997473920 00000040:00080000:1.0:1788891240.063086:0:22798:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788891240.063091:0:22798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1788891240.063101:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997474048 00000100:00100000:2.0:1788891240.063106:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997474048 00000004:00080000:1.0:1788891240.063113:0:22798:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788891240.063124:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788891240.063132:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22799:x1875787997473920:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788891240.063171:0:22798:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 462307647214ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788891240.063178:0:22798:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788891240.063340:0:24371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788891240.063353:0:24371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23515:x1875787997474048:12345-0@lo:7:osp-pre-1-1.0 00010000:00080000:1.0:1788891240.063353:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f8318ea00 x1875787997473664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891240.063374:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997473664:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788891240.063392:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788891240.063435:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997473792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788891240.063466:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891240.063493:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad5d36d9-7941-4f84-88d2-361333de6068:3629:1875787997472128:0@lo:400:kworker.0 00000100:00100000:2.0:1788891240.063505:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997472768:0@lo:400:kworker.0 00010000:00080000:2.0:1788891240.063516:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83a66680 x1875787997473408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891240.063547:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997473408:0@lo:400:kworker.0 00010000:00080000:2.0:1788891240.063559:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84293800 x1875787997472640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891240.063568:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997472640:0@lo:400:kworker.0 00010000:00080000:2.0:1788891240.063579:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f84293480 x1875787997473280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891240.063587:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997473280:0@lo:400:kworker.0 00000100:00100000:2.0:1788891240.063612:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788891240.063618:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997474176:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788891240.063670:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891240.063697:0:24275:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788891240.063703:0:24275:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1788891240.063724:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997473792 00000100:00100000:2.0:1788891240.063728:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997473792 00000100:00100000:2.0:1788891240.063751:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788891240.063883:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3629:x1875787997473792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788891240.063895:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788891240.063932:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3629:x1875787997473792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891240.063938:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788891240.063974:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83a64700 x1875787997473792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891240.063987:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997473792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788891240.064007:0:24276:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788891240.064014:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997474176 00000100:00100000:2.0:1788891240.064018:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997474176 00000100:00100000:3.0:1788891240.064034:0:22777:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788891240.064043:0:22777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788891240.064089:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997472000:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788891240.064141:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:0.0:1788891240.064808:0:23514:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788891240.064894:0:23514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 462309370588ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788891240.064901:0:23514:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788891240.065033:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997472256 00000100:00100000:0.0:1788891240.065038:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997472256 00000100:00100000:0.0:1788891240.065061:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788891240.065068:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997472256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891240.065130:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997472256:12345-0@lo:400:kworker.0 Request processed in 61us (3896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891240.065137:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788891240.065170:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997472256:0@lo:400:kworker.0 00002000:00080000:2.0:1788891240.066873:0:24371:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788891240.066881:0:24371:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788891240.066955:0:24371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23515:x1875787997474048:12345-0@lo:7:osp-pre-1-1.0 Request processed in 3604us (4098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891240.066966:0:24371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788891240.066996:0:24371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788891240.067007:0:24371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3629:x1875787997474176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788891240.067109:0:24371:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:34 count 1 00000100:00100000:2.0:1788891240.067730:0:24371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3629:x1875787997474176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 723us (4057us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788891240.067738:0:24371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788891240.067808:0:23515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f83a66d80 x1875787997474048/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788891256 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891240.067883:0:23515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a66d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23515:1875787997474048:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788891240.067898:0:23515:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788891240.067939:0:23515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8318ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23515:1875787997474304:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788891240.067980:0:23515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891240.068006:0:23515:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f830ffcc0 going to sleep for 11 seconds 00000004:00080000:2.0:1788891240.068108:0:3629:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff924f84291500, transno 0 00000004:00080000:2.0:1788891240.068113:0:3629:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff924f84291500/1, rc -2, transno 0 00000100:00100000:2.0:1788891240.068126:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997474176:0@lo:6:osp-syn-1-0.0 00000040:00080000:2.0:1788891240.068427:0:22798:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 2, last_idx 3 00000040:00080000:2.0:1788891240.068448:0:22798:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1788891240.068665:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997474304 00000100:00100000:2.0:1788891240.068671:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997474304 00000100:00100000:2.0:1788891240.068704:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788891240.068712:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23515:x1875787997474304:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788891240.068743:0:24276:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1788891240.068793:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23515:x1875787997474304:12345-0@lo:5:osp-pre-1-1.0 Request processed in 82us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891240.068800:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00002000:00080000:2.0:1788891240.068818:0:24274:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788891240.068822:0:24274:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1788891240.068827:0:24274:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00010000:00080000:0.0:1788891240.068926:0:23515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924f8318ea00 x1875787997474304/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788891256 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891240.068939:0:23515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23515:1875787997474304:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788891240.068948:0:23515:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788891240.068978:0:23515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085872680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23515:1875787997474432:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788891240.069008:0:23515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891240.069026:0:23515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250c1126f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788891240.069148:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997474432 00000100:00100000:3.0:1788891240.069153:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997474432 00000100:00100000:3.0:1788891240.069173:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788891240.069180:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23515:x1875787997474432:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788891240.069212:0:24276:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000004:00080000:0.0:1788891240.074000:0:22753:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788891240.075452:0:23504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:2.0:1788891240.083474:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891240.083492:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5fbd725/0xa66601b03fd54e8b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.083508:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788891240.083513:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891240.083519:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5fbd725/0xa66601b03fd54e8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.083573:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5fbd725/0xa66601b03fd54e8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.083584:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5fbd725/0xa66601b03fd54e8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.083592:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5fbd725/0xa66601b03fd54e8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.083811:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891240.083886:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891240.083893:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5fbd725/0xa66601b03fd54e8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.083902:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587b800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891240.083906:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5fbd725/0xa66601b03fd54e8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.083916:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5fbd725/0xa66601b03fd54e8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.083940:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5fbd725/0xa66601b03fd54e8b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.083947:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5fbd725/0xa66601b03fd54e8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.083962:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891240.083964:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891240.083966:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788891240.085112:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891240.085121:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd54e92 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.085134:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788891240.085137:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891240.085143:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd54e92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.085154:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd54e92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.085163:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd54e92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.085171:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd54e92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.085206:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891240.085585:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891240.085593:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd54e92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.085603:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587ae00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891240.085608:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd54e92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.085629:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd54e92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.085658:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd54e92 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.085667:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd54e92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891240.085673:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891240.085680:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc43ef82/0xa66601b03fd54e99 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.085685:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891240.085689:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891240.085692:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891240.085693:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788891240.085698:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891240.085702:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc43ef82/0xa66601b03fd54e99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.085713:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc43ef82/0xa66601b03fd54e99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.085722:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc43ef82/0xa66601b03fd54e99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.085731:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc43ef82/0xa66601b03fd54e99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.085746:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891240.085755:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891240.085759:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc43ef82/0xa66601b03fd54e99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.085767:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587ba00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891240.085776:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc43ef82/0xa66601b03fd54e99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.085785:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc43ef82/0xa66601b03fd54e99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.085797:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc43ef82/0xa66601b03fd54e99 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.085804:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc43ef82/0xa66601b03fd54e99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.085998:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891240.086002:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891240.086004:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788891240.086672:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891240.086681:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b90b48ad/0xa66601b03fd54ea0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.086692:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788891240.086696:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891240.086701:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b90b48ad/0xa66601b03fd54ea0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.086713:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b90b48ad/0xa66601b03fd54ea0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.086722:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b90b48ad/0xa66601b03fd54ea0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.086736:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b90b48ad/0xa66601b03fd54ea0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.086890:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788891240.087175:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891240.087181:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e3ea656/0xa66601b03fd54ea7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.087190:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788891240.087193:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891240.087198:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e3ea656/0xa66601b03fd54ea7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.087208:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e3ea656/0xa66601b03fd54ea7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.087216:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e3ea656/0xa66601b03fd54ea7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.087223:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e3ea656/0xa66601b03fd54ea7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.087364:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788891240.087371:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b90b48ad/0xa66601b03fd54ea0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.087380:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587a200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891240.087385:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b90b48ad/0xa66601b03fd54ea0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.087393:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b90b48ad/0xa66601b03fd54ea0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.087412:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b90b48ad/0xa66601b03fd54ea0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.087419:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b90b48ad/0xa66601b03fd54ea0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.087438:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891240.087442:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e3ea656/0xa66601b03fd54ea7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.087448:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587ac00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891240.087452:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e3ea656/0xa66601b03fd54ea7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.087471:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e3ea656/0xa66601b03fd54ea7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.087482:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e3ea656/0xa66601b03fd54ea7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.087491:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.087493:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.087495:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891240.087890:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891240.087895:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788891240.087903:0:24274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e3ea656/0xa66601b03fd54ea7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891240.088461:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788891240.088469:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d999113c/0xa66601b03fd54eae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.088479:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1788891240.088483:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891240.088488:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d999113c/0xa66601b03fd54eae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.088499:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d999113c/0xa66601b03fd54eae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.088509:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d999113c/0xa66601b03fd54eae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.088517:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d999113c/0xa66601b03fd54eae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.088653:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891240.089300:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891240.089308:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d999113c/0xa66601b03fd54eae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.089319:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587a800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891240.089325:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d999113c/0xa66601b03fd54eae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.089344:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d999113c/0xa66601b03fd54eae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.089361:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d999113c/0xa66601b03fd54eae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.089369:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d999113c/0xa66601b03fd54eae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.089402:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.089404:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.089406:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788891240.097493:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788891240.097506:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f23dfd30/0xa66601b03fd54eb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.097543:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=462s v=(0 0) 00010000:00010000:1.0:1788891240.097548:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891240.097555:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f23dfd30/0xa66601b03fd54eb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.097583:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f23dfd30/0xa66601b03fd54eb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.097593:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f23dfd30/0xa66601b03fd54eb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.097600:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f23dfd30/0xa66601b03fd54eb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.097620:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891240.098125:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891240.098134:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f23dfd30/0xa66601b03fd54eb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.098146:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6e00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891240.098151:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f23dfd30/0xa66601b03fd54eb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.098162:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f23dfd30/0xa66601b03fd54eb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.098181:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f23dfd30/0xa66601b03fd54eb5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.098190:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f23dfd30/0xa66601b03fd54eb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.098209:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.098212:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.098213:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788891240.100127:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788891240.100139:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54ebc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.100154:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=462s v=(0 0) 00010000:00010000:1.0:1788891240.100159:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891240.100166:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54ebc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.100179:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54ebc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.100190:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54ebc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.100209:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54ebc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.100230:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891240.100734:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891240.100742:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54ebc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.100752:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7e00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891240.100756:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54ebc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.100766:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54ebc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.100783:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54ebc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.100796:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54ebc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.100814:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891240.100816:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891240.100818:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788891240.102606:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788891240.102618:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd54ec3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.102632:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=462s v=(0 0) 00010000:00010000:1.0:1788891240.102637:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891240.102644:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd54ec3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.102668:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd54ec3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.102678:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd54ec3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.102686:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd54ec3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.102703:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891240.103126:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891240.103135:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd54ec3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.103158:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6000 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891240.103163:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd54ec3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.103172:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd54ec3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.103190:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd54ec3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.103198:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009332f797/0xa66601b03fd54ec3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.103214:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.103215:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.103217:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788891240.103624:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788891240.103631:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54eca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.103658:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=462s v=(0 0) 00010000:00010000:1.0:1788891240.103662:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891240.103668:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54eca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.103678:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54eca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.103686:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54eca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.103694:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54eca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.103711:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788891240.103999:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788891240.104006:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002030b881/0xa66601b03fd54ed1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.104014:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=462s v=(0 0) 00010000:00010000:1.0:1788891240.104017:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891240.104022:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002030b881/0xa66601b03fd54ed1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.104030:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002030b881/0xa66601b03fd54ed1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.104049:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002030b881/0xa66601b03fd54ed1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.104057:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002030b881/0xa66601b03fd54ed1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.104073:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788891240.104081:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788891240.104085:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54eca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.104093:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891240.104097:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54eca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.104100:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891240.104112:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002030b881/0xa66601b03fd54ed1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.104112:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54eca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.104133:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6c00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891240.104137:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002030b881/0xa66601b03fd54ed1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.104139:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54eca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.104154:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002030b881/0xa66601b03fd54ed1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.104156:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54eca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.104181:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.104183:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002030b881/0xa66601b03fd54ed1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.104191:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.104194:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002030b881/0xa66601b03fd54ed1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.104195:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.104213:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.104216:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.104218:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788891240.105244:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788891240.105254:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9ae30d/0xa66601b03fd54ed8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105266:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=462s v=(0 0) 00010000:00010000:1.0:1788891240.105270:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891240.105276:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a9ae30d/0xa66601b03fd54ed8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105287:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a9ae30d/0xa66601b03fd54ed8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105297:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9ae30d/0xa66601b03fd54ed8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105304:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a9ae30d/0xa66601b03fd54ed8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105327:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788891240.105723:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788891240.105730:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d2f6d61/0xa66601b03fd54edf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105739:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=462s v=(0 0) 00010000:00010000:1.0:1788891240.105742:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891240.105747:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d2f6d61/0xa66601b03fd54edf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105765:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d2f6d61/0xa66601b03fd54edf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105773:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d2f6d61/0xa66601b03fd54edf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105781:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d2f6d61/0xa66601b03fd54edf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105795:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788891240.105805:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788891240.105810:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a9ae30d/0xa66601b03fd54ed8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105829:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891240.105833:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9ae30d/0xa66601b03fd54ed8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105843:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9ae30d/0xa66601b03fd54ed8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105860:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a9ae30d/0xa66601b03fd54ed8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105868:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a9ae30d/0xa66601b03fd54ed8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105891:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891240.105894:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d2f6d61/0xa66601b03fd54edf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105901:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7400 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891240.105905:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d2f6d61/0xa66601b03fd54edf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105913:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d2f6d61/0xa66601b03fd54edf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105925:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d2f6d61/0xa66601b03fd54edf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105932:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d2f6d61/0xa66601b03fd54edf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.105943:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891240.105945:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891240.105947:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788891240.106215:0:25092:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1788891240.106232:0:25092:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788891240.106236:0:25092:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788891240.106260:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891240.106989:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891240.106999:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54ee6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.107086:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1788891240.107092:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891240.107099:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54ee6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.107111:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54ee6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.107121:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54ee6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.107128:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54ee6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.107152:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891240.107320:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891240.107327:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54ee6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.107335:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4a00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891240.107339:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54ee6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.107348:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54ee6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.107363:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54ee6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.107383:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54ee6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.107424:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.107426:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.107427:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891240.107473:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23515:x1875787997474432:12345-0@lo:5:osp-pre-1-1.0 Request processed in 38289us (38460us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788891240.107485:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788891240.107586:0:23515:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788891240.107594:0:23515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085872680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23515:1875787997474432:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788891240.107609:0:23515:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1788891240.107671:0:23515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23515:1875787997474560:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788891240.107709:0:23515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891240.107740:0:23515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250b66c6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788891240.107893:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997474560 00000100:00100000:1.0:1788891240.107900:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997474560 00000100:00100000:1.0:1788891240.107946:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788891240.107964:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23515:x1875787997474560:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788891240.108019:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23515:x1875787997474560:12345-0@lo:900:osp-pre-1-1.0 Request processed in 58us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891240.108026:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788891240.108056:0:23515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bf739880 x1875787997474560/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788891256 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891240.108066:0:23515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23515:1875787997474560:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1788891240.108470:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788891240.108479:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031d466c9/0xa66601b03fd54eed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.108491:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=462s v=(0 0) 00010000:00010000:1.0:1788891240.108494:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891240.108500:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031d466c9/0xa66601b03fd54eed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.108510:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031d466c9/0xa66601b03fd54eed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.108520:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031d466c9/0xa66601b03fd54eed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.108559:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031d466c9/0xa66601b03fd54eed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.108577:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891240.108607:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891240.108621:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031d466c9/0xa66601b03fd54eed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.108631:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6400 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891240.108635:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031d466c9/0xa66601b03fd54eed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.108655:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031d466c9/0xa66601b03fd54eed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.108671:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031d466c9/0xa66601b03fd54eed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.108679:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031d466c9/0xa66601b03fd54eed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.108696:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891240.108698:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891240.108699:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788891240.109539:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788891240.109548:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54ef4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.109560:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=462s v=(0 0) 00010000:00010000:1.0:1788891240.109564:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891240.109569:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54ef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.109579:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54ef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.109587:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54ef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.109595:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54ef4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.109617:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891240.109970:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891240.109977:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54ef4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.109985:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891240.109989:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54ef4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.109997:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54ef4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.110081:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54ef4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.110096:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011f9f147/0xa66601b03fd54ef4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.110113:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.110115:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.110117:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788891240.110605:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788891240.110613:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54efb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.110623:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=462s v=(0 0) 00010000:00010000:1.0:1788891240.110627:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891240.110632:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54efb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.110666:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54efb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.110676:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54efb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.110683:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54efb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.110707:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891240.111783:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891240.111793:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54efb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.111804:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7e00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:0.0:1788891240.111808:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54efb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.111831:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54efb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.111848:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54efb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.111855:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085023083/0xa66601b03fd54efb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.111875:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891240.111877:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891240.111879:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891240.115340:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891240.115356:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54f02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.115374:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1788891240.115379:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891240.115386:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54f02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.115400:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54f02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.115412:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54f02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.115426:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54f02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.115456:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891240.115499:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891240.115510:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54f02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.115520:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4a00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891240.115547:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54f02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.115564:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54f02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.115584:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54f02 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.115594:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9cae02e/0xa66601b03fd54f02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.115614:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891240.115616:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891240.115618:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891240.116662:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891240.116671:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54f09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.116684:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1788891240.116688:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891240.116694:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54f09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.116705:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54f09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.116714:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54f09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.116722:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54f09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:1.0:1788891240.116735:0:25551:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00010000:00010000:0.0:1788891240.116747:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891240.116867:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891240.116873:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54f09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.116882:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5400 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891240.116886:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54f09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.116894:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54f09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.116910:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54f09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.116917:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d47e3a63/0xa66601b03fd54f09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.116931:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.116933:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.116935:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788891240.117239:0:25551:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00002000:00010000:0.0:1788891240.118579:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891240.118590:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd54f10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.118613:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1788891240.118617:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891240.118624:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd54f10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.118637:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd54f10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.118657:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd54f10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.118664:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd54f10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.118689:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891240.118812:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891240.118824:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd54f10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.118833:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5000 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891240.118838:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd54f10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.118847:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd54f10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.118862:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd54f10 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.118869:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f03b75b4/0xa66601b03fd54f10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.118885:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.118887:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.118889:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891240.119324:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891240.119331:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce39ebd5/0xa66601b03fd54f17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.119340:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1788891240.119344:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891240.119349:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce39ebd5/0xa66601b03fd54f17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.119359:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce39ebd5/0xa66601b03fd54f17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.119378:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce39ebd5/0xa66601b03fd54f17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.119385:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce39ebd5/0xa66601b03fd54f17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.119447:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788891240.120475:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891240.120484:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007609f5ca/0xa66601b03fd54f1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.120495:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1788891240.120499:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891240.120504:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007609f5ca/0xa66601b03fd54f1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.120514:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007609f5ca/0xa66601b03fd54f1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.120541:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007609f5ca/0xa66601b03fd54f1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.120550:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007609f5ca/0xa66601b03fd54f1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.120629:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788891240.120636:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce39ebd5/0xa66601b03fd54f17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.120653:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a8800 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891240.120658:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce39ebd5/0xa66601b03fd54f17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.120678:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce39ebd5/0xa66601b03fd54f17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.120695:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce39ebd5/0xa66601b03fd54f17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.120702:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce39ebd5/0xa66601b03fd54f17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.120718:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891240.120721:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007609f5ca/0xa66601b03fd54f1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.120727:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a8a00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891240.120729:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007609f5ca/0xa66601b03fd54f1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.120736:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007609f5ca/0xa66601b03fd54f1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.120746:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007609f5ca/0xa66601b03fd54f1e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.120753:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.120755:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.120761:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891240.121199:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788891240.121206:0:24274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007609f5ca/0xa66601b03fd54f1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.121419:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891240.121623:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891240.121630:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ed161d/0xa66601b03fd54f25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.121640:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1788891240.121654:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891240.121660:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028ed161d/0xa66601b03fd54f25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.121670:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028ed161d/0xa66601b03fd54f25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.121679:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ed161d/0xa66601b03fd54f25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.121686:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028ed161d/0xa66601b03fd54f25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.121707:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891240.121771:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891240.121777:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028ed161d/0xa66601b03fd54f25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.121787:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a8000 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891240.121791:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ed161d/0xa66601b03fd54f25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.121800:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ed161d/0xa66601b03fd54f25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.121814:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028ed161d/0xa66601b03fd54f25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.121820:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028ed161d/0xa66601b03fd54f25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.121833:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.121835:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.121836:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891240.121963:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891240.121970:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3052b65/0xa66601b03fd54f2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.121983:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1788891240.121986:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891240.121990:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3052b65/0xa66601b03fd54f2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.121999:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3052b65/0xa66601b03fd54f2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.122007:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3052b65/0xa66601b03fd54f2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.122014:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3052b65/0xa66601b03fd54f2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.122037:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788891240.122296:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891240.122303:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000194d7b11/0xa66601b03fd54f33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.122311:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1788891240.122315:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891240.122319:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000194d7b11/0xa66601b03fd54f33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.122329:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000194d7b11/0xa66601b03fd54f33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.122418:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000194d7b11/0xa66601b03fd54f33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.122426:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000194d7b11/0xa66601b03fd54f33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.122440:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788891240.122675:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788891240.122681:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3052b65/0xa66601b03fd54f2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.122689:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a9c00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891240.122692:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3052b65/0xa66601b03fd54f2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.122707:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3052b65/0xa66601b03fd54f2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.122719:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3052b65/0xa66601b03fd54f2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.122727:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3052b65/0xa66601b03fd54f2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.122742:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891240.122745:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000194d7b11/0xa66601b03fd54f33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.122751:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a9000 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891240.122754:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000194d7b11/0xa66601b03fd54f33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.122762:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000194d7b11/0xa66601b03fd54f33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.122770:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000194d7b11/0xa66601b03fd54f33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.122777:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000194d7b11/0xa66601b03fd54f33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.122798:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.122800:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.122802:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.122809:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891240.122933:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891240.122939:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a22dc09f/0xa66601b03fd54f3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.122948:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1788891240.122951:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891240.122955:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a22dc09f/0xa66601b03fd54f3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.122964:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a22dc09f/0xa66601b03fd54f3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.122972:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a22dc09f/0xa66601b03fd54f3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.122978:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a22dc09f/0xa66601b03fd54f3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.123000:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891240.123208:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891240.123213:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a22dc09f/0xa66601b03fd54f3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.123221:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a8600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891240.123224:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a22dc09f/0xa66601b03fd54f3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.123232:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a22dc09f/0xa66601b03fd54f3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.123243:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a22dc09f/0xa66601b03fd54f3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.123251:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a22dc09f/0xa66601b03fd54f3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.123265:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.123267:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.123269:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891240.123575:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891240.123582:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e88e8de8/0xa66601b03fd54f41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.123591:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1788891240.123595:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891240.123599:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e88e8de8/0xa66601b03fd54f41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.123611:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e88e8de8/0xa66601b03fd54f41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.123619:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e88e8de8/0xa66601b03fd54f41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.123626:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e88e8de8/0xa66601b03fd54f41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.123643:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891240.123965:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891240.123971:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e88e8de8/0xa66601b03fd54f41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.123979:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a9e00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891240.123983:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e88e8de8/0xa66601b03fd54f41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.123991:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e88e8de8/0xa66601b03fd54f41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.124005:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e88e8de8/0xa66601b03fd54f41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.124023:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e88e8de8/0xa66601b03fd54f41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.124038:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891240.124039:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891240.124041:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891240.124470:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891240.124476:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd54f48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.124486:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1788891240.124495:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891240.124500:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd54f48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.124510:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd54f48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.124518:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd54f48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.124566:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd54f48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.124583:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788891240.125477:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891240.125486:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f72981cd/0xa66601b03fd54f4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.125497:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1788891240.125501:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891240.125506:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f72981cd/0xa66601b03fd54f4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.125516:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f72981cd/0xa66601b03fd54f4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.125542:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f72981cd/0xa66601b03fd54f4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.125556:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f72981cd/0xa66601b03fd54f4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.125571:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788891240.125880:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788891240.125889:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd54f48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.125897:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a8400 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891240.125901:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd54f48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.125910:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd54f48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.125924:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd54f48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.125932:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd54f48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.125948:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891240.125951:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f72981cd/0xa66601b03fd54f4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.125964:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a9a00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891240.125968:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f72981cd/0xa66601b03fd54f4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.125976:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f72981cd/0xa66601b03fd54f4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.125984:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891240.125988:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f72981cd/0xa66601b03fd54f4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.125996:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f72981cd/0xa66601b03fd54f4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.126010:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891240.126012:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891240.126014:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891240.126259:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891240.126266:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000256004fb/0xa66601b03fd54f56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.126275:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1788891240.126278:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891240.126283:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000256004fb/0xa66601b03fd54f56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.126291:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000256004fb/0xa66601b03fd54f56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.126299:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000256004fb/0xa66601b03fd54f56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.126305:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000256004fb/0xa66601b03fd54f56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.126322:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891240.127368:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891240.127377:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000256004fb/0xa66601b03fd54f56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.127392:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a8c00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:3.0:1788891240.127397:0:24301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000256004fb/0xa66601b03fd54f56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.127407:0:24301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000256004fb/0xa66601b03fd54f56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.127422:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000256004fb/0xa66601b03fd54f56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.127430:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000256004fb/0xa66601b03fd54f56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.127447:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.127448:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891240.127450:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891240.127636:0:24274:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788891240.127653:0:24274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8538fbf/0xa66601b03fd54f5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.127670:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1788891240.127674:0:24274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891240.127680:0:24274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8538fbf/0xa66601b03fd54f5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.127692:0:24274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8538fbf/0xa66601b03fd54f5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.127701:0:24274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8538fbf/0xa66601b03fd54f5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.127709:0:24274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8538fbf/0xa66601b03fd54f5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.127725:0:24274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788891240.127764:0:24274:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00010000:00010000:1.0:1788891240.127772:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891240.127780:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8538fbf/0xa66601b03fd54f5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.127790:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a8e00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891240.127794:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8538fbf/0xa66601b03fd54f5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.127803:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8538fbf/0xa66601b03fd54f5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.127816:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8538fbf/0xa66601b03fd54f5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.127835:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8538fbf/0xa66601b03fd54f5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.127851:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891240.127853:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22799:x1875787997473920:12345-0@lo:5:osp-pre-1-0.0 Request processed in 64717us (65041us total) trans 0 rc 0/0 00010000:00010000:1.0:1788891240.127854:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891240.127858:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891240.127866:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788891240.127918:0:22799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8318dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22799:1875787997473920:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788891240.127933:0:22799:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1788891240.127973:0:22799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085871180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22799:1875787997474688:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788891240.128005:0:22799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891240.128038:0:22799:0:(client.c:2715:ptlrpc_set_wait()) set ffff925087938000 going to sleep for 11 seconds 00000100:00100000:1.0:1788891240.128055:0:24371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997474688 00000100:00100000:1.0:1788891240.128105:0:24371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997474688 00000100:00100000:1.0:1788891240.128157:0:24371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788891240.128169:0:24371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085870a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22799:x1875787997474688:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788891240.128208:0:24371:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:1.0:1788891240.138154:0:24371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085870a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22799:x1875787997474688:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9981us (10139us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788891240.138171:0:24371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788891240.138456:0:22799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085871180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22799:1875787997474688:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788891240.138473:0:22799:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:2.0:1788891240.272769:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891240.272851:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987971456 00000100:00100000:0.0:1788891240.272861:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987971456 00000100:00100000:0.0:1788891240.272904:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 111 00000100:00100000:0.0:1788891240.272912:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2390:x1875787987971456:12345-192.168.204.26@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788891240.272940:0:22767:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 5e3ff97d-a6ce-4396-af93-633a8e852ad5@192.168.204.26@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:0.0:1788891240.272968:0:22767:0:(genops.c:1385:class_connect()) connect: client 5e3ff97d-a6ce-4396-af93-633a8e852ad5, cookie 0xa66601b03fd54f64 00000100:00080000:0.0:1788891240.273102:0:22767:0:(import.c:65:import_set_state_nolock()) ffff9250830a5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788891240.273177:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+5:2390:x1875787987971456:12345-192.168.204.26@tcp:250:mount.lustre.0 Request processed in 264us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891240.273184:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 111 00000100:00100000:0.0:1788891240.280216:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891240.280613:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987971584 00000100:00100000:3.0:1788891240.280623:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987971584 00000100:00100000:3.0:1788891240.280696:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 112 00000100:00100000:3.0:1788891240.280707:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+5:18209:x1875787987971584:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788891240.280724:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891240.280742:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff925091a8be00/0xa66601b03fd54f6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204de479 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.280771:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff925091a8be00/0xa66601b03fd54f6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de479 expref: 6 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.280798:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff925091a8be00/0xa66601b03fd54f6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de479 expref: 6 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891240.280808:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8be00, rc 0) 00000100:00100000:3.0:1788891240.280881:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+6:18209:x1875787987971584:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 167us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891240.280888:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 112 00000100:00100000:3.0:1788891240.282338:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891240.283349:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987971712 00000100:00100000:2.0:1788891240.283359:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987971712 00000100:00100000:2.0:1788891240.283464:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 113 00000100:00100000:2.0:1788891240.283474:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+6:18209:x1875787987971712:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788891240.283609:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+6:18209:x1875787987971712:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 136us (1277us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788891240.283617:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 113 00000100:00100000:2.0:1788891240.288688:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891240.288818:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987971840 00000100:00100000:0.0:1788891240.288829:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987971840 00000100:00100000:0.0:1788891240.288886:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 114 00000100:00100000:0.0:1788891240.288895:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+6:18209:x1875787987971840:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788891240.288912:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891240.288930:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924f820a8200/0xa66601b03fd54f72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204de480 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.288963:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924f820a8200/0xa66601b03fd54f72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de480 expref: 7 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.288975:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924f820a8200/0xa66601b03fd54f72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de480 expref: 7 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891240.288994:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f820a8200, rc 0) 00000100:00100000:0.0:1788891240.289049:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+7:18209:x1875787987971840:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 155us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891240.289056:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 114 00000100:00100000:0.0:1788891240.292569:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891240.292690:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987971968 00000100:00100000:2.0:1788891240.292700:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987971968 00000100:00100000:2.0:1788891240.292753:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 115 00000100:00100000:2.0:1788891240.292763:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250b5a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+7:18209:x1875787987971968:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788891240.292960:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250b5a42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+8:18209:x1875787987971968:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 198us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891240.292969:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 115 00000100:00100000:3.0:1788891240.298318:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891240.298425:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987972096 00000100:00100000:0.0:1788891240.298435:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987972096 00000100:00100000:0.0:1788891240.298492:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 116 00000100:00100000:0.0:1788891240.298502:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+8:18209:x1875787987972096:12345-192.168.204.26@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788891240.298970:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+8:18209:x1875787987972096:12345-192.168.204.26@tcp:503:mount.lustre.0 Request processed in 467us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891240.298979:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 116 00000100:00100000:0.0:1788891240.306114:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891240.306347:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987972224 00000100:00100000:3.0:1788891240.306359:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987972224 00000100:00100000:3.0:1788891240.306418:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 117 00000100:00100000:3.0:1788891240.306429:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+8:18228:x1875787987972224:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788891240.306624:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+8:18228:x1875787987972224:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 197us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891240.306633:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 117 00000100:00100000:0.0:1788891240.320330:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891240.320473:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987972352 00000100:00100000:1.0:1788891240.320483:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987972352 00000100:00100000:1.0:1788891240.320562:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 118 00000100:00100000:1.0:1788891240.320572:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+8:18228:x1875787987972352:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788891240.320726:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+8:18228:x1875787987972352:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 155us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891240.320734:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 118 00000100:00100000:0.0:1788891240.324653:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891240.324759:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987972480 00000100:00100000:2.0:1788891240.324770:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987972480 00000100:00100000:2.0:1788891240.324831:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 119 00000100:00100000:2.0:1788891240.324841:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+8:18228:x1875787987972480:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788891240.325012:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+8:18228:x1875787987972480:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 172us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891240.325020:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 119 00000100:00100000:0.0:1788891240.327361:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891240.329719:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987972608 00000100:00100000:1.0:1788891240.329745:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987972608 00000100:00100000:1.0:1788891240.329920:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 120 00000100:00100000:1.0:1788891240.329930:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+8:18209:x1875787987972608:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788891240.329947:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891240.329963:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c6200/0xa66601b03fd54f79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204de4b1 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.329990:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c6200/0xa66601b03fd54f79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de4b1 expref: 9 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.330001:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c6200/0xa66601b03fd54f79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de4b1 expref: 9 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.330010:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6200, rc 0) 00000100:00100000:1.0:1788891240.330071:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+9:18209:x1875787987972608:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 142us (2719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891240.330078:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 120 00000100:00100000:0.0:1788891240.334656:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891240.334909:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987972736 00000100:00100000:2.0:1788891240.334919:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987972736 00000100:00100000:2.0:1788891240.334975:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 121 00000100:00100000:2.0:1788891240.334985:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+9:18209:x1875787987972736:12345-192.168.204.26@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788891240.335009:0:22768:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788891240.335032:0:22768:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788891240.335036:0:22768:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788891240.335039:0:22768:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788891240.335042:0:22768:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788891240.335045:0:22768:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788891240.338368:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+9:18209:x1875787987972736:12345-192.168.204.26@tcp:256:mount.lustre.0 Request processed in 3377us (3722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891240.338389:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 121 00000100:00100000:0.0:1788891240.344246:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891240.344348:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987972864 00000100:00100000:1.0:1788891240.344358:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987972864 00000100:00100000:1.0:1788891240.344411:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 122 00000100:00100000:1.0:1788891240.344421:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+9:18209:x1875787987972864:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788891240.344438:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891240.344457:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54f80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204de4b8 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.344486:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54f80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de4b8 expref: 10 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.344497:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54f80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de4b8 expref: 10 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891240.344519:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6c00, rc 0) 00000100:00100000:1.0:1788891240.344731:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+10:18209:x1875787987972864:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 310us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891240.344738:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 122 00000100:00100000:0.0:1788891240.349692:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891240.349754:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987972992 00000100:00100000:2.0:1788891240.349766:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987972992 00000100:00100000:2.0:1788891240.349827:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 123 00000100:00100000:2.0:1788891240.349837:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+10:18209:x1875787987972992:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788891240.349990:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+10:18209:x1875787987972992:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 153us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891240.349999:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 123 00000100:00100000:0.0:1788891240.351993:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891240.353028:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987973120 00000100:00100000:1.0:1788891240.353052:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987973120 00000100:00100000:1.0:1788891240.353185:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 124 00000100:00100000:1.0:1788891240.353197:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+10:18209:x1875787987973120:12345-192.168.204.26@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788891240.353354:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+10:18209:x1875787987973120:12345-192.168.204.26@tcp:503:mount.lustre.0 Request processed in 158us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891240.353362:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 124 00000100:00100000:0.0:1788891240.356825:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891240.357039:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987973248 00000100:00100000:2.0:1788891240.357049:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987973248 00000100:00100000:2.0:1788891240.357146:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 125 00000100:00100000:2.0:1788891240.357157:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+10:18235:x1875787987973248:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788891240.357311:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+10:18235:x1875787987973248:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 155us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891240.357320:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 125 00000100:00100000:0.0:1788891240.363397:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891240.363700:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987973376 00000100:00100000:1.0:1788891240.363710:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987973376 00000100:00100000:3.0:1788891240.363823:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 126 00000100:00100000:3.0:1788891240.363837:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+10:18235:x1875787987973376:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788891240.364000:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+10:18235:x1875787987973376:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 166us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891240.364008:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 126 00000100:00100000:1.0:1788891240.370757:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891240.370913:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987973504 00000100:00100000:0.0:1788891240.370924:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987973504 00000100:00100000:0.0:1788891240.370974:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:0.0:1788891240.370983:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1875787987973504:12345-192.168.204.26@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788891240.371024:0:24370:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 413079f8-dd2b-438f-8f6c-c06cd5265027@192.168.204.26@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:0.0:1788891240.371095:0:24370:0:(genops.c:1385:class_connect()) connect: client 413079f8-dd2b-438f-8f6c-c06cd5265027, cookie 0xa66601b03fd54f87 00000004:00100000:0.0:1788891240.371123:0:24370:0:(mdt_handler.c:7304:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788891240.371324:0:24370:0:(import.c:65:import_set_state_nolock()) ffff924f83a12800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788891240.371400:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+6:2390:x1875787987973504:12345-192.168.204.26@tcp:38:mount.lustre.0 Request processed in 416us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891240.371408:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:2.0:1788891240.375675:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891240.375721:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891240.375753:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891240.375938:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987973760 00000100:00100000:1.0:1788891240.375949:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987973760 00000100:00100000:1.0:1788891240.375993:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987974016 00000100:00100000:1.0:1788891240.375997:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987974016 00000100:00100000:2.0:1788891240.376086:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987973632 00000100:00100000:2.0:1788891240.376090:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987973632 00000100:00100000:0.0:1788891240.376149:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:0.0:1788891240.376158:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1875787987973760:12345-192.168.204.26@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788891240.376188:0:22772:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from 413079f8-dd2b-438f-8f6c-c06cd5265027@192.168.204.26@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:0.0:1788891240.376235:0:22772:0:(genops.c:1385:class_connect()) connect: client 413079f8-dd2b-438f-8f6c-c06cd5265027, cookie 0xa66601b03fd54f8e 00000004:00100000:0.0:1788891240.376259:0:22772:0:(mdt_handler.c:7304:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788891240.376418:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00080000:3.0:1788891240.376455:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788891240.376752:0:22772:0:(import.c:65:import_set_state_nolock()) ffff9250bf77b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788891240.376843:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+7:18209:x1875787987974016:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788891240.376865:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446297600 avail 1300058112 00000100:00100000:1.0:1788891240.376950:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+7:18209:x1875787987974016:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 523us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891240.376958:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:1.0:1788891240.376975:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:1.0:1788891240.376989:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+6:0:x1875787987973632:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788891240.377000:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446297600 avail 1300058112 00000100:00100000:1.0:1788891240.377134:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+6:0:x1875787987973632:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 146us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891240.377141:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:0.0:1788891240.377211:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+6:2390:x1875787987973760:12345-192.168.204.26@tcp:38:mount.lustre.0 Request processed in 1053us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891240.377218:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:2.0:1788891240.380080:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891240.380130:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987974144 00000100:00100000:0.0:1788891240.380138:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987974144 00000100:00100000:0.0:1788891240.380198:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:0.0:1788891240.380213:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+6:18209:x1875787987974144:12345-192.168.204.26@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788891240.380290:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+6:18209:x1875787987974144:12345-192.168.204.26@tcp:40:mount.lustre.0 Request processed in 84us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891240.380297:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:2.0:1788891240.383080:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891240.383118:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891240.383143:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891240.383179:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891240.383280:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987974272 00000100:00100000:1.0:1788891240.383289:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987974272 00000100:00100000:1.0:1788891240.383327:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987974400 00000100:00100000:1.0:1788891240.383330:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987974400 00000100:00100000:1.0:1788891240.383347:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:1.0:1788891240.383353:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1875787987974272:12345-192.168.204.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788891240.383384:0:24276:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 413079f8-dd2b-438f-8f6c-c06cd5265027@192.168.204.26@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:1.0:1788891240.383425:0:24276:0:(genops.c:1385:class_connect()) connect: client 413079f8-dd2b-438f-8f6c-c06cd5265027, cookie 0xa66601b03fd54f95 00002000:00100000:1.0:1788891240.383436:0:24276:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 413079f8-dd2b-438f-8f6c-c06cd5265027/ffff924f83386800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788891240.383453:0:24276:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788891240.383659:0:24276:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788891240.383690:0:24276:0:(import.c:65:import_set_state_nolock()) ffff924f832da000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788891240.383748:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+6:2390:x1875787987974272:12345-192.168.204.26@tcp:8:mount.lustre.0 Request processed in 394us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891240.383756:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:1.0:1788891240.383774:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:1.0:1788891240.383780:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1875787987974400:12345-192.168.204.26@tcp:8:mount.lustre.0 00000100:00100000:0.0:1788891240.383781:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987974528 00000100:00100000:0.0:1788891240.383787:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987974528 00010000:00080000:1.0:1788891240.383808:0:24276:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 413079f8-dd2b-438f-8f6c-c06cd5265027@192.168.204.26@tcp t0 exp 0000000000000000 cur 462 last 0 00000100:00100000:0.0:1788891240.383823:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:0.0:1788891240.383831:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:413079f8-dd2b-438f-8f6c-c06cd5265027+6:18209:x1875787987974528:12345-192.168.204.26@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788891240.383878:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:413079f8-dd2b-438f-8f6c-c06cd5265027+6:18209:x1875787987974528:12345-192.168.204.26@tcp:900:mount.lustre.0 Request processed in 47us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891240.383886:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:0.0:1788891240.383932:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987973888 00000100:00100000:0.0:1788891240.383936:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987973888 00000100:00100000:0.0:1788891240.384026:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 12 00000100:00100000:0.0:1788891240.384035:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+6:0:x1875787987973888:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788891240.384057:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000020:00000080:1.0:1788891240.384104:0:24276:0:(genops.c:1385:class_connect()) connect: client 413079f8-dd2b-438f-8f6c-c06cd5265027, cookie 0xa66601b03fd54f9c 00002000:00100000:1.0:1788891240.384111:0:24276:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 413079f8-dd2b-438f-8f6c-c06cd5265027/ffff9250b72d1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1788891240.384119:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+6:0:x1875787987973888:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 84us (1044us total) trans 0 rc 0/0 00002000:00100000:1.0:1788891240.384127:0:24276:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788891240.384131:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 12 00002000:00080000:1.0:1788891240.384252:0:24276:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788891240.384271:0:24276:0:(import.c:65:import_set_state_nolock()) ffff9250b72d2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788891240.384306:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+6:2390:x1875787987974400:12345-192.168.204.26@tcp:8:mount.lustre.0 Request processed in 524us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891240.384314:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00080000:2.0:1788891240.384376:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788891240.390500:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891240.391954:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987974656 00000100:00100000:0.0:1788891240.391968:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987974656 00000100:00100000:0.0:1788891240.392127:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:0.0:1788891240.392138:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+6:18209:x1875787987974656:12345-192.168.204.26@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788891240.395099:0:22775:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2876us 00000004:00200000:3.0:1788891240.405108:0:22775:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788891240.405326:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+6:18209:x1875787987974656:12345-192.168.204.26@tcp:33:mount.lustre.0 Request processed in 13185us (14830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891240.405341:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:0.0:1788891240.504591:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891240.504817:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987974784 00000100:00100000:2.0:1788891240.504828:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987974784 00000100:00100000:2.0:1788891240.504885:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:2.0:1788891240.504894:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+6:18258:x1875787987974784:12345-192.168.204.26@tcp:101:mkdir.0 00010000:00010000:2.0:1788891240.504914:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891240.504937:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a400/0xa66601b03fd54fa3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de4e9 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.505003:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd54faa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.505024:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd54faa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.505040:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd54faa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891240.505090:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788891240.505094:0:22773:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788891240.505127:0:22773:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd54faa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.505149:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a400/0xa66601b03fd54fa3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de4e9 expref: 8 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.505165:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd54faa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de4e9 expref: 7 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891240.505189:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e34100) 00010000:00010000:2.0:1788891240.505192:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788891240.505195:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92508587be00, rc 0) 00000100:00100000:2.0:1788891240.505252:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+7:18258:x1875787987974784:12345-192.168.204.26@tcp:101:mkdir.0 Request processed in 359us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891240.505258:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:3.0:1788891240.572678:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997474816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788891240.572769:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891240.572878:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997474816 00000100:00100000:2.0:1788891240.572886:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997474816 00000100:00100000:2.0:1788891240.572938:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788891240.572947:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997474816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788891240.572968:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788891240.573019:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1875787997474816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891240.573025:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788891240.573069:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997474816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788891240.573178:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997474944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788891240.573207:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891240.573269:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997474944 00000100:00100000:2.0:1788891240.573273:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997474944 00000100:00100000:2.0:1788891240.573305:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788891240.573312:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085872a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997474944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788891240.573323:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788891240.573426:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085872a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997474944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891240.573433:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788891240.573556:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997474944:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788891241.019760:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891241.083788:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925085872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997475072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788891241.083875:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891241.083927:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997475072 00000100:00100000:0.0:1788891241.083936:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997475072 00000100:00100000:0.0:1788891241.083993:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788891241.084017:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997475072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788891241.084052:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788891241.084125:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997475072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891241.084132:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788891241.084199:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925085872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997475072:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788891242.043723:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891242.212404:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891242.212616:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987974912 00000100:00100000:1.0:1788891242.212635:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987974912 00000100:00100000:1.0:1788891242.212752:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:1.0:1788891242.212769:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+7:18311:x1875787987974912:12345-192.168.204.26@tcp:41:lfs.0 00000100:00080000:2.0:1788891242.212773:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1788891242.212817:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788891242.212951:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+7:18311:x1875787987974912:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 187us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891242.212959:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:1.0:1788891242.215396:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891242.215504:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987975040 00000100:00100000:2.0:1788891242.215514:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987975040 00000100:00100000:2.0:1788891242.215663:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:2.0:1788891242.215676:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+6:18311:x1875787987975040:12345-192.168.204.26@tcp:41:lfs.0 00000004:00000024:2.0:1788891242.215721:0:22773:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:0.0:1788891242.215923:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788891242.216181:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+6:18311:x1875787987975040:12345-192.168.204.26@tcp:41:lfs.0 Request processed in 506us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891242.216189:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:2.0:1788891242.221850:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891242.222908:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987975168 00000100:00100000:0.0:1788891242.222919:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987975168 00000100:00100000:0.0:1788891242.223120:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:0.0:1788891242.223132:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:413079f8-dd2b-438f-8f6c-c06cd5265027+6:18311:x1875787987975168:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:0.0:1788891242.223165:0:24278:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788891242.223257:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:413079f8-dd2b-438f-8f6c-c06cd5265027+6:18311:x1875787987975168:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 127us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891242.223265:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00080000:2.0:1788891242.223478:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891242.228278:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891242.228411:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987975296 00000100:00100000:1.0:1788891242.228421:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987975296 00000100:00100000:1.0:1788891242.228514:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:1.0:1788891242.228553:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:413079f8-dd2b-438f-8f6c-c06cd5265027+6:18311:x1875787987975296:12345-192.168.204.26@tcp:13:lfs.0 00002000:00000024:1.0:1788891242.228598:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1788891242.228657:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788891242.228705:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:413079f8-dd2b-438f-8f6c-c06cd5265027+6:18311:x1875787987975296:12345-192.168.204.26@tcp:13:lfs.0 Request processed in 177us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891242.228724:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:3.0:1788891242.343152:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891242.344042:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987975424 00000100:00100000:2.0:1788891242.344053:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987975424 00000100:00100000:2.0:1788891242.344112:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 127 00000100:00100000:2.0:1788891242.344122:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925087b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+10:18344:x1875787987975424:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788891242.344141:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891242.344161:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92508587b000/0xa66601b03fd54fb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204de4f0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891242.344191:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92508587b000/0xa66601b03fd54fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de4f0 expref: 11 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891242.344202:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92508587b000/0xa66601b03fd54fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de4f0 expref: 11 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891242.344213:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92508587b000, rc 0) 00000100:00100000:2.0:1788891242.344347:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925087b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+11:18344:x1875787987975424:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 225us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891242.344355:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 127 00000100:00100000:2.0:1788891242.350050:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891242.350281:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987975552 00000100:00100000:3.0:1788891242.350293:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987975552 00000100:00100000:3.0:1788891242.350420:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 128 00000100:00100000:3.0:1788891242.350432:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+11:18344:x1875787987975552:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788891242.350642:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+11:18344:x1875787987975552:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 212us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891242.350651:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 128 00000100:00100000:0.0:1788891242.355051:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891242.355173:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987975680 00000100:00100000:2.0:1788891242.355183:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987975680 00000100:00100000:2.0:1788891242.355241:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 129 00000100:00100000:2.0:1788891242.355251:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+11:18344:x1875787987975680:12345-192.168.204.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788891242.355495:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+11:18344:x1875787987975680:12345-192.168.204.26@tcp:503:mount.lustre.0 Request processed in 244us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891242.355503:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 129 00000100:00100000:0.0:1788891242.357957:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891242.358311:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987975808 00000100:00100000:3.0:1788891242.358321:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987975808 00000100:00100000:3.0:1788891242.358441:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 130 00000100:00100000:3.0:1788891242.358452:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+11:18350:x1875787987975808:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788891242.358651:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+11:18350:x1875787987975808:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 200us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891242.358659:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 130 00000100:00100000:0.0:1788891242.373304:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891242.373660:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987975936 00000100:00100000:2.0:1788891242.373673:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987975936 00000100:00100000:2.0:1788891242.373740:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 131 00000100:00100000:2.0:1788891242.373751:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+11:18350:x1875787987975936:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788891242.373946:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+11:18350:x1875787987975936:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 187us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891242.373956:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 131 00000100:00100000:0.0:1788891242.376133:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891242.376279:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987976064 00000100:00100000:3.0:1788891242.376290:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987976064 00000100:00100000:3.0:1788891242.376347:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 132 00000100:00100000:3.0:1788891242.376357:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+11:18350:x1875787987976064:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788891242.376501:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+11:18350:x1875787987976064:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 144us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891242.376516:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 132 00000100:00100000:0.0:1788891242.378917:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891242.379040:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987976192 00000100:00100000:2.0:1788891242.379049:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987976192 00000100:00100000:2.0:1788891242.379102:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 133 00000100:00100000:2.0:1788891242.379219:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+11:18344:x1875787987976192:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788891242.379237:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891242.379256:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92508587aa00/0xa66601b03fd54fb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204de521 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891242.379284:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92508587aa00/0xa66601b03fd54fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de521 expref: 12 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891242.379559:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92508587aa00/0xa66601b03fd54fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de521 expref: 12 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891242.379587:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92508587aa00, rc 0) 00000100:00100000:2.0:1788891242.379657:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+12:18344:x1875787987976192:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 547us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891242.379665:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 133 00000100:00100000:0.0:1788891242.382783:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891242.382881:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987976320 00000100:00100000:1.0:1788891242.382891:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987976320 00000100:00100000:1.0:1788891242.382949:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 134 00000100:00100000:1.0:1788891242.382960:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+12:18344:x1875787987976320:12345-192.168.204.26@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788891242.382984:0:22767:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788891242.383029:0:22767:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788891242.383033:0:22767:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788891242.383036:0:22767:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788891242.383039:0:22767:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788891242.383041:0:22767:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788891242.385799:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+12:18344:x1875787987976320:12345-192.168.204.26@tcp:256:mount.lustre.0 Request processed in 2826us (3022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891242.385815:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 134 00000100:00100000:0.0:1788891242.389486:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891242.389583:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987976448 00000100:00100000:2.0:1788891242.389594:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987976448 00000100:00100000:2.0:1788891242.389662:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 135 00000100:00100000:2.0:1788891242.389674:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509094c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+12:18344:x1875787987976448:12345-192.168.204.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788891242.389692:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891242.389711:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92508587a000/0xa66601b03fd54fbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204de528 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891242.389752:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92508587a000/0xa66601b03fd54fbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de528 expref: 13 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891242.389764:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92508587a000/0xa66601b03fd54fbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de528 expref: 13 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891242.389773:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92508587a000, rc 0) 00000100:00100000:2.0:1788891242.389836:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509094c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+13:18344:x1875787987976448:12345-192.168.204.26@tcp:101:mount.lustre.0 Request processed in 162us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891242.389844:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 135 00000100:00100000:0.0:1788891242.392056:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891242.392197:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987976576 00000100:00100000:1.0:1788891242.392207:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987976576 00000100:00100000:1.0:1788891242.392257:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 136 00000100:00100000:1.0:1788891242.392267:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+13:18344:x1875787987976576:12345-192.168.204.26@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788891242.392419:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+13:18344:x1875787987976576:12345-192.168.204.26@tcp:501:mount.lustre.0 Request processed in 152us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891242.392427:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 136 00000100:00100000:0.0:1788891242.394960:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891242.395031:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987976704 00000100:00100000:2.0:1788891242.395041:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987976704 00000100:00100000:2.0:1788891242.395105:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 137 00000100:00100000:2.0:1788891242.395115:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+13:18344:x1875787987976704:12345-192.168.204.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788891242.395276:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+13:18344:x1875787987976704:12345-192.168.204.26@tcp:503:mount.lustre.0 Request processed in 161us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891242.395284:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 137 00000100:00100000:0.0:1788891242.398743:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891242.399278:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987976832 00000100:00100000:3.0:1788891242.399288:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987976832 00000100:00100000:3.0:1788891242.400177:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 138 00000100:00100000:3.0:1788891242.400195:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+13:18353:x1875787987976832:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788891242.400409:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+13:18353:x1875787987976832:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 219us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891242.400418:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 138 00000100:00100000:0.0:1788891242.411719:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891242.411938:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987976960 00000100:00100000:1.0:1788891242.411952:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987976960 00000100:00100000:1.0:1788891242.412469:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 139 00000100:00100000:1.0:1788891242.412484:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+13:18353:x1875787987976960:12345-192.168.204.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788891242.412684:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+13:18353:x1875787987976960:12345-192.168.204.26@tcp:502:llog_process_th.0 Request processed in 203us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891242.412703:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 139 00000100:00100000:0.0:1788891242.425028:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891242.425177:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891242.425312:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987977088 00000100:00100000:2.0:1788891242.425322:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987977088 00000100:00100000:2.0:1788891242.425675:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987977344 00000100:00100000:2.0:1788891242.425681:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987977344 00000100:00100000:3.0:1788891242.426435:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:3.0:1788891242.426446:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8318ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2390:x1875787987977088:12345-192.168.204.26@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788891242.426484:0:22773:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 764a7f30-db7e-4ef5-b540-d95fb3bdda52@192.168.204.26@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:3.0:1788891242.426552:0:22773:0:(genops.c:1385:class_connect()) connect: client 764a7f30-db7e-4ef5-b540-d95fb3bdda52, cookie 0xa66601b03fd54fc6 00000004:00100000:3.0:1788891242.426578:0:22773:0:(mdt_handler.c:7304:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788891242.427966:0:22773:0:(import.c:65:import_set_state_nolock()) ffff9250841ab000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788891242.428122:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8318ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:2390:x1875787987977088:12345-192.168.204.26@tcp:38:mount.lustre.0 Request processed in 1675us (3102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891242.428134:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:3.0:1788891242.428172:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:3.0:1788891242.428177:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250ba077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2390:x1875787987977344:12345-192.168.204.26@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788891242.428201:0:22773:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0001: connection from 764a7f30-db7e-4ef5-b540-d95fb3bdda52@192.168.204.26@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:3.0:1788891242.428232:0:22773:0:(genops.c:1385:class_connect()) connect: client 764a7f30-db7e-4ef5-b540-d95fb3bdda52, cookie 0xa66601b03fd54fcd 00000004:00100000:3.0:1788891242.428253:0:22773:0:(mdt_handler.c:7304:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788891242.428305:0:22773:0:(import.c:65:import_set_state_nolock()) ffff9250841aa800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788891242.428346:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250ba077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:2390:x1875787987977344:12345-192.168.204.26@tcp:38:mount.lustre.0 Request processed in 167us (3169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891242.428353:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:0.0:1788891242.433722:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891242.434307:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987977472 00000100:00100000:3.0:1788891242.434320:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987977472 00000100:00100000:3.0:1788891242.434400:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:3.0:1788891242.434411:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250ba074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:0:x1875787987977472:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788891242.434449:0:22773:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:2.0:1788891242.434809:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788891242.435047:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250ba074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:0:x1875787987977472:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 637us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891242.435055:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:0.0:1788891242.435203:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891242.435385:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891242.436457:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987977600 00000100:00100000:3.0:1788891242.436468:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987977600 00000100:00100000:1.0:1788891242.436589:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987977216 00000100:00100000:1.0:1788891242.436594:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987977216 00000100:00100000:1.0:1788891242.436681:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:1.0:1788891242.436691:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250ba074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:764a7f30-db7e-4ef5-b540-d95fb3bdda52+7:0:x1875787987977216:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788891242.436717:0:24370:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788891242.436955:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250ba074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:764a7f30-db7e-4ef5-b540-d95fb3bdda52+7:0:x1875787987977216:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 264us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891242.437430:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00080000:0.0:1788891242.437496:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788891242.437978:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:2.0:1788891242.437991:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250ba075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:18344:x1875787987977600:12345-192.168.204.26@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788891242.438012:0:22772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788891242.438076:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250ba075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:18344:x1875787987977600:12345-192.168.204.26@tcp:41:mount.lustre.0 Request processed in 88us (2873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891242.438083:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:0.0:1788891242.446204:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891242.446311:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987977728 00000100:00100000:3.0:1788891242.446323:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987977728 00000100:00100000:3.0:1788891242.446382:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:3.0:1788891242.446393:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250ba075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:18344:x1875787987977728:12345-192.168.204.26@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788891242.446490:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250ba075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:18344:x1875787987977728:12345-192.168.204.26@tcp:40:mount.lustre.0 Request processed in 99us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891242.446498:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:0.0:1788891242.450519:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891242.451058:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891242.451245:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891242.451544:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987978112 00000100:00100000:3.0:1788891242.451554:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987978112 00000100:00100000:3.0:1788891242.451621:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:3.0:1788891242.451633:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:18344:x1875787987978112:12345-192.168.204.26@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788891242.451740:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:18344:x1875787987978112:12345-192.168.204.26@tcp:900:mount.lustre.0 Request processed in 109us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891242.451757:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:1.0:1788891242.452242:0:24371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987977856 00000100:00100000:0.0:1788891242.452243:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987977984 00000100:00100000:1.0:1788891242.452250:0:24371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987977856 00000100:00100000:0.0:1788891242.452251:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987977984 00000100:00100000:1.0:1788891242.452330:0:24371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:1.0:1788891242.452337:0:24371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250ba074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1875787987977856:12345-192.168.204.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788891242.452366:0:24371:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 764a7f30-db7e-4ef5-b540-d95fb3bdda52@192.168.204.26@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:1.0:1788891242.452411:0:24371:0:(genops.c:1385:class_connect()) connect: client 764a7f30-db7e-4ef5-b540-d95fb3bdda52, cookie 0xa66601b03fd54fd4 00002000:00100000:1.0:1788891242.452423:0:24371:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 764a7f30-db7e-4ef5-b540-d95fb3bdda52/ffff9250bb7b8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788891242.452437:0:24371:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788891242.452509:0:24371:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788891242.452555:0:24371:0:(import.c:65:import_set_state_nolock()) ffff9250bb7b9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788891242.452595:0:24371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250ba074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:2390:x1875787987977856:12345-192.168.204.26@tcp:8:mount.lustre.0 Request processed in 256us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891242.452613:0:24371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:1.0:1788891242.452627:0:24371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:1.0:1788891242.452631:0:24371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1875787987977984:12345-192.168.204.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788891242.452653:0:24371:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 764a7f30-db7e-4ef5-b540-d95fb3bdda52@192.168.204.26@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:1.0:1788891242.452667:0:24371:0:(genops.c:1385:class_connect()) connect: client 764a7f30-db7e-4ef5-b540-d95fb3bdda52, cookie 0xa66601b03fd54fdb 00002000:00100000:1.0:1788891242.452671:0:24371:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 764a7f30-db7e-4ef5-b540-d95fb3bdda52/ffff9250bb7ba000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788891242.452677:0:24371:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788891242.452706:0:24371:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788891242.452719:0:24371:0:(import.c:65:import_set_state_nolock()) ffff9250bb7bb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788891242.452739:0:24371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:2390:x1875787987977984:12345-192.168.204.26@tcp:8:mount.lustre.0 Request processed in 107us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891242.452745:0:24371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:2.0:1788891242.455263:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891242.455369:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987978240 00000100:00100000:1.0:1788891242.455379:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987978240 00000100:00100000:1.0:1788891242.455429:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:1.0:1788891242.455439:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:18344:x1875787987978240:12345-192.168.204.26@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788891242.455555:0:22776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788891242.455695:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:18344:x1875787987978240:12345-192.168.204.26@tcp:33:mount.lustre.0 Request processed in 256us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891242.455704:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:1.0:1788891242.593141:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891242.593778:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987978368 00000100:00100000:3.0:1788891242.593865:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987978368 00000100:00100000:3.0:1788891242.593936:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:3.0:1788891242.593947:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:18376:x1875787987978368:12345-192.168.204.26@tcp:101:mkdir.0 00010000:00010000:3.0:1788891242.593969:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891242.593995:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd54fe2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de559 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891242.594067:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd54fe9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891242.594085:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd54fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891242.594097:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd54fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891242.594150:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788891242.594154:0:22773:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891242.594177:0:22773:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd54fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891242.594203:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd54fe2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de559 expref: 8 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891242.594224:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd54fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de559 expref: 7 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891242.594252:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e34100) 00010000:00010000:3.0:1788891242.594255:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788891242.594258:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8ac00, rc 0) 00000100:00100000:3.0:1788891242.594335:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:764a7f30-db7e-4ef5-b540-d95fb3bdda52+7:18376:x1875787987978368:12345-192.168.204.26@tcp:101:mkdir.0 Request processed in 389us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891242.594341:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 22 00010000:00010000:0.0:1788891243.071950:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891244.094031:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788891244.672937:0:25648:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788891245.115794:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891245.180749:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250ba075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997475200:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788891245.180852:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891245.181107:0:25539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997475200 00000100:00100000:2.0:1788891245.181118:0:25539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997475200 00000100:00100000:2.0:1788891245.181197:0:25539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788891245.181209:0:25539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250ba074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997475200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788891245.181258:0:25539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788891245.181309:0:25539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250ba074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997475200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891245.181317:0:25539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788891245.181503:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997475328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788891245.181570:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891245.181618:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997475328 00000100:00100000:1.0:1788891245.181622:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997475328 00000100:00100000:1.0:1788891245.181666:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788891245.181674:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997475328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788891245.181706:0:24278:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788891245.181744:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997475328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891245.181750:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788891245.181768:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788891245.182069:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250ba075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997475200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788891245.182421:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997475584:0@lo:400:kworker.0 00000100:00100000:3.0:1788891245.182466:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891245.182493:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997475712:0@lo:400:kworker.0 00000100:00100000:3.0:1788891245.182542:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891245.182682:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997475584 00000100:00100000:0.0:1788891245.182688:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997475584 00000100:00100000:0.0:1788891245.182729:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788891245.182736:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997475584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891245.182785:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997475584:12345-0@lo:400:kworker.0 Request processed in 49us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891245.182792:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788891245.182810:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad5d36d9-7941-4f84-88d2-361333de6068:3628:1875787997475456:0@lo:400:kworker.0 00000100:00100000:0.0:1788891245.182840:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891245.182921:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997475712 00000100:00100000:1.0:1788891245.182926:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997475712 00000100:00100000:1.0:1788891245.182964:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788891245.182971:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997475712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891245.183003:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997475712:12345-0@lo:400:kworker.0 Request processed in 34us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891245.183010:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788891245.183058:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997475328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788891245.183076:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997475840:0@lo:400:kworker.0 00000100:00100000:1.0:1788891245.183098:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891245.183118:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997476352:0@lo:400:kworker.0 00000100:00100000:1.0:1788891245.183141:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891245.183168:0:24371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997475840 00000100:00100000:1.0:1788891245.183172:0:24371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997475840 00000100:00100000:1.0:1788891245.183197:0:24371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788891245.183203:0:24371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3627:x1875787997475840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891245.183233:0:24371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3627:x1875787997475840:12345-0@lo:400:kworker.0 Request processed in 30us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891245.183239:0:24371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788891245.183256:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997476352 00000100:00100000:1.0:1788891245.183259:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997476352 00000100:00100000:1.0:1788891245.183293:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788891245.183299:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997476352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891245.183325:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1875787997476352:12345-0@lo:400:kworker.0 Request processed in 27us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891245.183331:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788891245.183362:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997475584:0@lo:400:kworker.0 00000100:00100000:1.0:1788891245.183369:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997476096:0@lo:400:kworker.0 00000100:00100000:1.0:1788891245.183390:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891245.183405:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997476608:0@lo:400:kworker.0 00000100:00100000:1.0:1788891245.183433:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891245.183475:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997476608 00000100:00100000:1.0:1788891245.183478:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997476608 00000100:00100000:1.0:1788891245.183502:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788891245.183508:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997476608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891245.183592:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1875787997476608:12345-0@lo:400:kworker.0 Request processed in 83us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891245.183599:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788891245.183627:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3629:1875787997476608:0@lo:400:kworker.0 00000100:00100000:1.0:1788891245.183652:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3627:1875787997475840:0@lo:400:kworker.0 00000100:00100000:1.0:1788891245.183663:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3627:1875787997476352:0@lo:400:kworker.0 00000100:00100000:2.0:1788891245.183809:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997476096 00000100:00100000:2.0:1788891245.183813:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997476096 00000100:00100000:2.0:1788891245.183859:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788891245.183867:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997476096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891245.183909:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997476096:12345-0@lo:400:kworker.0 Request processed in 43us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891245.183915:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788891245.183952:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997476096:0@lo:400:kworker.0 00000100:00100000:3.0:1788891245.184235:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997475456 00000100:00100000:3.0:1788891245.184240:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997475456 00000100:00100000:3.0:1788891245.184278:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788891245.184285:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+24:3628:x1875787997475456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891245.184322:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+24:3628:x1875787997475456:12345-0@lo:400:kworker.0 Request processed in 38us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891245.184329:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788891245.184382:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997475712:0@lo:400:kworker.0 00000100:00100000:3.0:1788891245.184390:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997476224:0@lo:400:kworker.0 00000100:00100000:3.0:1788891245.184418:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891245.184441:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997476736:0@lo:400:kworker.0 00000100:00100000:3.0:1788891245.184470:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891245.184565:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997476224 00000100:00100000:3.0:1788891245.184569:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997476224 00000100:00100000:3.0:1788891245.184594:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997476736 00000100:00100000:3.0:1788891245.184597:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997476736 00000100:00100000:3.0:1788891245.184616:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788891245.184622:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997476224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891245.184653:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1875787997476224:12345-0@lo:400:kworker.0 Request processed in 32us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891245.184660:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788891245.184669:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788891245.184674:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875787997476736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891245.184695:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1875787997476736:12345-0@lo:400:kworker.0 Request processed in 21us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891245.184701:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788891245.184727:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3630:1875787997476224:0@lo:400:kworker.0 00010000:00080000:3.0:1788891245.184740:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c12a6300 x1875787997476736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891245.184752:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3630:1875787997476736:0@lo:400:kworker.0 00000100:00100000:0.0:1788891245.184869:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad5d36d9-7941-4f84-88d2-361333de6068:3628:1875787997475456:0@lo:400:kworker.0 00000100:00100000:0.0:1788891245.184877:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997475968:0@lo:400:kworker.0 00000100:00100000:0.0:1788891245.184902:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891245.184942:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997476480:0@lo:400:kworker.0 00000100:00100000:0.0:1788891245.184962:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891245.184984:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788891245.184989:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997476864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788891245.185011:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788891245.185036:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788891245.185040:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788891245.185045:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788891245.185048:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891245.185058:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997475968 00000100:00100000:0.0:1788891245.185061:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997475968 00000100:00100000:0.0:1788891245.185080:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997476480 00000100:00100000:0.0:1788891245.185082:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997476480 00000100:00100000:0.0:1788891245.185100:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788891245.185106:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250ba075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997475968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891245.185135:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250ba075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1875787997475968:12345-0@lo:400:kworker.0 Request processed in 29us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891245.185141:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788891245.185150:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788891245.185155:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250ba075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875787997476480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891245.185175:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250ba075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1875787997476480:12345-0@lo:400:kworker.0 Request processed in 20us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891245.185180:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788891245.185192:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788891245.185207:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3628:1875787997475968:0@lo:400:kworker.0 00010000:00080000:0.0:1788891245.185216:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250c12a5c00 x1875787997476480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891245.185238:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3628:1875787997476480:0@lo:400:kworker.0 00000100:00100000:0.0:1788891245.185256:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997476864 00000100:00100000:0.0:1788891245.185259:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997476864 00000100:00100000:0.0:1788891245.185282:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788891245.185287:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250ba077b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1875787997476864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788891245.185302:0:24278:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788891245.185335:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250ba077b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1875787997476864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891245.185341:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788891245.185369:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997476864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788891245.695921:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997476992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788891245.696008:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891245.696069:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997477120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788891245.696099:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891245.696151:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997476992 00000100:00100000:2.0:1788891245.697263:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997476992 00000100:00100000:2.0:1788891245.697682:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997477120 00000100:00100000:2.0:1788891245.697687:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997477120 00000100:00100000:2.0:1788891245.697713:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788891245.697723:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997476992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788891245.697755:0:24278:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788891245.697829:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997476992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891245.697838:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788891245.697859:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788891245.697866:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997477120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788891245.697876:0:24278:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788891245.697908:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997477120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891245.697923:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788891245.697984:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997477120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788891245.699927:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997476992:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1788891245.701850:0:25092:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 764a7f30-db7e-4ef5-b540-d95fb3bdda52 00000001:00100000:1.0:1788891245.701864:0:25092:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 413079f8-dd2b-438f-8f6c-c06cd5265027 00000001:00080000:1.0:1788891245.701881:0:25092:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000001:00100000:1.0:1788891245.701954:0:22753:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 764a7f30-db7e-4ef5-b540-d95fb3bdda52 00000001:00100000:1.0:1788891245.701962:0:22753:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 413079f8-dd2b-438f-8f6c-c06cd5265027 00000001:00100000:3.0:1788891245.702041:0:24270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 764a7f30-db7e-4ef5-b540-d95fb3bdda52 00000001:00100000:3.0:1788891245.702047:0:24270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 413079f8-dd2b-438f-8f6c-c06cd5265027 00000001:00100000:0.0:1788891245.702247:0:23504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 764a7f30-db7e-4ef5-b540-d95fb3bdda52 00000001:00100000:0.0:1788891245.702255:0:23504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 413079f8-dd2b-438f-8f6c-c06cd5265027 00000040:00080000:0.0:1788891246.076229:0:23529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788891246.140008:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891246.203820:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788891246.203848:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250ba076a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997477248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788891246.203944:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891246.204155:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997477248 00000100:00100000:0.0:1788891246.204164:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997477248 00000100:00100000:0.0:1788891246.204215:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788891246.204226:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997477248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788891246.204267:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788891246.204334:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997477248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891246.204435:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788891246.204874:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250ba076a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997477248:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1788891247.160477:0:25796:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff70dbdc30 20000000:00000080:2.0:1788891247.160496:0:25796:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9250bb756c00 uarg=0000000000000000 20000000:01000000:2.0:1788891247.160807:0:25796:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788891247.160812:0:25796:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788891247.160817:0:25796:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788891247.161206:0:25797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1788891247.161363:0:25796:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 00010000:00010000:0.0:1788891247.163793:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788891247.167985:0:25796:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788891247.168021:0:25796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92508587ba00/0xa66601b03fd54ff0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891247.168042:0:25796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250813ed200/0xa66601b03fd54c54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54c4d expref: 23 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891247.168050:0:25796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250813ec400/0xa66601b03fd54c62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54c5b expref: 23 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891247.168057:0:25796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff925091a8a000/0xa66601b03fd54ca1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54c9a expref: 23 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891247.168063:0:25796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250baae4000/0xa66601b03fd54e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd54e14 expref: 23 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891247.168073:0:25796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54f80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de4b8 expref: 12 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891247.168081:0:25796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92508587a000/0xa66601b03fd54fbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de528 expref: 12 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891247.168108:0:25796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92508587ba00/0xa66601b03fd54ff0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891247.168154:0:25796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92508587a000/0xa66601b03fd54fbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de528 expref: 12 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891247.168170:0:25796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92508587a000/0xa66601b03fd54fbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de528 expref: 12 pid: 22768 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891247.168187:0:25796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1875787997477376:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891247.168295:0:25796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54f80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de4b8 expref: 12 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891247.168304:0:25796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54f80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de4b8 expref: 12 pid: 22767 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891247.168313:0:25796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1875787997477504:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891247.168345:0:25796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250baae4000/0xa66601b03fd54e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd54e14 expref: 23 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891247.168353:0:25796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250baae4000/0xa66601b03fd54e1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd54e14 expref: 23 pid: 22765 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891247.168361:0:25796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1875787997477632:0@lo:104: 00000100:00100000:2.0:1788891247.168400:0:25796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788891247.168447:0:25796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff925091a8a000/0xa66601b03fd54ca1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd54c9a expref: 23 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891247.168466:0:25796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff925091a8a000/0xa66601b03fd54ca1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd54c9a expref: 23 pid: 22767 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891247.168474:0:25796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83149f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1875787997477760:0@lo:104: 00000100:00100000:2.0:1788891247.168495:0:25796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788891247.168847:0:25796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250813ec400/0xa66601b03fd54c62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd54c5b expref: 23 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891247.168857:0:25796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250813ec400/0xa66601b03fd54c62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd54c5b expref: 23 pid: 22767 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891247.168866:0:25796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1875787997477888:0@lo:104: 00000100:00100000:2.0:1788891247.168891:0:25796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788891247.168911:0:25796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9250813ed200/0xa66601b03fd54c54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa66601b03fd54c4d expref: 23 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891247.168919:0:25796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9250813ed200/0xa66601b03fd54c54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa66601b03fd54c4d expref: 23 pid: 22765 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891247.168927:0:25796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f8314b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1875787997478016:0@lo:104: 00000100:00100000:2.0:1788891247.168947:0:25796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891247.168958:0:25796:0:(client.c:2715:ptlrpc_set_wait()) set ffff925087938e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788891247.169043:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997477632 00000100:00100000:1.0:1788891247.169051:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997477632 00000100:00100000:1.0:1788891247.169091:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997477760 00000100:00100000:1.0:1788891247.169093:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997477760 00000100:00100000:1.0:1788891247.169103:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997477888 00000100:00100000:1.0:1788891247.169105:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997477888 00000100:00100000:1.0:1788891247.169114:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997478016 00000100:00100000:1.0:1788891247.169116:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997478016 00000100:00100000:1.0:1788891247.169129:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788891247.169139:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad5d36d9-7941-4f84-88d2-361333de6068+6:25796:x1875787997477632:12345-0@lo:104: 00010000:00010000:1.0:1788891247.169153:0:22757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff925091a8a600/0xa66601b03fd54e14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54e1b expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169217:0:22757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788891247.169223:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad5d36d9-7941-4f84-88d2-361333de6068+6:25796:x1875787997477632:12345-0@lo:104: Request processed in 87us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891247.169230:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788891247.169249:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788891247.169254:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad5d36d9-7941-4f84-88d2-361333de6068+5:25796:x1875787997477760:12345-0@lo:104: 00010000:00010000:1.0:1788891247.169261:0:22757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd54c9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54ca1 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169306:0:22757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788891247.169311:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad5d36d9-7941-4f84-88d2-361333de6068+5:25796:x1875787997477760:12345-0@lo:104: Request processed in 57us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891247.169317:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788891247.169328:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788891247.169334:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad5d36d9-7941-4f84-88d2-361333de6068+4:25796:x1875787997477888:12345-0@lo:104: 00010000:00010000:1.0:1788891247.169340:0:22757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd54c5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54c62 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169369:0:22757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788891247.169374:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad5d36d9-7941-4f84-88d2-361333de6068+4:25796:x1875787997477888:12345-0@lo:104: Request processed in 41us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891247.169380:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788891247.169392:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788891247.169398:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad5d36d9-7941-4f84-88d2-361333de6068+3:25796:x1875787997478016:12345-0@lo:104: 00010000:00010000:1.0:1788891247.169404:0:22757:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd54c4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54c54 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169428:0:22757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788891247.169433:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad5d36d9-7941-4f84-88d2-361333de6068+3:25796:x1875787997478016:12345-0@lo:104: Request processed in 36us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891247.169438:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788891247.169457:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788891247.169463:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff925091a8a600/0xa66601b03fd54e14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54e1b expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169482:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8a600 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788891247.169486:0:24301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff925091a8a600/0xa66601b03fd54e14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd54e1b expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169494:0:24301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff925091a8a600/0xa66601b03fd54e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd54e1b expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891247.169500:0:24301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff925091a8a600/0xa66601b03fd54e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd54e1b expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891247.169516:0:24301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788891247.169565:0:24301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff925091a8a600/0xa66601b03fd54e14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54e1b expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169572:0:24301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788891247.169591:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff925091a8a600/0xa66601b03fd54e14 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54e1b expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169597:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff925091a8a600/0xa66601b03fd54e14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54e1b expref: -99 pid: 25091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169611:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788891247.169615:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd54c9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54ca1 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169620:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ed600 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788891247.169623:0:24301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd54c9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd54ca1 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169639:0:24301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd54c9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd54ca1 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891247.169646:0:24301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd54c9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd54ca1 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891247.169652:0:24301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788891247.169665:0:24301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd54c9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54ca1 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169669:0:24301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788891247.169675:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd54c9a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54ca1 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169681:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250813ed600/0xa66601b03fd54c9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54ca1 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169692:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788891247.169695:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd54c5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54c62 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169700:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250813ede00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788891247.169703:0:24301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd54c5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd54c62 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169710:0:24301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd54c5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd54c62 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891247.169717:0:24301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd54c5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd54c62 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891247.169829:0:24301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788891247.169843:0:24301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd54c5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54c62 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169848:0:24301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788891247.169864:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd54c5b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54c62 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169870:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250813ede00/0xa66601b03fd54c5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54c62 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169879:0:24301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891247.169882:0:24301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd54c4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa66601b03fd54c54 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169887:0:24301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5c00 already unused, calling callback (ffffffffc13fbc20) 10000000:00010000:1.0:1788891247.169890:0:24301:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd54c4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa66601b03fd54c54 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169896:0:24301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd54c4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa66601b03fd54c54 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891247.169901:0:24301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd54c4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa66601b03fd54c54 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891247.169906:0:24301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788891247.169917:0:24301:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd54c4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54c54 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169924:0:24301:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788891247.169936:0:24301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd54c4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54c54 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169943:0:24301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff9250baae5c00/0xa66601b03fd54c4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa66601b03fd54c54 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.169956:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891247.169958:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891247.169959:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891247.169967:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891247.169986:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf73aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad5d36d9-7941-4f84-88d2-361333de6068:3627:1875787997478144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891247.170018:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891247.170044:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788891247.170049:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad5d36d9-7941-4f84-88d2-361333de6068:3627:1875787997478272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891247.170069:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891247.170094:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bf739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad5d36d9-7941-4f84-88d2-361333de6068:3629:1875787997478400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891247.170116:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891247.170134:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788891247.170139:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad5d36d9-7941-4f84-88d2-361333de6068:3629:1875787997478528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891247.170158:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891247.170183:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997478144 00000100:00100000:1.0:1788891247.170188:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997478144 00010000:00010000:1.0:1788891247.170209:0:22760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250baae4000/0xa66601b03fd54e1b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54e14 expref: 24 pid: 22765 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891247.170225:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997478272 00000100:00100000:1.0:1788891247.170228:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997478272 00010000:00010000:1.0:1788891247.170239:0:22760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff925091a8a000/0xa66601b03fd54ca1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54c9a expref: 25 pid: 22767 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891247.170262:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997478400 00000100:00100000:1.0:1788891247.170265:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997478400 00010000:00010000:1.0:1788891247.170277:0:22760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250813ec400/0xa66601b03fd54c62 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54c5b expref: 26 pid: 22767 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891247.170286:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997478528 00000100:00100000:1.0:1788891247.170288:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997478528 00010000:00010000:1.0:1788891247.170298:0:22760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250813ed200/0xa66601b03fd54c54 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54c4d expref: 27 pid: 22765 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891247.170310:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788891247.170316:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad5d36d9-7941-4f84-88d2-361333de6068+27:3627:x1875787997478144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891247.170327:0:22760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891247.170333:0:22760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250baae4000/0xa66601b03fd54e1b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54e14 expref: 27 pid: 22765 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.170342:0:22760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250baae4000/0xa66601b03fd54e1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd54e14 expref: 27 pid: 22765 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.170359:0:22760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891247.170387:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad5d36d9-7941-4f84-88d2-361333de6068+27:3627:x1875787997478144:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891247.170392:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788891247.170405:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788891247.170410:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad5d36d9-7941-4f84-88d2-361333de6068+26:3627:x1875787997478272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891247.170418:0:22760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891247.170422:0:22760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff925091a8a000/0xa66601b03fd54ca1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54c9a expref: 26 pid: 22767 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.170440:0:22760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff925091a8a000/0xa66601b03fd54ca1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd54c9a expref: 26 pid: 22767 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.170449:0:22760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891247.170472:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad5d36d9-7941-4f84-88d2-361333de6068+26:3627:x1875787997478272:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891247.170479:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788891247.170491:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788891247.170497:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad5d36d9-7941-4f84-88d2-361333de6068+25:3629:x1875787997478400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891247.170504:0:22760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891247.170542:0:22760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250813ec400/0xa66601b03fd54c62 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54c5b expref: 25 pid: 22767 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.170551:0:22760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250813ec400/0xa66601b03fd54c62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd54c5b expref: 25 pid: 22767 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.170561:0:22760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891247.170587:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad5d36d9-7941-4f84-88d2-361333de6068+25:3629:x1875787997478400:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891247.170593:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788891247.170605:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788891247.170611:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad5d36d9-7941-4f84-88d2-361333de6068+24:3629:x1875787997478528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891247.170618:0:22760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891247.170622:0:22760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250813ed200/0xa66601b03fd54c54 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa66601b03fd54c4d expref: 24 pid: 22765 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.170630:0:22760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250813ed200/0xa66601b03fd54c54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa66601b03fd54c4d expref: 24 pid: 22765 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.170644:0:22760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891247.170666:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad5d36d9-7941-4f84-88d2-361333de6068+24:3629:x1875787997478528:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891247.170672:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788891247.170693:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891247.170714:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad5d36d9-7941-4f84-88d2-361333de6068:3629:1875787997478528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891247.171029:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad5d36d9-7941-4f84-88d2-361333de6068:3629:1875787997478400:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891247.171369:0:25796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250baae4000/0xa66601b03fd54e1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd54e14 expref: 23 pid: 22765 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891247.171382:0:25796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1875787997477632:0@lo:104: 00010000:00010000:2.0:1788891247.171392:0:25796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff925091a8a000/0xa66601b03fd54ca1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd54c9a expref: 22 pid: 22767 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891247.171411:0:25796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83149f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1875787997477760:0@lo:104: 00010000:00010000:2.0:1788891247.171421:0:25796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813ec400/0xa66601b03fd54c62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd54c5b expref: 21 pid: 22767 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891247.171428:0:25796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1875787997477888:0@lo:104: 00010000:00010000:2.0:1788891247.171437:0:25796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250813ed200/0xa66601b03fd54c54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa66601b03fd54c4d expref: 20 pid: 22765 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891247.171444:0:25796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f8314b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1875787997478016:0@lo:104: 00000100:00100000:1.0:1788891247.172187:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad5d36d9-7941-4f84-88d2-361333de6068:3627:1875787997478272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891247.172198:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bf73aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad5d36d9-7941-4f84-88d2-361333de6068:3627:1875787997478144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891247.174089:0:25796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1875787997477376:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891247.174105:0:25796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1875787997477504:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891247.174145:0:25796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92508587ba00/0xa66601b03fd54ff0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891247.174397:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891247.174567:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891247.175020:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987978496 00000100:00100000:1.0:1788891247.175027:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987978496 00010000:00010000:1.0:1788891247.175064:0:22760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92508587a000/0xa66601b03fd54fbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de528 expref: 13 pid: 22768 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891247.175103:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987978624 00000100:00100000:1.0:1788891247.175107:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987978624 00010000:00010000:1.0:1788891247.175119:0:22760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54f80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de4b8 expref: 14 pid: 22767 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891247.175132:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:1.0:1788891247.175140:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925086ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+14:2393:x1875787987978496:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891247.175153:0:22760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891247.175158:0:22760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92508587a000/0xa66601b03fd54fbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de528 expref: 14 pid: 22768 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.175180:0:22760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92508587a000/0xa66601b03fd54fbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de528 expref: 14 pid: 22768 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.175198:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92508587a000/0xa66601b03fd54fbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de528 expref: 14 pid: 22768 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.175211:0:22760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891247.175271:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925086ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+13:2393:x1875787987978496:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 131us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891247.175279:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 13 00000100:00100000:1.0:1788891247.175328:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 14 00000100:00100000:1.0:1788891247.175334:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250ba075180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+12:2393:x1875787987978624:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891247.175342:0:22760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891247.175346:0:22760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54f80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de4b8 expref: 12 pid: 22767 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.175355:0:22760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54f80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de4b8 expref: 12 pid: 22767 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.175366:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9250b69c6c00/0xa66601b03fd54f80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de4b8 expref: 12 pid: 22767 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.175376:0:22760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92508587ba00/0xa66601b03fd54ff0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.175385:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92508587ba00/0xa66601b03fd54ff0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.175409:0:22760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92508587ba00/0xa66601b03fd54ff0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.175416:0:22760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92508587ba00/0xa66601b03fd54ff0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.175423:0:22760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92508587ba00/0xa66601b03fd54ff0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.175428:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92508587ba00/0xa66601b03fd54ff0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.175434:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587ba00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891247.175439:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92508587ba00/0xa66601b03fd54ff0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.175447:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92508587ba00/0xa66601b03fd54ff0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.175458:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92508587ba00/0xa66601b03fd54ff0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891247.175468:0:22760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891247.175488:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250ba075180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+11:2393:x1875787987978624:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 154us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891247.175494:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 14 00010000:00010000:2.0:1788891247.175617:0:25796:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92508587ba00/0xa66601b03fd54ff0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891247.175626:0:25796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92508587ba00/0xa66601b03fd54ff0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891247.175633:0:25796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92508587ba00/0xa66601b03fd54ff0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788891247.421817:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788891247.572998:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891247.573047:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891247.573083:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891247.573133:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891247.573158:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891247.573174:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891247.573189:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891247.573205:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891247.573227:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891247.573257:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987979520 00000100:00100000:0.0:1788891247.573257:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987979008 00000100:00100000:1.0:1788891247.573267:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987979520 00000100:00100000:0.0:1788891247.573267:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987979008 00000100:00100000:3.0:1788891247.573332:0:24371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987979264 00000100:00100000:3.0:1788891247.573337:0:24371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987979264 00000100:00100000:1.0:1788891247.573392:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987978880 00000100:00100000:1.0:1788891247.573396:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987978880 00000100:00100000:2.0:1788891247.573483:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987978752 00000100:00100000:2.0:1788891247.573487:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987978752 00000100:00100000:2.0:1788891247.573577:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 141 00000100:00100000:2.0:1788891247.573588:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+11:2393:x1875787987978752:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788891247.573662:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+11:2393:x1875787987978752:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 75us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891247.573682:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 141 00000100:00100000:2.0:1788891247.573718:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987979776 00000100:00100000:2.0:1788891247.573722:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987979776 00000100:00100000:0.0:1788891247.575400:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987979392 00000100:00100000:0.0:1788891247.575409:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987979392 00000100:00100000:0.0:1788891247.575431:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:0.0:1788891247.575440:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:764a7f30-db7e-4ef5-b540-d95fb3bdda52+5:2393:x1875787987979520:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891247.575509:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:764a7f30-db7e-4ef5-b540-d95fb3bdda52+5:2393:x1875787987979520:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 60us (2365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891247.575516:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:0.0:1788891247.575551:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:0.0:1788891247.575558:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+5:2393:x1875787987979008:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891247.575583:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+5:2393:x1875787987979008:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 26us (2536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891247.575588:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:0.0:1788891247.575600:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:0.0:1788891247.575605:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:2393:x1875787987979392:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891247.575628:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:2393:x1875787987979392:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 22us (2423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891247.575634:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00080000:0.0:1788891247.575658:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788891247.575663:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788891247.575666:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788891247.575858:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987979136 00000100:00100000:0.0:1788891247.575863:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987979136 00000100:00100000:0.0:1788891247.575903:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987979648 00000100:00100000:0.0:1788891247.575907:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987979648 00000100:00100000:0.0:1788891247.575923:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:0.0:1788891247.575941:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+5:2393:x1875787987979136:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891247.575988:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+5:2393:x1875787987979136:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 48us (2797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891247.576003:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:0.0:1788891247.576017:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:0.0:1788891247.576024:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:764a7f30-db7e-4ef5-b540-d95fb3bdda52+5:2393:x1875787987979648:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:0.0:1788891247.576046:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:764a7f30-db7e-4ef5-b540-d95fb3bdda52+5:2393:x1875787987979648:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 23us (2818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891247.576052:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00080000:0.0:1788891247.576109:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788891247.580438:0:24371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:3.0:1788891247.580455:0:24371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+5:2393:x1875787987979264:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:3.0:1788891247.580579:0:24371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+5:2393:x1875787987979264:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 129us (7494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891247.580605:0:24371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:1.0:1788891247.581160:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:1.0:1788891247.581172:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+6:2393:x1875787987978880:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:1.0:1788891247.581224:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+6:2393:x1875787987978880:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 56us (8048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891247.581230:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:2.0:1788891247.581594:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:2.0:1788891247.581605:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:764a7f30-db7e-4ef5-b540-d95fb3bdda52+5:2393:x1875787987979776:12345-192.168.204.26@tcp:400:kworker.0 00000100:00100000:2.0:1788891247.581639:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:764a7f30-db7e-4ef5-b540-d95fb3bdda52+5:2393:x1875787987979776:12345-192.168.204.26@tcp:400:kworker.0 Request processed in 37us (8480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891247.581645:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:0.0:1788891248.093073:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891248.093182:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987979904 00000100:00100000:2.0:1788891248.093194:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987979904 00000100:00100000:2.0:1788891248.093291:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:2.0:1788891248.093303:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250ba076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+6:18845:x1875787987979904:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891248.093324:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891248.093345:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ba00/0xa66601b03fd54ff7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de560 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093419:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b800/0xa66601b03fd54ffe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093436:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b800/0xa66601b03fd54ffe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093452:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b800/0xa66601b03fd54ffe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093481:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b600/0xa66601b03fd55005 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093514:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b600/0xa66601b03fd55005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093558:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b600/0xa66601b03fd55005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093646:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b200/0xa66601b03fd5500c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093654:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b200/0xa66601b03fd5500c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093661:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b200/0xa66601b03fd5500c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891248.093693:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788891248.093697:0:22772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788891248.093737:0:22772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b200/0xa66601b03fd5500c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093748:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b800/0xa66601b03fd54ffe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093755:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b800/0xa66601b03fd54ffe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093761:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b800/0xa66601b03fd54ffe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093767:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587b800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891248.093771:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b800/0xa66601b03fd54ffe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093785:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b800/0xa66601b03fd54ffe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093797:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e34100) 00010000:00010000:2.0:1788891248.093801:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891248.093805:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b800/0xa66601b03fd54ffe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093811:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b800/0xa66601b03fd54ffe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093825:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b600/0xa66601b03fd55005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093831:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b600/0xa66601b03fd55005 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093837:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b600/0xa66601b03fd55005 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093842:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587b600 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891248.093844:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b600/0xa66601b03fd55005 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093850:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b600/0xa66601b03fd55005 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093857:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff925083c80400) 00010000:00010000:2.0:1788891248.093860:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891248.093863:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b600/0xa66601b03fd55005 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093891:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b600/0xa66601b03fd55005 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093930:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ba00/0xa66601b03fd54ff7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de560 expref: 8 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093949:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587b200/0xa66601b03fd5500c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de560 expref: 7 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.093956:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff925083c80c00) 00010000:00010000:2.0:1788891248.093959:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788891248.093964:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92508587b200, rc 0) 00000100:00100000:2.0:1788891248.094040:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250ba076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+7:18845:x1875787987979904:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 738us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891248.094049:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 23 00000100:00100000:0.0:1788891248.097902:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.098087:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987980032 00000100:00100000:3.0:1788891248.098099:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987980032 00000100:00100000:3.0:1788891248.098172:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:3.0:1788891248.098184:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250ba077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:413079f8-dd2b-438f-8f6c-c06cd5265027+7:18845:x1875787987980032:12345-192.168.204.26@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788891248.098825:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250ba077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:413079f8-dd2b-438f-8f6c-c06cd5265027+7:18845:x1875787987980032:12345-192.168.204.26@tcp:900:lhsmtool_posix.0 Request processed in 640us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891248.098834:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:1.0:1788891248.108968:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891248.109103:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987980288 00000100:00100000:0.0:1788891248.109114:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987980288 00000100:00100000:0.0:1788891248.109178:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:0.0:1788891248.109190:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+7:18845:x1875787987980288:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788891248.109212:0:22774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891248.109234:0:22774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd55013 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de567 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.109310:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5501a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.109325:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5501a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.109337:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5501a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.109366:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd55021 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.109373:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd55021 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.109380:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd55021 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.109500:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9a00/0xa66601b03fd55028 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.109510:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9a00/0xa66601b03fd55028 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.109547:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9a00/0xa66601b03fd55028 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891248.109559:0:22774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788891248.110961:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5501a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.110974:0:22774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5501a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.110981:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5501a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.110987:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a9e00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891248.110992:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5501a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.111015:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5501a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.111029:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff925083c80c00) 00010000:00010000:0.0:1788891248.111032:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891248.111038:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5501a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.111044:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5501a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.111059:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd55021 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.111064:0:22774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd55021 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.111069:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd55021 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.111074:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a8400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891248.111077:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd55021 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.111082:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd55021 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.111089:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9250c130b300) 00010000:00010000:0.0:1788891248.111092:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891248.111095:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd55021 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.111111:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd55021 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.112562:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd55013 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de567 expref: 10 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.112581:0:22774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9a00/0xa66601b03fd55028 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de567 expref: 9 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.112589:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9250c130b200) 00010000:00010000:0.0:1788891248.112592:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891248.112595:0:22774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f820a9a00, rc 0) 00000100:00100000:0.0:1788891248.112958:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+9:18845:x1875787987980288:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 3768us (3999us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788891248.112968:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:0.0:1788891248.122180:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.123075:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987980416 00000100:00100000:3.0:1788891248.123091:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987980416 00000100:00100000:3.0:1788891248.123237:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:3.0:1788891248.123250:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250ba076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+9:18845:x1875787987980416:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788891248.123410:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250ba076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+9:18845:x1875787987980416:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 Request processed in 163us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891248.123418:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:2.0:1788891248.131244:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891248.131376:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987980544 00000100:00100000:1.0:1788891248.131390:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987980544 00000100:00100000:1.0:1788891248.131567:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 26 00000100:00100000:1.0:1788891248.131581:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+5:18845:x1875787987980544:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1788891248.134049:0:22773:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2403us 00000100:00100000:0.0:1788891248.151507:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+5:18845:x1875787987980544:12345-192.168.204.26@tcp:59:lhsmtool_posix.0 Request processed in 19902us (20250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891248.151550:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 26 00000100:00100000:0.0:1788891248.152581:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.152788:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987980672 00000100:00100000:3.0:1788891248.152799:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987980672 00000100:00100000:3.0:1788891248.153059:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:3.0:1788891248.153071:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250ba077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+9:18851:x1875787987980672:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891248.153096:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891248.153132:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55036 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de56e expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153226:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5503d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153694:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5503d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153711:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5503d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153732:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55044 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153739:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55044 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153745:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55044 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153817:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5503d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153834:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5503d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153841:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5503d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153848:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891248.153853:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5503d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153862:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5503d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153877:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e34100) 00010000:00010000:3.0:1788891248.153888:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891248.153895:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5503d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153901:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5503d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153914:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55044 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153919:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55044 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153925:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55044 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153929:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891248.153932:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55044 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153938:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55044 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153945:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9250b65ef900) 00010000:00010000:3.0:1788891248.153947:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891248.153950:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55044 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.153954:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55044 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.154000:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55036 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de56e expref: 10 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.154019:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e34100) 00010000:00010000:3.0:1788891248.154022:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891248.154025:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55036 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de56e expref: 10 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.154034:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8b800, rc 0) 00000100:00100000:3.0:1788891248.154109:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250ba077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+9:18851:x1875787987980672:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1040us (1533us total) trans 0 rc 301/301 00000100:00100000:3.0:1788891248.154118:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:0.0:1788891248.158949:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891248.159086:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987980800 00000100:00100000:1.0:1788891248.159099:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987980800 00000100:00100000:1.0:1788891248.159327:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:1.0:1788891248.159342:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250ba074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:413079f8-dd2b-438f-8f6c-c06cd5265027+9:18851:x1875787987980800:12345-192.168.204.26@tcp:700:lfs.0 00000100:00100000:1.0:1788891248.159753:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250ba074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:413079f8-dd2b-438f-8f6c-c06cd5265027+9:18851:x1875787987980800:12345-192.168.204.26@tcp:700:lfs.0 Request processed in 183us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891248.159777:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:2.0:1788891248.164017:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891248.164125:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987981056 00000100:00100000:0.0:1788891248.164138:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987981056 00000100:00100000:0.0:1788891248.164247:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:0.0:1788891248.164259:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+9:18851:x1875787987981056:12345-192.168.204.26@tcp:36:lfs.0 00010000:00010000:0.0:1788891248.164352:0:22774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891248.164408:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd54faa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de4e9 expref: 9 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.164431:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e34100) 00010000:00010000:0.0:1788891248.164437:0:22774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788891248.164552:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5504b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.164564:0:22774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd54fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de559 expref: 5 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.164571:0:22774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5504b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.164604:0:22774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd54fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de559 expref: 5 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.164614:0:22774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd54fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de559 expref: 5 pid: 22773 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891248.164628:0:22774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250ba076300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22774:1875787997478656:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891248.164734:0:22774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250908c6900 going to sleep for 11 seconds 00000100:00100000:1.0:1788891248.168334:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891248.168481:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987981184 00000100:00100000:2.0:1788891248.168508:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987981184 00010000:00010000:2.0:1788891248.168590:0:22760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd54fe9 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de559 expref: 6 pid: 22773 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891248.168642:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 15 00000100:00100000:2.0:1788891248.168655:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:2393:x1875787987981184:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891248.168692:0:22760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891248.168701:0:22760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd54fe9 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de559 expref: 6 pid: 22773 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.168737:0:22760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd54fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de559 expref: 6 pid: 22773 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.168768:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e34100) 00010000:00010000:2.0:1788891248.168775:0:22760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5504b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.168787:0:22760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5504b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.168795:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5504b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.169321:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd54fe9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de559 expref: 6 pid: 22773 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891248.169505:0:22774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250ba076300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22774:1875787997478656:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788891248.169665:0:22774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5504b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.169692:0:22774:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5504b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.169698:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5504b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.169728:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9000/0xa66601b03fd55052 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.169740:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9000/0xa66601b03fd55052 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.169748:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9000/0xa66601b03fd55052 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.170068:0:22760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891248.170162:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:764a7f30-db7e-4ef5-b540-d95fb3bdda52+5:2393:x1875787987981184:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 1507us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891248.170174:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 15 00010000:00010000:0.0:1788891248.171943:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9c00/0xa66601b03fd55059 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.171972:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9c00/0xa66601b03fd55059 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.171985:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9c00/0xa66601b03fd55059 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788891248.172012:0:22774:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c657c425 reply state 000000006f6f75af transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9c00/0xa66601b03fd55059 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.172025:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9c00/0xa66601b03fd55059 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.172034:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9250c130bd00) 00010000:00010000:0.0:1788891248.172044:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788891248.172049:0:22774:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788891248.172059:0:22774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788891248.172070:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5504b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.172078:0:22774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5504b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.172085:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5504b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.172091:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a9e00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891248.172097:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5504b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.172106:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5504b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.172120:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924f82e34100) 00010000:00010000:0.0:1788891248.172123:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891248.172126:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5504b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.172132:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5504b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788891248.172155:0:22774:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c657c425 reply state 000000006f6f75af transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9000/0xa66601b03fd55052 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.172165:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9000/0xa66601b03fd55052 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.172185:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9250c130b300) 00010000:00010000:0.0:1788891248.172187:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788891248.172189:0:22774:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788891248.172317:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+10:18851:x1875787987981056:12345-192.168.204.26@tcp:36:lfs.0 Request processed in 8055us (8311us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788891248.172327:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 28 00010000:00010000:1.0:1788891248.189354:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891248.234888:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891248.235103:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987981312 00000100:00100000:0.0:1788891248.235114:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987981312 00000100:00100000:0.0:1788891248.235184:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:0.0:1788891248.235194:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+10:18859:x1875787987981312:12345-192.168.204.26@tcp:101:lctl.0 00010000:00010000:0.0:1788891248.235219:0:24370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891248.235244:0:24370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd55060 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de575 expref: -99 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.235373:0:24370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8600/0xa66601b03fd55067 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.235386:0:24370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8600/0xa66601b03fd55067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.235397:0:24370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8600/0xa66601b03fd55067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891248.235442:0:24370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788891248.235445:0:24370:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788891248.235497:0:24370:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8600/0xa66601b03fd55067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.235837:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd55060 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de575 expref: 12 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.235875:0:24370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8600/0xa66601b03fd55067 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de575 expref: 11 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.235884:0:24370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250c130b500) 00010000:00010000:0.0:1788891248.235887:0:24370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788891248.235891:0:24370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f820a8600, rc 0) 00000100:00100000:2.0:1788891248.236181:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+11:18859:x1875787987981312:12345-192.168.204.26@tcp:101:lctl.0 Request processed in 986us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891248.236190:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:2.0:1788891248.255926:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891248.256040:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987981440 00000100:00100000:1.0:1788891248.256050:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987981440 00000100:00100000:1.0:1788891248.256115:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:1.0:1788891248.256126:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:764a7f30-db7e-4ef5-b540-d95fb3bdda52+5:18860:x1875787987981440:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:1.0:1788891248.256158:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891248.256190:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5506e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de57c expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.256257:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6000/0xa66601b03fd55075 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.256271:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6000/0xa66601b03fd55075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.256285:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6000/0xa66601b03fd55075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891248.256338:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788891248.256353:0:22773:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788891248.256376:0:22773:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6000/0xa66601b03fd55075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.256401:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5506e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de57c expref: 7 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.256434:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6000/0xa66601b03fd55075 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de57c expref: 6 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.256442:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250c130b500) 00010000:00010000:1.0:1788891248.256445:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788891248.256448:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6000, rc 0) 00000100:00100000:1.0:1788891248.256571:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:18860:x1875787987981440:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 446us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891248.256579:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:1.0:1788891248.259238:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.259444:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987981568 00000100:00100000:3.0:1788891248.259454:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987981568 00000100:00100000:3.0:1788891248.259566:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:3.0:1788891248.259576:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:764a7f30-db7e-4ef5-b540-d95fb3bdda52+6:18860:x1875787987981568:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891248.259596:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891248.259617:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd5507c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de583 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.259695:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55083 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.259709:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55083 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.259720:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55083 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.259730:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5508a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.259751:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5508a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.259758:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5508a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.259845:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd55091 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.259866:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd55091 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.259872:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd55091 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891248.259907:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788891248.259911:0:22772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891248.259930:0:22772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd55091 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.259941:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55083 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.259947:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55083 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.259952:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55083 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.259957:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891248.259960:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55083 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.259972:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55083 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.259983:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250c130b500) 00010000:00010000:3.0:1788891248.259985:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891248.259989:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55083 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.259994:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd55083 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.260006:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5508a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.260011:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5508a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.260016:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5508a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.260019:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891248.260021:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5508a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.260025:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5508a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.260030:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9250c130b300) 00010000:00010000:3.0:1788891248.260032:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891248.260034:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5508a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.260247:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd5508a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.260273:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd5507c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de583 expref: 8 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.260285:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd55091 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de583 expref: 7 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.260292:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9250c130bd00) 00010000:00010000:3.0:1788891248.260294:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788891248.260297:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8a200, rc 0) 00000100:00100000:3.0:1788891248.260357:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:764a7f30-db7e-4ef5-b540-d95fb3bdda52+7:18860:x1875787987981568:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 783us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891248.260365:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 31 00000100:00100000:2.0:1788891248.262927:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.263045:0:22784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987981696 00000100:00100000:3.0:1788891248.263055:0:22784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987981696 00000100:00100000:3.0:1788891248.263117:0:22784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:3.0:1788891248.263126:0:22784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:764a7f30-db7e-4ef5-b540-d95fb3bdda52+5:18860:x1875787987981696:12345-192.168.204.26@tcp:900:lfs.0 00000100:00100000:3.0:1788891248.263226:0:22784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:764a7f30-db7e-4ef5-b540-d95fb3bdda52+5:18860:x1875787987981696:12345-192.168.204.26@tcp:900:lfs.0 Request processed in 101us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891248.263234:0:22784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:0.0:1788891248.267366:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.267458:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987981952 00000100:00100000:3.0:1788891248.267469:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987981952 00000100:00100000:3.0:1788891248.267580:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:3.0:1788891248.267592:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250ba076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:764a7f30-db7e-4ef5-b540-d95fb3bdda52+7:18860:x1875787987981952:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891248.267634:0:22774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891248.267671:0:22774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55098 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de58a expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891248.267776:0:22774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788891248.267897:0:22774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55098 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de58a expref: 9 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.267913:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250c130b500) 00010000:00010000:3.0:1788891248.267916:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891248.267921:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55098 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de58a expref: 9 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.267936:0:22774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8b800, rc 0) 00000100:00100000:3.0:1788891248.268003:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250ba076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:764a7f30-db7e-4ef5-b540-d95fb3bdda52+8:18860:x1875787987981952:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 414us (647us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1788891248.268010:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 32 00000100:00100000:1.0:1788891248.271597:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.271712:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987982208 00000100:00100000:3.0:1788891248.271725:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987982208 00000100:00100000:3.0:1788891248.271798:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:3.0:1788891248.271809:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:764a7f30-db7e-4ef5-b540-d95fb3bdda52+8:18860:x1875787987982208:12345-192.168.204.26@tcp:36:lfs.0 00010000:00010000:3.0:1788891248.271879:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891248.271910:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd55091 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de583 expref: 8 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.271930:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9250c130bd00) 00010000:00010000:3.0:1788891248.271935:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788891248.271976:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd550a6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.271990:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd550a6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.272000:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd550a6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788891248.272342:0:22772:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c30ee306 reply state 0000000096c25557 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd550a6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.272356:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd550a6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.272363:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9250c130bd00) 00010000:00010000:3.0:1788891248.272365:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788891248.272368:0:22772:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788891248.272377:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788891248.272455:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:764a7f30-db7e-4ef5-b540-d95fb3bdda52+9:18860:x1875787987982208:12345-192.168.204.26@tcp:36:lfs.0 Request processed in 648us (869us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788891248.272463:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 33 00000100:00100000:2.0:1788891248.274959:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891248.275247:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987982464 00000100:00100000:0.0:1788891248.275258:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987982464 00000100:00100000:0.0:1788891248.275318:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:0.0:1788891248.275328:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:764a7f30-db7e-4ef5-b540-d95fb3bdda52+9:18860:x1875787987982464:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788891248.275790:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:764a7f30-db7e-4ef5-b540-d95fb3bdda52+10:18860:x1875787987982464:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 462us (838us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788891248.275799:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:0.0:1788891248.281481:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.281924:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987982720 00000100:00100000:3.0:1788891248.281937:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987982720 00000100:00100000:3.0:1788891248.282045:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:3.0:1788891248.282058:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250ba076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:764a7f30-db7e-4ef5-b540-d95fb3bdda52+10:18860:x1875787987982720:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891248.282082:0:22774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891248.282104:0:22774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd550ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de591 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282192:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd550b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282222:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd550b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282233:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd550b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282247:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd550bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282255:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd550bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282262:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd550bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891248.282365:0:22774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788891248.282442:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd550b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282450:0:22774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd550b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282456:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd550b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282461:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891248.282466:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd550b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282474:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd550b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282509:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250c130b500) 00010000:00010000:3.0:1788891248.282512:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891248.282518:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd550b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282549:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd550b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282562:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd550bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282569:0:22774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd550bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282575:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd550bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282580:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891248.282584:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd550bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282590:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd550bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282597:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9250c130b300) 00010000:00010000:3.0:1788891248.282599:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891248.282602:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd550bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282608:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd550bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282926:0:22774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd550ad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de591 expref: 12 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282941:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250c130b500) 00010000:00010000:3.0:1788891248.282943:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891248.282947:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd550ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de591 expref: 12 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.282957:0:22774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8a200, rc 0) 00000100:00100000:3.0:1788891248.283079:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250ba076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:764a7f30-db7e-4ef5-b540-d95fb3bdda52+11:18860:x1875787987982720:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1023us (1608us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1788891248.283087:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 34 00000100:00100000:1.0:1788891248.288048:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891248.288206:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987982848 00000100:00100000:2.0:1788891248.288218:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987982848 00000100:00100000:2.0:1788891248.288274:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:2.0:1788891248.288284:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:764a7f30-db7e-4ef5-b540-d95fb3bdda52+11:18860:x1875787987982848:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:2.0:1788891248.288325:0:24370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891248.288346:0:24370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a600/0xa66601b03fd550c9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de598 expref: -99 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.288454:0:24370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd550d0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.288468:0:24370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd550d0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.288479:0:24370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd550d0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891248.288517:0:24370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788891248.288541:0:24370:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788891248.288568:0:24370:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd550d0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.288596:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a600/0xa66601b03fd550c9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de598 expref: 13 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.288615:0:24370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd550d0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de598 expref: 12 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891248.288624:0:24370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9250c130bd00) 00010000:00010000:2.0:1788891248.288627:0:24370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788891248.288631:0:24370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92508587be00, rc 0) 00000100:00100000:2.0:1788891248.289102:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:764a7f30-db7e-4ef5-b540-d95fb3bdda52+12:18860:x1875787987982848:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 817us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891248.289110:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 35 00000100:00100000:2.0:1788891248.295989:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891248.296157:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987982976 00000100:00100000:1.0:1788891248.296167:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987982976 00000100:00100000:1.0:1788891248.296222:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:1.0:1788891248.296232:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:764a7f30-db7e-4ef5-b540-d95fb3bdda52+12:18860:x1875787987982976:12345-192.168.204.26@tcp:37:lfs.0 00000100:00100000:0.0:1788891248.301583:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:764a7f30-db7e-4ef5-b540-d95fb3bdda52+12:18860:x1875787987982976:12345-192.168.204.26@tcp:37:lfs.0 Request processed in 5341us (5594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891248.301607:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 3 00000100:00100000:2.0:1788891248.305603:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891248.305760:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987983232 00000100:00100000:0.0:1788891248.305772:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987983232 00000100:00100000:0.0:1788891248.305903:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:0.0:1788891248.305916:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92509182bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:764a7f30-db7e-4ef5-b540-d95fb3bdda52+12:18860:x1875787987983232:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788891248.306155:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92509182bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:764a7f30-db7e-4ef5-b540-d95fb3bdda52+13:18860:x1875787987983232:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 241us (562us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788891248.306180:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 4 00000100:00100000:2.0:1788891248.362092:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891248.362210:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987983360 00000100:00100000:1.0:1788891248.362222:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987983360 00000100:00100000:1.0:1788891248.362289:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:1.0:1788891248.362300:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+11:18866:x1875787987983360:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:1.0:1788891248.362325:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891248.362359:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6c00/0xa66601b03fd550d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de59f expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362443:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd550de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362477:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd550de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362500:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd550de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362514:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd550e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362569:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd550e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362577:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd550e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362665:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd550ec lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362675:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd550ec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362683:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd550ec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891248.362833:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788891248.362837:0:22773:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788891248.362878:0:22773:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd550ec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362892:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd550de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362909:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd550de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362916:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd550de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362922:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c7800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891248.362926:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd550de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362934:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd550de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362946:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250c130b500) 00010000:00010000:1.0:1788891248.362949:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891248.362955:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd550de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362961:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd550de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362976:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd550e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362982:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd550e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362987:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd550e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.362992:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250b69c6400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:1.0:1788891248.363001:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd550e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.363008:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd550e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.363016:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9250c130b300) 00010000:00010000:1.0:1788891248.363018:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788891248.363175:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd550e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.363184:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6400/0xa66601b03fd550e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.363216:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6c00/0xa66601b03fd550d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de59f expref: 13 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.363229:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7e00/0xa66601b03fd550ec lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de59f expref: 12 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.363236:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9250c130bd00) 00010000:00010000:1.0:1788891248.363239:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788891248.363242:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7e00, rc 0) 00000100:00100000:1.0:1788891248.363313:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+12:18866:x1875787987983360:12345-192.168.204.26@tcp:101:bash.0 Request processed in 1014us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891248.363322:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 36 00000100:00100000:2.0:1788891248.369631:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.369783:0:22784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987983488 00000100:00100000:3.0:1788891248.369795:0:22784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987983488 00000100:00100000:3.0:1788891248.369905:0:22784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:3.0:1788891248.369917:0:22784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:413079f8-dd2b-438f-8f6c-c06cd5265027+5:18866:x1875787987983488:12345-192.168.204.26@tcp:900:bash.0 00000100:00100000:3.0:1788891248.370012:0:22784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:413079f8-dd2b-438f-8f6c-c06cd5265027+5:18866:x1875787987983488:12345-192.168.204.26@tcp:900:bash.0 Request processed in 97us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891248.370020:0:22784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:1.0:1788891248.379737:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891248.380679:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987983744 00000100:00100000:0.0:1788891248.380690:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987983744 00000100:00100000:0.0:1788891248.380756:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:0.0:1788891248.380767:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+12:18866:x1875787987983744:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:0.0:1788891248.380788:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891248.380810:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8e00/0xa66601b03fd550f3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de5a6 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.380928:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8a00/0xa66601b03fd550fa lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.380946:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd550d0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de598 expref: 12 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.380955:0:22772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8a00/0xa66601b03fd550fa lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.381019:0:22772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd550d0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de598 expref: 12 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.381034:0:22772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd550d0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de598 expref: 12 pid: 24370 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891248.381049:0:22772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bb784000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22772:1875787997478784:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891248.381150:0:22772:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250908c6300 going to sleep for 11 seconds 00000100:00100000:2.0:1788891248.389572:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891248.389722:0:22772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bb784000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22772:1875787997478784:192.168.204.26@tcp:104: 00010000:00010000:0.0:1788891248.389772:0:22772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8a00/0xa66601b03fd550fa lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891248.390563:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987983872 00000100:00100000:3.0:1788891248.390571:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987983872 00010000:00010000:3.0:1788891248.390607:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd550d0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de598 expref: 13 pid: 24370 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891248.390700:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 16 00000100:00100000:3.0:1788891248.390710:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:764a7f30-db7e-4ef5-b540-d95fb3bdda52+13:2394:x1875787987983872:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891248.390747:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891248.390755:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd550d0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de598 expref: 13 pid: 24370 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.390769:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd550d0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de598 expref: 13 pid: 24370 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.390795:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd550d0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de598 expref: 13 pid: 24370 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.390815:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9250c130bd00) 00010000:00010000:3.0:1788891248.390820:0:22759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8a00/0xa66601b03fd550fa lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.390831:0:22759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8a00/0xa66601b03fd550fa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.390839:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8a00/0xa66601b03fd550fa lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.390878:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891248.391026:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:764a7f30-db7e-4ef5-b540-d95fb3bdda52+12:2394:x1875787987983872:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 315us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891248.391035:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 16 00010000:00010000:0.0:1788891248.392314:0:22772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8a00/0xa66601b03fd550fa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.392332:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8a00/0xa66601b03fd550fa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.392364:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9200/0xa66601b03fd55101 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.392378:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9200/0xa66601b03fd55101 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.392388:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9200/0xa66601b03fd55101 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.393011:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55108 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.393022:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55108 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.393030:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55108 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891248.393042:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788891248.393073:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8a00/0xa66601b03fd550fa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.393081:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8a00/0xa66601b03fd550fa lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.393107:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8a00/0xa66601b03fd550fa lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.393113:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a8a00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891248.393118:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8a00/0xa66601b03fd550fa lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.393126:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8a00/0xa66601b03fd550fa lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.393141:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9250c130bd00) 00010000:00010000:0.0:1788891248.393145:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891248.393150:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8a00/0xa66601b03fd550fa lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.393157:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8a00/0xa66601b03fd550fa lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788891248.393173:0:22772:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087e483d8 reply state 00000000f337e109 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9200/0xa66601b03fd55101 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.393186:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9200/0xa66601b03fd55101 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.393192:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9250c130b900) 00010000:00010000:0.0:1788891248.393195:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788891248.393199:0:22772:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788891248.393238:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8e00/0xa66601b03fd550f3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5a6 expref: 15 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.393253:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55108 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5a6 expref: 14 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891248.393269:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:0.0:1788891248.393272:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788891248.393274:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f820a9600, rc 0) 00000100:00100000:0.0:1788891248.393354:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+15:18866:x1875787987983744:12345-192.168.204.26@tcp:101:bash.0 Request processed in 12588us (13627us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788891248.393364:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 37 00000100:00100000:2.0:1788891248.410229:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.410322:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987984000 00000100:00100000:3.0:1788891248.410333:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987984000 00000100:00100000:3.0:1788891248.410397:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:3.0:1788891248.410408:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+15:18866:x1875787987984000:12345-192.168.204.26@tcp:101:bash.0 00010000:00010000:3.0:1788891248.410453:0:22774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891248.410476:0:22774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd55116 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de5ad expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.410606:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd5511d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.410623:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd5511d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.410634:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd5511d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891248.410697:0:22774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788891248.410701:0:22774:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788891248.410723:0:22774:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd5511d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.410738:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd5511d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.410764:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd55116 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5ad expref: 17 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.410781:0:22774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd5511d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5ad expref: 16 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.410789:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:3.0:1788891248.410792:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788891248.410796:0:22774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8b000, rc 0) 00000100:00100000:3.0:1788891248.410873:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+16:18866:x1875787987984000:12345-192.168.204.26@tcp:101:bash.0 Request processed in 467us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891248.410881:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 38 00000100:00100000:1.0:1788891248.415754:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891248.416136:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987984256 00000100:00100000:0.0:1788891248.416148:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987984256 00000100:00100000:0.0:1788891248.416211:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 5 00000100:00100000:0.0:1788891248.416222:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+16:18866:x1875787987984256:12345-192.168.204.26@tcp:35:bash.0 00000100:00100000:0.0:1788891248.416677:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+17:18866:x1875787987984256:12345-192.168.204.26@tcp:35:bash.0 Request processed in 453us (928us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1788891248.416687:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 5 00000040:00080000:1.0:1788891248.445109:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788891248.479631:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.479780:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987984512 00000100:00100000:3.0:1788891248.479792:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987984512 00000100:00100000:3.0:1788891248.480088:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:3.0:1788891248.480099:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+17:18876:x1875787987984512:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891248.480128:0:24370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891248.480148:0:24370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd55124 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de5b4 expref: -99 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891248.480812:0:24370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788891248.481007:0:24370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd55124 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5b4 expref: 19 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.481024:0:24370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9250c130b500) 00010000:00010000:3.0:1788891248.481027:0:24370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891248.481033:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd55124 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5b4 expref: 19 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.481048:0:24370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8a200, rc 0) 00000100:00100000:3.0:1788891248.481120:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+18:18876:x1875787987984512:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 1022us (1499us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1788891248.481129:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 39 00000100:00100000:2.0:1788891248.486649:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891248.487360:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987984768 00000100:00100000:0.0:1788891248.487375:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987984768 00000100:00100000:0.0:1788891248.487450:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:0.0:1788891248.487460:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+18:18876:x1875787987984768:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788891248.487716:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+19:18876:x1875787987984768:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 256us (1084us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1788891248.487724:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 6 00000100:00100000:1.0:1788891248.533144:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.533265:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987985024 00000100:00100000:3.0:1788891248.533277:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987985024 00000100:00100000:3.0:1788891248.533377:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00100000:3.0:1788891248.533387:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+19:18879:x1875787987985024:12345-192.168.204.26@tcp:101:lfs.0 00010000:00010000:3.0:1788891248.533422:0:22774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891248.533444:0:22774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd55132 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de5bb expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.533604:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55139 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.533619:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55139 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.533631:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55139 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891248.533644:0:22774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788891248.533752:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd55132 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5bb expref: 22 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.533781:0:22774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55139 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5bb expref: 21 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.533791:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:3.0:1788891248.533794:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788891248.533797:0:22774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8b800, rc 0) 00000100:00100000:3.0:1788891248.533872:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+21:18879:x1875787987985024:12345-192.168.204.26@tcp:101:lfs.0 Request processed in 486us (737us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1788891248.533879:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 40 00000100:00100000:2.0:1788891248.538160:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.538232:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987985152 00000100:00100000:3.0:1788891248.538242:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987985152 00000100:00100000:3.0:1788891248.538606:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 41 00000100:00100000:3.0:1788891248.538633:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+21:18879:x1875787987985152:12345-192.168.204.26@tcp:54:lfs.0 00010000:00010000:3.0:1788891248.538814:0:24370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd55147 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.538834:0:24370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd55147 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.538917:0:24370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd55147 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.538955:0:24370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd55147 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.538962:0:24370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd55147 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.538969:0:24370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd55147 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.538976:0:24370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8ac00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891248.538982:0:24370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd55147 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.538991:0:24370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd55147 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.539003:0:24370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:3.0:1788891248.539007:0:24370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891248.539013:0:24370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd55147 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.539018:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd55147 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891248.539113:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+21:18879:x1875787987985152:12345-192.168.204.26@tcp:54:lfs.0 Request processed in 482us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891248.539121:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 41 00000100:00100000:2.0:1788891248.539286:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891248.539720:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987985280 00000100:00100000:1.0:1788891248.539728:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987985280 00000100:00100000:1.0:1788891248.539775:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:1.0:1788891248.539784:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+21:2394:x1875787987985280:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891248.539797:0:22760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891248.539825:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55139 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5bb expref: 21 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.539840:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:1.0:1788891248.539844:0:22760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891248.540033:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+20:2394:x1875787987985280:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 251us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891248.540041:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:1.0:1788891248.546162:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891248.546266:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987985536 00000100:00100000:0.0:1788891248.546278:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987985536 00000100:00100000:0.0:1788891248.546347:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:0.0:1788891248.546359:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+20:18879:x1875787987985536:12345-192.168.204.26@tcp:35:lfs.0 00000100:00100000:0.0:1788891248.547332:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+21:18879:x1875787987985536:12345-192.168.204.26@tcp:35:lfs.0 Request processed in 971us (1177us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1788891248.547342:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 7 00000100:00100000:2.0:1788891248.786786:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891248.787351:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987985792 00000100:00100000:1.0:1788891248.787363:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987985792 00000100:00100000:1.0:1788891248.787440:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:1.0:1788891248.787452:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f8314b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+21:18910:x1875787987985792:12345-192.168.204.26@tcp:101:cat.0 00010000:00010000:1.0:1788891248.787561:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891248.787585:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd5514e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de5c2 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.787695:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd55155 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.787709:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd55155 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.787739:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd55155 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891248.787751:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788891248.787900:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7800/0xa66601b03fd5514e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5c2 expref: 24 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.787920:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd55155 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5c2 expref: 23 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.787929:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:1.0:1788891248.787932:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788891248.787936:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c7400, rc 0) 00000100:00100000:1.0:1788891248.788014:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f8314b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+23:18910:x1875787987985792:12345-192.168.204.26@tcp:101:cat.0 Request processed in 563us (1254us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1788891248.788021:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 42 00000100:00100000:2.0:1788891248.796377:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891248.796423:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891248.796508:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987986176 00000100:00100000:1.0:1788891248.796518:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987986176 00000100:00100000:1.0:1788891248.796591:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:1.0:1788891248.796600:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+23:18910:x1875787987986176:12345-192.168.204.26@tcp:35:cat.0 00000100:00100000:1.0:1788891248.796912:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+24:18910:x1875787987986176:12345-192.168.204.26@tcp:35:cat.0 Request processed in 312us (545us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1788891248.796920:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 8 00000100:00100000:3.0:1788891248.797083:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987986048 00000100:00100000:3.0:1788891248.797088:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987986048 00000100:00100000:3.0:1788891248.797129:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:3.0:1788891248.797136:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+24:2391:x1875787987986048:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891248.797147:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891248.797168:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c7400/0xa66601b03fd55155 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5c2 expref: 24 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.797185:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:3.0:1788891248.797189:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891248.797206:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+23:2391:x1875787987986048:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 72us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891248.797212:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:2.0:1788891248.865256:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.865358:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987986432 00000100:00100000:3.0:1788891248.865369:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987986432 00000100:00100000:3.0:1788891248.865497:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:3.0:1788891248.865509:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+23:18916:x1875787987986432:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:3.0:1788891248.865567:0:24370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891248.865595:0:24370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd55163 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de5c9 expref: -99 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.865750:0:24370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5516a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.865783:0:24370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55108 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5a6 expref: 24 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.865794:0:24370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd5511d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5ad expref: 24 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.865803:0:24370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5516a lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.866008:0:24370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd5511d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5ad expref: 24 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.866025:0:24370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd5511d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5ad expref: 24 pid: 22774 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891248.866040:0:24370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24370:1875787997478912:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891248.866154:0:24370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55108 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5a6 expref: 24 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.866164:0:24370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55108 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5a6 expref: 24 pid: 22772 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891248.866173:0:24370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24370:1875787997479040:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788891248.866198:0:24370:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f8215b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891248.869002:0:24370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24370:1875787997478912:192.168.204.26@tcp:104: 00000100:00100000:3.0:1788891248.869022:0:24370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24370:1875787997479040:192.168.204.26@tcp:104: 00010000:00010000:3.0:1788891248.869067:0:24370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5516a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891248.874520:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891248.874605:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.874679:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987986560 00000100:00100000:3.0:1788891248.874689:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987986560 00010000:00010000:3.0:1788891248.874734:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd5511d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5ad expref: 25 pid: 22774 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891248.874772:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987986688 00000100:00100000:3.0:1788891248.874776:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987986688 00010000:00010000:3.0:1788891248.874789:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55108 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5a6 expref: 26 pid: 22772 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891248.874808:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:3.0:1788891248.874817:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84297800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+26:2393:x1875787987986560:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891248.874831:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891248.874849:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd5511d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5ad expref: 26 pid: 22774 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.874862:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd5511d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5ad expref: 26 pid: 22774 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.874885:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b000/0xa66601b03fd5511d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5ad expref: 26 pid: 22774 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.874901:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:3.0:1788891248.874907:0:22759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5516a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.874934:0:22759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5516a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.874941:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891248.875010:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84297800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+25:2393:x1875787987986560:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 192us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891248.875019:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 17 00000100:00100000:3.0:1788891248.875036:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 18 00000100:00100000:3.0:1788891248.875043:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925086ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+24:2394:x1875787987986688:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891248.875050:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891248.875056:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55108 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5a6 expref: 24 pid: 22772 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.875066:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55108 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5a6 expref: 24 pid: 22772 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.875078:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55108 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5a6 expref: 24 pid: 22772 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.875088:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:3.0:1788891248.875092:0:22759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5516a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.875099:0:22759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5516a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.875107:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5516a lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.875145:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891248.875167:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925086ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+23:2394:x1875787987986688:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 124us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891248.875173:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 18 00010000:00010000:3.0:1788891248.875225:0:24370:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5516a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.875233:0:24370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5516a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891248.875251:0:24370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788891248.875426:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8ac00/0xa66601b03fd55163 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5c9 expref: 24 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.875441:0:24370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a200/0xa66601b03fd5516a lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5c9 expref: 23 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.875448:0:24370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:3.0:1788891248.875451:0:24370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788891248.875453:0:24370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8a200, rc 0) 00000100:00100000:3.0:1788891248.875490:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+23:18916:x1875787987986432:12345-192.168.204.26@tcp:101:dd.0 Request processed in 9985us (10246us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1788891248.875498:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 43 00000100:00100000:2.0:1788891248.879394:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.879491:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987986816 00000100:00100000:3.0:1788891248.879501:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987986816 00000100:00100000:3.0:1788891248.879597:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 44 00000100:00100000:3.0:1788891248.879607:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+23:18916:x1875787987986816:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:3.0:1788891248.879661:0:22774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891248.879680:0:22774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd55178 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de5d0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.879715:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a000/0xa66601b03fd5517f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.879729:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a000/0xa66601b03fd5517f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.879740:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a000/0xa66601b03fd5517f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.880016:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a600/0xa66601b03fd55178 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5d0 expref: 25 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.880038:0:22774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a000/0xa66601b03fd5517f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5d0 expref: 24 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.880048:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:3.0:1788891248.880051:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788891248.880055:0:22774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8a000, rc 0) 00000100:00100000:3.0:1788891248.880135:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+24:18916:x1875787987986816:12345-192.168.204.26@tcp:101:dd.0 Request processed in 529us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891248.880143:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 44 00000100:00100000:0.0:1788891248.883104:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.883181:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987987072 00000100:00100000:3.0:1788891248.883190:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987987072 00000100:00100000:3.0:1788891248.883251:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 45 00000100:00100000:3.0:1788891248.883261:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bb784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+24:18916:x1875787987987072:12345-192.168.204.26@tcp:36:dd.0 00010000:00010000:3.0:1788891248.883520:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55186 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.883565:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55186 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.883578:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55186 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788891248.883631:0:22772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1788891248.883912:0:22772:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000063d50ce reply state 00000000a56c56bd transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55186 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.883929:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55186 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.883938:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:3.0:1788891248.883941:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788891248.883945:0:22772:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788891248.884119:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bb784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+27:18916:x1875787987987072:12345-192.168.204.26@tcp:36:dd.0 Request processed in 858us (1025us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1788891248.884127:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 45 00000020:00080000:3.0:1788891248.884132:0:22772:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788891248.886743:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.886955:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987987200 00000100:00100000:3.0:1788891248.886968:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987987200 00000100:00100000:3.0:1788891248.887078:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 46 00000100:00100000:3.0:1788891248.887090:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bb785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+27:18916:x1875787987987200:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:3.0:1788891248.887116:0:22774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891248.887143:0:22774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5c00/0xa66601b03fd5518d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de5d7 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.887228:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5c00/0xa66601b03fd5518d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5d7 expref: 28 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.887246:0:22774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5c00/0xa66601b03fd5518d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5d7 expref: 28 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.887268:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:3.0:1788891248.887271:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788891248.887275:0:22774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5c00, rc 0) 00000100:00100000:3.0:1788891248.887338:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bb785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+28:18916:x1875787987987200:12345-192.168.204.26@tcp:101:dd.0 Request processed in 250us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891248.887346:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 46 00000100:00100000:2.0:1788891248.899101:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.899184:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987987456 00000100:00100000:3.0:1788891248.899194:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987987456 00000100:00100000:3.0:1788891248.899257:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:3.0:1788891248.899267:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84294380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+28:18916:x1875787987987456:12345-192.168.204.26@tcp:103:dd.0 00010000:00010000:3.0:1788891248.899284:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891248.899312:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5c00/0xa66601b03fd5518d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5d7 expref: 28 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.899332:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:3.0:1788891248.899337:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891248.899396:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84294380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+27:18916:x1875787987987456:12345-192.168.204.26@tcp:103:dd.0 Request processed in 130us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891248.899404:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 2 00000100:00100000:0.0:1788891248.901847:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891248.901935:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987987584 00000100:00100000:3.0:1788891248.901944:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987987584 00000100:00100000:3.0:1788891248.901995:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:3.0:1788891248.902003:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bb784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+27:18916:x1875787987987584:12345-192.168.204.26@tcp:58:dd.0 00010000:00010000:3.0:1788891248.902107:0:24370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4000/0xa66601b03fd55194 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.902124:0:24370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4000/0xa66601b03fd55194 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891248.902135:0:24370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4000/0xa66601b03fd55194 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788891248.903349:0:24370:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788891248.903382:0:24370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1788891248.905984:0:24370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1788891248.906200:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bb784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+27:18916:x1875787987987584:12345-192.168.204.26@tcp:58:dd.0 Request processed in 4191us (4359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891248.906212:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 47 00000100:00100000:0.0:1788891248.908852:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891248.908938:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987987712 00000100:00100000:1.0:1788891248.908949:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987987712 00000100:00100000:1.0:1788891248.909011:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 48 00000100:00100000:1.0:1788891248.909022:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bb785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+27:18916:x1875787987987712:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:1.0:1788891248.909060:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891248.909083:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5519b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de5de expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.909141:0:22773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4000/0xa66601b03fd55194 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.909153:0:22773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5519b lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5de expref: 28 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.909172:0:22773:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4000/0xa66601b03fd55194 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.909185:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5519b lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5de expref: 28 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.909199:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:1.0:1788891248.909202:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788891248.909206:0:22773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5519b lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5de expref: 28 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891248.909212:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250b69c6e00, rc 0) 00000100:00100000:1.0:1788891248.909268:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bb785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+28:18916:x1875787987987712:12345-192.168.204.26@tcp:101:dd.0 Request processed in 247us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891248.909276:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 48 00000100:00100000:1.0:1788891249.041677:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891249.041813:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987987840 00000100:00100000:2.0:1788891249.041823:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987987840 00000100:00100000:2.0:1788891249.041879:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 142 00000100:00100000:2.0:1788891249.041889:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+11:18223:x1875787987987840:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891249.041920:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891249.041940:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92508587b800/0xa66601b03fd551a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204de5e5 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.041967:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92508587b800/0xa66601b03fd551a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5e5 expref: 12 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.041979:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92508587b800/0xa66601b03fd551a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5e5 expref: 12 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.041989:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92508587b800, rc 0) 00000100:00100000:2.0:1788891249.042059:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+12:18223:x1875787987987840:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 171us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891249.042067:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 142 00000100:00100000:0.0:1788891249.047604:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891249.048020:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987987968 00000100:00100000:3.0:1788891249.048033:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987987968 00000100:00100000:3.0:1788891249.048098:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 143 00000100:00100000:3.0:1788891249.048109:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+12:18223:x1875787987987968:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788891249.048979:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+12:18223:x1875787987987968:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 867us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891249.048988:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 143 00000100:00100000:0.0:1788891249.052348:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891249.052454:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987988096 00000100:00100000:1.0:1788891249.052467:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987988096 00000100:00100000:1.0:1788891249.052588:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 144 00000100:00100000:1.0:1788891249.052600:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+12:18223:x1875787987988096:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788891249.052786:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e3ff97d-a6ce-4396-af93-633a8e852ad5+12:18223:x1875787987988096:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 187us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891249.052794:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 144 00000100:00100000:1.0:1788891249.060330:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891249.063498:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987988224 00000100:00100000:3.0:1788891249.063516:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987988224 00000100:00100000:3.0:1788891249.063675:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 145 00000100:00100000:3.0:1788891249.063686:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+12:18223:x1875787987988224:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788891249.063704:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891249.063721:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9250baae5c00/0xa66601b03fd551a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf0d86975204de5ec expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.063791:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9250baae5c00/0xa66601b03fd551a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5ec expref: 13 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.063804:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9250baae5c00/0xa66601b03fd551a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5ec expref: 13 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.063816:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9250baae5c00, rc 0) 00000100:00100000:3.0:1788891249.063895:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+13:18223:x1875787987988224:12345-192.168.204.26@tcp:101:ll_cfg_requeue.0 Request processed in 210us (3575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891249.063901:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 145 00000100:00100000:0.0:1788891249.066380:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891249.066483:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987988352 00000100:00100000:2.0:1788891249.066492:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987988352 00000100:00100000:2.0:1788891249.066583:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 146 00000100:00100000:2.0:1788891249.066593:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+13:18223:x1875787987988352:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788891249.066773:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e3ff97d-a6ce-4396-af93-633a8e852ad5+13:18223:x1875787987988352:12345-192.168.204.26@tcp:501:ll_cfg_requeue.0 Request processed in 173us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891249.066781:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 146 00000100:00100000:0.0:1788891249.069671:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891249.069769:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987988480 00000100:00100000:3.0:1788891249.069779:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987988480 00000100:00100000:3.0:1788891249.069860:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 147 00000100:00100000:3.0:1788891249.069870:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+13:18223:x1875787987988480:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788891249.070059:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e3ff97d-a6ce-4396-af93-633a8e852ad5+13:18223:x1875787987988480:12345-192.168.204.26@tcp:503:ll_cfg_requeue.0 Request processed in 189us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891249.070068:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 147 10000000:01000000:1.0:1788891249.147684:0:22770:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788891249.147693:0:22770:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9250841ad000 from 13 10000000:01000000:1.0:1788891249.147698:0:22770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788891249.147753:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd551b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891249.147776:0:22770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd551b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891249.147787:0:22770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd551b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891249.147815:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997479168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788891249.147892:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891249.147950:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baa2ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788891249.148085:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997479168 00000100:00100000:2.0:1788891249.148093:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997479168 00000100:00100000:2.0:1788891249.148155:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788891249.148164:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+20:22770:x1875787997479168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891249.148177:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891249.148195:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92508587a400/0xa66601b03fd551b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd551b0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.148219:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92508587a400/0xa66601b03fd551b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd551b0 expref: 21 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.148230:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92508587a400/0xa66601b03fd551b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd551b0 expref: 21 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.148239:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92508587a400, rc 0) 00000100:00100000:2.0:1788891249.148288:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+21:22770:x1875787997479168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891249.148295:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788891249.148496:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997479168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891249.148511:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd551b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd551b7 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891249.148616:0:22770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd551b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd551b7 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891249.148685:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997479296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891249.148712:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891249.148730:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baa2ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788891249.149144:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997479296 00000100:00100000:3.0:1788891249.149151:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997479296 00000100:00100000:3.0:1788891249.149189:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788891249.149197:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250baa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+21:22770:x1875787997479296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788891249.149316:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250baa16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+21:22770:x1875787997479296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891249.149323:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000040:00080000:0.0:1788891249.149541:0:23529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788891249.149609:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997479296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891249.149643:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997479424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788891249.149683:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891249.149711:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baa2ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788891249.149804:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997479424 00000100:00100000:3.0:1788891249.149814:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997479424 00000100:00100000:3.0:1788891249.149884:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788891249.149891:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+21:22770:x1875787997479424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788891249.149977:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+21:22770:x1875787997479424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891249.149984:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788891249.150054:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997479424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788891249.153748:0:25810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788891249.154065:0:22770:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788891249.154092:0:22770:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788891249.154114:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd551b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd551b7 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.154130:0:22770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250b69c7400/0xa66601b03fd551b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd551b7 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891249.154141:0:22770:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788891249.154144:0:22770:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9250908d6000 from 13 10000000:01000000:2.0:1788891249.154147:0:22770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788891249.154187:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92508587a600/0xa66601b03fd551be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.154195:0:22770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff92508587a600/0xa66601b03fd551be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.154206:0:22770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92508587a600/0xa66601b03fd551be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891249.154246:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997479552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788891249.154327:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891249.154499:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f82263300 going to sleep for 11 seconds 00000100:00100000:0.0:1788891249.156790:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997479552 00000100:00100000:0.0:1788891249.156802:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997479552 00000100:00100000:0.0:1788891249.156875:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788891249.156886:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+21:22770:x1875787997479552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788891249.156904:0:22768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891249.156922:0:22768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924f820a8c00/0xa66601b03fd551c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd551be expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.156950:0:22768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924f820a8c00/0xa66601b03fd551c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd551be expref: 22 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.156967:0:22768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924f820a8c00/0xa66601b03fd551c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd551be expref: 22 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.156977:0:22768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f820a8c00, rc 0) 00000100:00100000:0.0:1788891249.157098:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad5d36d9-7941-4f84-88d2-361333de6068+22:22770:x1875787997479552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (2770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891249.157118:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788891249.157335:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f84297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997479552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891249.157365:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92508587a600/0xa66601b03fd551be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd551c5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891249.157375:0:22770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92508587a600/0xa66601b03fd551be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd551c5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891249.157454:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997479680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891249.157514:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891249.157581:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baa2b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891249.158197:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997479680 00000100:00100000:3.0:1788891249.158204:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997479680 00000100:00100000:3.0:1788891249.158243:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788891249.158251:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+22:22770:x1875787997479680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788891249.158399:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+22:22770:x1875787997479680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891249.158406:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788891249.158582:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997479680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891249.158617:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997479808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788891249.158659:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891249.158743:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baa2b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891249.159069:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997479808 00000100:00100000:3.0:1788891249.159074:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997479808 00000100:00100000:3.0:1788891249.159147:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788891249.159155:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+22:22770:x1875787997479808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788891249.159253:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+22:22770:x1875787997479808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891249.159260:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788891249.159916:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997479808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788891249.161165:0:25811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788891249.161327:0:22770:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788891249.161351:0:22770:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788891249.161361:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92508587a600/0xa66601b03fd551be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd551c5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.161372:0:22770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff92508587a600/0xa66601b03fd551be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd551c5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891249.161396:0:22770:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788891249.161400:0:22770:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff924f832d8800 from 13 10000000:01000000:3.0:1788891249.161402:0:22770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788891249.161632:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd551cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.161641:0:22770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd551cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.161649:0:22770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd551cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891249.161671:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997479936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788891249.161729:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891249.161894:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff92508a529c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788891249.161938:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997479936 00000100:00100000:2.0:1788891249.161946:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997479936 00000100:00100000:2.0:1788891249.162023:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788891249.162033:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+22:22770:x1875787997479936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891249.162044:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891249.162057:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92508587bc00/0xa66601b03fd551d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd551cc expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.162079:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92508587bc00/0xa66601b03fd551d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd551cc expref: 23 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.162089:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92508587bc00/0xa66601b03fd551d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd551cc expref: 23 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.162097:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92508587bc00, rc 0) 00000100:00100000:2.0:1788891249.162144:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+23:22770:x1875787997479936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891249.162150:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788891249.162222:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997479936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891249.162235:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd551cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd551d3 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891249.162244:0:22770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd551cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd551d3 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891249.162295:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997480064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891249.162322:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891249.162554:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baa2b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891249.162719:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997480064 00000100:00100000:3.0:1788891249.162724:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997480064 00000100:00100000:3.0:1788891249.162747:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788891249.162754:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+23:22770:x1875787997480064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788891249.162917:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+23:22770:x1875787997480064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891249.162925:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788891249.163024:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997480064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891249.163055:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997480192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788891249.163097:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891249.163119:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250baa2b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891249.163162:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997480192 00000100:00100000:3.0:1788891249.163166:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997480192 00000100:00100000:3.0:1788891249.163183:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788891249.163188:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+23:22770:x1875787997480192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788891249.163308:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+23:22770:x1875787997480192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891249.163322:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788891249.163590:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997480192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788891249.164731:0:25812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788891249.165036:0:22770:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788891249.165056:0:22770:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788891249.165067:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd551cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd551d3 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.165078:0:22770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae4a00/0xa66601b03fd551cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd551d3 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891249.165088:0:22770:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788891249.165090:0:22770:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9250b4f3c000 from 13 10000000:01000000:3.0:1788891249.165093:0:22770:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788891249.165121:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5000/0xa66601b03fd551da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.165128:0:22770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff9250baae5000/0xa66601b03fd551da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.165137:0:22770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff9250baae5000/0xa66601b03fd551da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891249.165157:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997480320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788891249.165205:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891249.165278:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff925095be6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788891249.165315:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997480320 00000100:00100000:2.0:1788891249.165321:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997480320 00000100:00100000:2.0:1788891249.165515:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788891249.165554:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+23:22770:x1875787997480320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891249.165567:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891249.165586:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92508587b600/0xa66601b03fd551e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa66601b03fd551da expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.165610:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92508587b600/0xa66601b03fd551e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa66601b03fd551da expref: 24 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.165621:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92508587b600/0xa66601b03fd551e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa66601b03fd551da expref: 24 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.165629:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92508587b600, rc 0) 00000100:00100000:2.0:1788891249.165668:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+24:22770:x1875787997480320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891249.165674:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788891249.165775:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997480320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891249.165789:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff9250baae5000/0xa66601b03fd551da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd551e1 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891249.165797:0:22770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff9250baae5000/0xa66601b03fd551da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa66601b03fd551e1 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891249.165863:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997480448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891249.165890:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891249.166084:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090b93180 going to sleep for 11 seconds 00000100:00100000:3.0:1788891249.166152:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997480448 00000100:00100000:3.0:1788891249.166157:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997480448 00000100:00100000:3.0:1788891249.166180:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788891249.166186:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+24:22770:x1875787997480448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788891249.166295:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad5d36d9-7941-4f84-88d2-361333de6068+24:22770:x1875787997480448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891249.166308:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788891249.166495:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997480448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891249.166559:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997480576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788891249.166599:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891249.166618:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090b93180 going to sleep for 11 seconds 00000100:00100000:2.0:1788891249.166663:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997480576 00000100:00100000:2.0:1788891249.166667:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997480576 00000100:00100000:2.0:1788891249.166694:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788891249.166700:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+24:22770:x1875787997480576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788891249.166800:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+24:22770:x1875787997480576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891249.166808:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788891249.166912:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad5d36d9-7941-4f84-88d2-361333de6068:22770:1875787997480576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788891249.168208:0:25813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788891249.170545:0:22770:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788891249.170579:0:22770:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788891249.170591:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff9250baae5000/0xa66601b03fd551da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd551e1 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.170604:0:22770:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff9250baae5000/0xa66601b03fd551da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa66601b03fd551e1 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891249.213277:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788891249.467755:0:22808:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788891249.467768:0:22808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788891249.467799:0:22808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788891249.467809:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788891249.467976:0:22808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22808:1875787997480704:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788891249.468135:0:22808:0:(client.c:2715:ptlrpc_set_wait()) set ffff925090b93780 going to sleep for 11 seconds 00000100:00100000:0.0:1788891249.473761:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891249.473791:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987988608 00000100:00100000:0.0:1788891249.473799:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987988608 00000100:00100000:0.0:1788891249.473850:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 49 00000100:00100000:0.0:1788891249.473858:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bb784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+29:18919:x1875787987988608:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788891249.473890:0:22772:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788891249.474001:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bb784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+29:18919:x1875787987988608:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 143us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891249.474009:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 49 00000100:00080000:1.0:1788891249.474375:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891249.474422:0:22808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f83a71500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22808:1875787997480704:192.168.204.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788891249.478289:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891249.478584:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987988736 00000100:00100000:0.0:1788891249.478595:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987988736 00000100:00100000:0.0:1788891249.478675:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 50 00000100:00100000:0.0:1788891249.478686:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+28:18919:x1875787987988736:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788891249.478760:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd551e8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.478778:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd551e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.478791:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd551e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.478805:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd551ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.478812:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd551ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.478836:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd551ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.478860:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd551f6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.478870:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd551f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.478876:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd551f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891249.478921:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788891249.478926:0:22773:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788891249.478938:0:22773:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd551f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.478950:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd551e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.478957:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd551e8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.478965:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd551e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.478972:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a8400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891249.478976:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd551e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.478984:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd551e8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.479004:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9250c130b200) 00010000:00010000:0.0:1788891249.479007:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891249.479012:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd551e8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.479017:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd551e8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.479031:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd551ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.479037:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd551ef lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.479043:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd551ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.479048:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a8000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891249.479051:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd551ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.479057:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd551ef lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.479064:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9250c130b000) 00010000:00010000:0.0:1788891249.479067:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891249.479069:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd551ef lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.479075:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd551ef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.479099:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd551f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.479113:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd551f6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.479119:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd551f6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.479125:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a8800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891249.479128:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd551f6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.479134:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd551f6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.479141:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:0.0:1788891249.479143:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891249.479146:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd551f6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.479152:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd551f6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891249.479235:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+28:18919:x1875787987988736:12345-192.168.204.26@tcp:34:lhsmtool_posix.0 Request processed in 550us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891249.479243:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 50 00000100:00100000:0.0:1788891249.484254:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891249.484351:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987988992 00000100:00100000:2.0:1788891249.484377:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987988992 00000100:00100000:2.0:1788891249.484448:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:2.0:1788891249.484458:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bb785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+28:18919:x1875787987988992:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891249.484489:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891249.484509:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a000/0xa66601b03fd551fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de5f3 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.484665:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ac00/0xa66601b03fd55204 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.484681:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ac00/0xa66601b03fd55204 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.484693:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ac00/0xa66601b03fd55204 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891249.484705:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788891249.484780:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ac00/0xa66601b03fd55204 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.484788:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ac00/0xa66601b03fd55204 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.484794:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ac00/0xa66601b03fd55204 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.484800:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587ac00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891249.484805:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ac00/0xa66601b03fd55204 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.484812:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ac00/0xa66601b03fd55204 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.484832:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:2.0:1788891249.484835:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788891249.484840:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ac00/0xa66601b03fd55204 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.484846:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ac00/0xa66601b03fd55204 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.484886:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a000/0xa66601b03fd551fd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5f3 expref: 30 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.484896:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9250c130b200) 00010000:00010000:2.0:1788891249.484898:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788891249.484902:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a000/0xa66601b03fd551fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5f3 expref: 30 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.484910:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92508587a000, rc 0) 00000100:00100000:2.0:1788891249.484964:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bb785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+29:18919:x1875787987988992:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 508us (722us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1788891249.484972:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 51 00000100:00100000:2.0:1788891249.490421:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891249.490514:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987989120 00000100:00100000:0.0:1788891249.490557:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987989120 00000100:00100000:0.0:1788891249.490640:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:0.0:1788891249.490652:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f84297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+29:18919:x1875787987989120:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788891249.490688:0:22773:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788891249.490816:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f84297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+29:18919:x1875787987989120:12345-192.168.204.26@tcp:53:lhsmtool_posix.0 Request processed in 166us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891249.490824:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 52 00000100:00100000:1.0:1788891249.497238:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891249.497340:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987989376 00000100:00100000:2.0:1788891249.497351:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987989376 00000100:00100000:2.0:1788891249.497479:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 53 00000100:00100000:2.0:1788891249.497488:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+29:18919:x1875787987989376:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891249.497509:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891249.497559:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a000/0xa66601b03fd55212 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de5fa expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788891249.498353:0:22772:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:2.0:1788891249.498360:0:22772:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:2.0:1788891249.498381:0:22772:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1788891249.498574:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ac00/0xa66601b03fd55219 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.498589:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ac00/0xa66601b03fd55219 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.498807:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ac00/0xa66601b03fd55219 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.498872:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a000/0xa66601b03fd55212 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5fa expref: 32 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.498891:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ac00/0xa66601b03fd55219 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5fa expref: 31 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.498899:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff925083c80000) 00010000:00010000:2.0:1788891249.498901:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891249.498904:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92508587ac00, rc 0) 00000100:00100000:2.0:1788891249.499021:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+31:18919:x1875787987989376:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 1532us (1794us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1788891249.499030:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 53 00000100:00100000:1.0:1788891249.502206:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891249.502379:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987989632 00000100:00100000:0.0:1788891249.502392:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987989632 00000100:00100000:0.0:1788891249.502457:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 54 00000100:00100000:0.0:1788891249.502479:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+31:18919:x1875787987989632:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788891249.502854:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891249.502884:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ac00/0xa66601b03fd55219 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5fa expref: 31 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.502901:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff925083c80000) 00010000:00010000:0.0:1788891249.502912:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788891249.502934:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd55227 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.502948:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd55227 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.502957:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd55227 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.502970:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd5522e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xe21df04f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.502976:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd5522e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe21df04f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.502994:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd5522e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe21df04f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.503035:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd55227 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.503041:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd55227 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.503047:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd55227 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.503053:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a8800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891249.503056:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd55227 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.503062:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd55227 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.503069:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9250c130bd00) 00010000:00010000:0.0:1788891249.503071:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891249.503074:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd55227 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.503079:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8800/0xa66601b03fd55227 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.503087:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd5522e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe21df04f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.503093:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd5522e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe21df04f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.503102:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd5522e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe21df04f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.503107:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a8000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:0.0:1788891249.503109:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd5522e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe21df04f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.503114:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd5522e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe21df04f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.503120:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xe21df04f (ffff9250c130b000) 00010000:00010000:0.0:1788891249.503122:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891249.503124:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd5522e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xe21df04f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.503129:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd5522e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xe21df04f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891249.503249:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+30:18919:x1875787987989632:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 771us (1054us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788891249.503257:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 54 00000100:00100000:3.0:1788891249.505193:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891249.505441:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987989760 00000100:00100000:0.0:1788891249.505451:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987989760 00000100:00100000:0.0:1788891249.505574:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00100000:0.0:1788891249.505584:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+30:18919:x1875787987989760:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788891249.505605:0:24370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891249.505630:0:24370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd55235 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de601 expref: -99 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.505701:0:24370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5523c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.505715:0:24370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5523c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.505725:0:24370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5523c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.505848:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd55235 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de601 expref: 32 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.505869:0:24370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9e00/0xa66601b03fd5523c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de601 expref: 31 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.505879:0:24370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9250c130b100) 00010000:00010000:0.0:1788891249.505882:0:24370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788891249.505886:0:24370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f820a9e00, rc 0) 00000100:00100000:0.0:1788891249.505936:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+31:18919:x1875787987989760:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 354us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891249.505943:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 55 00000100:00100000:1.0:1788891249.508087:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891249.508176:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987990016 00000100:00100000:3.0:1788891249.508186:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987990016 00000100:00100000:3.0:1788891249.508241:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 56 00000100:00100000:3.0:1788891249.508250:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf73aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+31:18919:x1875787987990016:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788891249.508333:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd55243 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.508349:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd55243 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.508361:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd55243 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788891249.508608:0:22774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:3.0:1788891249.508622:0:22774:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 471753096337ns, next at 472753093539ns, rc = 0 00000004:00010000:3.0:1788891249.509065:0:22774:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae3371f0 reply state 0000000073f03032 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd55243 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.509081:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd55243 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.509089:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9250c130b100) 00010000:00010000:3.0:1788891249.509092:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788891249.509095:0:22774:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788891249.509206:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf73aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+33:18919:x1875787987990016:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 955us (1126us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1788891249.509230:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 56 00000100:00100000:1.0:1788891249.512783:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891249.512957:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987990144 00000100:00100000:2.0:1788891249.512968:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987990144 00000100:00100000:2.0:1788891249.513077:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 57 00000100:00100000:2.0:1788891249.513088:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+33:18919:x1875787987990144:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891249.513129:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891249.513151:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a800/0xa66601b03fd5524a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de608 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.513215:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a800/0xa66601b03fd5524a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de608 expref: 34 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.513229:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a800/0xa66601b03fd5524a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de608 expref: 34 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.513246:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9250c130b100) 00010000:00010000:2.0:1788891249.513250:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788891249.513253:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92508587a800, rc 0) 00000100:00100000:2.0:1788891249.513361:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+34:18919:x1875787987990144:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 274us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891249.513370:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 57 00000100:00100000:2.0:1788891249.517213:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891249.517322:0:25538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987990272 00000100:00100000:0.0:1788891249.517334:0:25538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987990272 00000100:00080000:1.0:1788891249.517562:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788891249.517814:0:25538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:0.0:1788891249.517933:0:25538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090312300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:413079f8-dd2b-438f-8f6c-c06cd5265027+5:2393:x1875787987990272:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788891249.518175:0:25538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090312300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:413079f8-dd2b-438f-8f6c-c06cd5265027+6:2393:x1875787987990272:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 350us (971us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1788891249.518200:0:25538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 24 00000100:00100000:1.0:1788891249.521164:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891249.521273:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987990528 00000100:00100000:0.0:1788891249.521282:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987990528 00000100:00100000:0.0:1788891249.521366:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:0.0:1788891249.521376:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bf739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+34:18919:x1875787987990528:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788891249.521644:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bf739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+35:18919:x1875787987990528:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 259us (478us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1788891249.521652:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 9 00000100:00100000:1.0:1788891249.523668:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891249.523802:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987990784 00000100:00100000:0.0:1788891249.523809:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987990784 00000100:00100000:0.0:1788891249.523862:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 58 00000100:00100000:0.0:1788891249.523870:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+35:18919:x1875787987990784:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788891249.523961:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+35:18919:x1875787987990784:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 91us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891249.523969:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 58 00000100:00100000:2.0:1788891249.526566:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891249.526657:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987990912 00000100:00100000:0.0:1788891249.526666:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987990912 00000100:00100000:0.0:1788891249.526792:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:0.0:1788891249.526802:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+35:18919:x1875787987990912:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788891249.526822:0:24370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891249.526976:0:24370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd55251 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de60f expref: -99 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.527042:0:24370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd55258 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.527077:0:24370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd55258 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.527090:0:24370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd55258 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891249.527138:0:24370:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788891249.527158:0:24370:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd55258 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.527184:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8400/0xa66601b03fd55251 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de60f expref: 37 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.527203:0:24370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd55258 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de60f expref: 36 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.527212:0:24370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9250c130b100) 00010000:00010000:0.0:1788891249.527215:0:24370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788891249.527218:0:24370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f820a8000, rc 0) 00000100:00100000:0.0:1788891249.527333:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+36:18919:x1875787987990912:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 531us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891249.527341:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 59 00000100:00100000:1.0:1788891249.530992:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891249.531082:0:24371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987991040 00000100:00100000:3.0:1788891249.531091:0:24371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987991040 00000100:00100000:3.0:1788891249.531174:0:24371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:3.0:1788891249.531186:0:24371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+6:2394:x1875787987991040:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788891249.531206:0:24371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891249.531231:0:24371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6f82fab/0xa66601b03fd5525f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de616 expref: -99 pid: 24371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788891249.531259:0:24371:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa05071, blocks: 0x0 00010000:00010000:3.0:1788891249.531278:0:24371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788891249.531283:0:24371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891249.531293:0:24371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6f82fab/0xa66601b03fd5525f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de616 expref: 7 pid: 24371 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.531313:0:24371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e6f82fab/0xa66601b03fd5525f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de616 expref: 7 pid: 24371 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.531327:0:24371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff925091a8a600, rc 0) 00000100:00100000:3.0:1788891249.531391:0:24371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+7:2394:x1875787987991040:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 207us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891249.531399:0:24371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 25 00000100:00100000:1.0:1788891249.534569:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891249.534741:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987991296 00000100:00100000:0.0:1788891249.534751:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987991296 00000100:00100000:0.0:1788891249.534804:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:0.0:1788891249.534812:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+36:18919:x1875787987991296:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788891249.534912:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+36:18919:x1875787987991296:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 100us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891249.534933:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 60 00000100:00100000:2.0:1788891249.537018:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891249.537266:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987991424 00000100:00100000:0.0:1788891249.537275:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987991424 00000100:00100000:0.0:1788891249.537332:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 61 00000100:00100000:0.0:1788891249.537341:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+36:18919:x1875787987991424:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788891249.539443:0:22753:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:1.0:1788891249.539470:0:22753:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1788891249.539617:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9000/0xa66601b03fd55052 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539641:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9000/0xa66601b03fd55052 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539659:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9000/0xa66601b03fd55052 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539666:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a9000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891249.539671:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9000/0xa66601b03fd55052 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539691:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9000/0xa66601b03fd55052 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539708:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9250c130b300) 00010000:00010000:3.0:1788891249.539711:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891249.539716:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9000/0xa66601b03fd55052 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539722:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9000/0xa66601b03fd55052 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539745:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9c00/0xa66601b03fd55059 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539751:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9c00/0xa66601b03fd55059 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539757:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9c00/0xa66601b03fd55059 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539762:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a9c00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891249.539777:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9c00/0xa66601b03fd55059 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539794:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9c00/0xa66601b03fd55059 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539804:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9250c130bd00) 00010000:00010000:3.0:1788891249.539806:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891249.539810:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9c00/0xa66601b03fd55059 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539816:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9c00/0xa66601b03fd55059 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539842:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9200/0xa66601b03fd55101 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539849:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9200/0xa66601b03fd55101 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539855:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9200/0xa66601b03fd55101 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539860:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a9200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891249.539863:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9200/0xa66601b03fd55101 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539870:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9200/0xa66601b03fd55101 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539877:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9250c130b900) 00010000:00010000:3.0:1788891249.539880:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891249.539883:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9200/0xa66601b03fd55101 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539896:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9200/0xa66601b03fd55101 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539912:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55186 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539919:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55186 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539925:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55186 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539930:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b800 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891249.539933:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55186 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539939:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55186 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539948:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:3.0:1788891249.539950:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891249.539954:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55186 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539959:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55186 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539970:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd55243 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539976:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd55243 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539989:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd55243 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.539995:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae5400 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891249.539998:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd55243 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.540004:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd55243 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.540012:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9250c130b100) 00010000:00010000:3.0:1788891249.540014:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788891249.540017:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd55243 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.540023:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae5400/0xa66601b03fd55243 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891249.541181:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000001:00080000:1.0:1788891249.541365:0:22753:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:0.0:1788891249.541483:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997480832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788891249.541592:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891249.541898:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+15:18919:x1875787987991424:12345-192.168.204.26@tcp:44:lhsmtool_posix.0 Request processed in 4555us (4886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891249.541908:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 61 00010000:00010000:3.0:1788891249.544226:0:3614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd550a6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.544241:0:3614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd550a6 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.544248:0:3614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd550a6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.544253:0:3614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:3.0:1788891249.544258:0:3614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd550a6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.544280:0:3614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd550a6 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.544294:0:3614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9250c130bd00) 00010000:00010000:3.0:1788891249.544297:0:3614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788891249.544301:0:3614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd550a6 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.544306:0:3614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b200/0xa66601b03fd550a6 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891249.544485:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891249.544913:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997480832 00000100:00100000:2.0:1788891249.544924:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997480832 00000100:00100000:0.0:1788891249.545027:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987991552 00000100:00100000:0.0:1788891249.545031:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987991552 00000100:00100000:0.0:1788891249.545068:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788891249.545078:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bb787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997480832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788891249.545219:0:24276:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788891249.545223:0:24276:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788891249.545225:0:24276:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788891249.545228:0:24276:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788891249 -> 1788891249 00002000:00010000:0.0:1788891249.545230:0:24276:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788891249.545291:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bb787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3628:x1875787997480832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 215us (3699us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788891249.545299:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788891249.545319:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:0.0:1788891249.545326:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925085b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+7:2393:x1875787987991552:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788891249.545397:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925085b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+7:2393:x1875787987991552:12345-192.168.204.26@tcp:16:lhsmtool_posix.0 Request processed in 70us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891249.545404:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 27 00000100:00100000:0.0:1788891249.545587:0:3628:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1788891249.545605:0:3628:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff925090313800 x1875787997480832/t12884901892(12884901892) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788891265 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788891249.545616:0:3628:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff925090313800/2, rc 0, transno 12884901892 00000100:00100000:0.0:1788891249.545621:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997480832:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1788891249.546456:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788891249.548810:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891249.549118:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987991808 00000100:00100000:3.0:1788891249.549128:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987991808 00000100:00100000:3.0:1788891249.549186:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:3.0:1788891249.549195:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+15:18919:x1875787987991808:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788891249.549245:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891249.549269:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8000/0xa66601b03fd55258 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de60f expref: 15 pid: 24370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.549288:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9250c130b100) 00010000:00010000:3.0:1788891249.549293:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788891249.549321:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55266 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.549334:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55266 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.549343:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55266 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788891249.549480:0:22773:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a9f8a75 reply state 00000000da214ad2 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55266 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.549492:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8b800/0xa66601b03fd55266 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.549499:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9250c130b100) 00010000:00010000:3.0:1788891249.549502:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788891249.549504:0:22773:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788891249.549603:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+16:18919:x1875787987991808:12345-192.168.204.26@tcp:36:lhsmtool_posix.0 Request processed in 409us (803us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1788891249.549610:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 62 00000100:00100000:3.0:1788891249.551629:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891249.551792:0:24371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987991936 00000100:00100000:0.0:1788891249.551802:0:24371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987991936 00000100:00100000:0.0:1788891249.552218:0:24371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 28 00000100:00100000:0.0:1788891249.552229:0:24371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+7:18919:x1875787987991936:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788891249.552246:0:24371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891249.552263:0:24371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd5526d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de61d expref: -99 pid: 24371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.552294:0:24371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6f82fab/0xa66601b03fd5525f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de616 expref: 8 pid: 24371 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.552305:0:24371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891249.552309:0:24371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891249.552314:0:24371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd5526d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de61d expref: 8 pid: 24371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.552351:0:24371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6f82fab/0xa66601b03fd5525f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de616 expref: 8 pid: 24371 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.552700:0:24371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6f82fab/0xa66601b03fd5525f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de616 expref: 8 pid: 24371 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891249.552726:0:24371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bb787b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24371:1875787997480960:192.168.204.26@tcp:104: 00000100:00100000:0.0:1788891249.552815:0:24371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9250908c6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788891249.555332:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891249.555416:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987992064 00000100:00100000:2.0:1788891249.555427:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987992064 00010000:00010000:2.0:1788891249.555475:0:22760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6f82fab/0xa66601b03fd5525f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de616 expref: 9 pid: 24371 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891249.555574:0:24371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bb787b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24371:1875787997480960:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891249.555592:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:2.0:1788891249.555603:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+9:2394:x1875787987992064:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891249.555622:0:24371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd5526d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de61d expref: 9 pid: 24371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.555631:0:22760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891249.555645:0:24371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f820a8400, rc 0) 00010000:00010000:2.0:1788891249.555655:0:22760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6f82fab/0xa66601b03fd5525f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de616 expref: 9 pid: 24371 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.555669:0:22760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6f82fab/0xa66601b03fd5525f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de616 expref: 9 pid: 24371 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891249.555703:0:24371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+9:18919:x1875787987991936:12345-192.168.204.26@tcp:101:lhsmtool_posix.0 Request processed in 3474us (4080us total) trans 0 rc 0/0 00010000:00010000:2.0:1788891249.555706:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6f82fab/0xa66601b03fd5525f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de616 expref: 9 pid: 24371 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891249.555720:0:24371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 28 00010000:00010000:2.0:1788891249.555725:0:22760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891249.555731:0:22760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891249.555739:0:22760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd5526d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de61d expref: 7 pid: 24371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.555750:0:22760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd5526d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de61d expref: 7 pid: 24371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.555790:0:22760:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd5526d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de61d expref: 7 pid: 24371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891249.555803:0:22760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22760:1875787997481088:192.168.204.26@tcp:105: 00000100:00100000:2.0:1788891249.555858:0:22760:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f821d7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788891249.558941:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891249.559014:0:25538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987992192 00000100:00100000:3.0:1788891249.559022:0:25538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987992192 00000100:00100000:3.0:1788891249.559082:0:25538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:3.0:1788891249.559092:0:25538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:413079f8-dd2b-438f-8f6c-c06cd5265027+8:2393:x1875787987992192:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788891249.559255:0:25538:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788891249.559259:0:25538:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788891248 00002000:00010000:3.0:1788891249.559262:0:25538:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788891247 00002000:00010000:3.0:1788891249.559264:0:25538:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788891249 -> 1788891248 00002000:00010000:3.0:1788891249.559266:0:25538:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788891249.559326:0:25538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:413079f8-dd2b-438f-8f6c-c06cd5265027+9:2393:x1875787987992192:12345-192.168.204.26@tcp:2:lhsmtool_posix.0 Request processed in 236us (395us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788891249.559334:0:25538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 29 00000100:00100000:2.0:1788891249.559583:0:22760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22760:1875787997481088:192.168.204.26@tcp:105: 00010000:00010000:2.0:1788891249.559604:0:22760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891249.559644:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+8:2394:x1875787987992064:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 4044us (4322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891249.559652:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 19 00000100:00100000:1.0:1788891249.564217:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891249.564302:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987992320 00000100:00100000:2.0:1788891249.564313:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987992320 00000100:00100000:2.0:1788891249.564375:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:2.0:1788891249.564386:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+8:2392:x1875787987992320:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788891249.564430:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd55274 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.564450:0:24275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd5526d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de61d expref: 8 pid: 24371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.564469:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891249.564474:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788891249.564478:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd55274 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.564510:0:24275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd5526d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de61d expref: 8 pid: 24371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.564556:0:24275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd5526d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de61d expref: 8 pid: 24371 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891249.564572:0:24275:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24275:1875787997481216:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891249.564963:0:24275:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f821d7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788891249.567656:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891249.567814:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987992448 00000100:00100000:3.0:1788891249.567843:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987992448 00010000:00010000:3.0:1788891249.567880:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd5526d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de61d expref: 9 pid: 24371 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891249.567924:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 20 00000100:00100000:3.0:1788891249.567935:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+9:2393:x1875787987992448:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891249.567951:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891249.567975:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd5526d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de61d expref: 9 pid: 24371 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.567989:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd5526d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de61d expref: 9 pid: 24371 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.568013:0:22758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788891249.568018:0:22758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788891249.568023:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd55274 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.568034:0:22758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd55274 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.568057:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891249.568114:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+9:2393:x1875787987992448:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 181us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891249.568123:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 20 00010000:00010000:2.0:1788891249.569202:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000958c0a2/0xa66601b03fd5526d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de61d expref: 8 pid: 24371 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891249.569223:0:24275:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24275:1875787997481216:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891249.569247:0:24275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd55274 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.569258:0:24275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd55274 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.569266:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd55274 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.569292:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd55274 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.569301:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd55274 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.569310:0:24275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd55274 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.569317:0:24275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587ae00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891249.569321:0:24275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd55274 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.569345:0:24275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd55274 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.569360:0:24275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd55274 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.569368:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000109aac80/0xa66601b03fd55274 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891249.569438:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+7:2392:x1875787987992320:12345-192.168.204.26@tcp:1:lhsmtool_posix.0 Request processed in 5053us (5229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891249.569446:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 30 00000100:00100000:1.0:1788891249.572291:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891249.572360:0:24370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987992704 00000100:00100000:2.0:1788891249.572369:0:24370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987992704 00000100:00100000:2.0:1788891249.572425:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 63 00000100:00100000:2.0:1788891249.572434:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+16:18919:x1875787987992704:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788891249.572543:0:24370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a200/0xa66601b03fd5527b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.572562:0:24370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a000/0xa66601b03fd5517f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5d0 expref: 16 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.572572:0:24370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a200/0xa66601b03fd5527b lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.572603:0:24370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a000/0xa66601b03fd5517f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5d0 expref: 16 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.572626:0:24370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a000/0xa66601b03fd5517f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5d0 expref: 16 pid: 22774 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891249.572789:0:24370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24370:1875787997481344:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891249.572942:0:24370:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f821d7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788891249.576996:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891249.577083:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987992832 00000100:00100000:3.0:1788891249.577094:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987992832 00010000:00010000:3.0:1788891249.577148:0:22760:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a000/0xa66601b03fd5517f lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5d0 expref: 17 pid: 22774 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891249.577194:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 21 00000100:00100000:3.0:1788891249.577204:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+17:2393:x1875787987992832:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891249.577222:0:22760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891249.577229:0:22760:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a000/0xa66601b03fd5517f lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5d0 expref: 17 pid: 22774 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.577244:0:22760:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a000/0xa66601b03fd5517f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5d0 expref: 17 pid: 22774 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.577267:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:3.0:1788891249.577274:0:22760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5519b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5de expref: 17 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.577285:0:22760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a200/0xa66601b03fd5527b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.577293:0:22760:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a200/0xa66601b03fd5527b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.577300:0:22760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a200/0xa66601b03fd5527b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.577322:0:22760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891249.577376:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:413079f8-dd2b-438f-8f6c-c06cd5265027+17:2393:x1875787987992832:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 174us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891249.577383:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 21 00010000:00010000:2.0:1788891249.578999:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff925091a8a000/0xa66601b03fd5517f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5d0 expref: 16 pid: 22774 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891249.579021:0:24370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24370:1875787997481344:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891249.579041:0:24370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a200/0xa66601b03fd5527b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.579050:0:24370:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a200/0xa66601b03fd5527b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.579055:0:24370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a200/0xa66601b03fd5527b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.579247:0:24370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd55282 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.579260:0:24370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a800/0xa66601b03fd5524a lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de608 expref: 16 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.579268:0:24370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd55282 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.579298:0:24370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a800/0xa66601b03fd5524a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de608 expref: 16 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.579320:0:24370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a800/0xa66601b03fd5524a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de608 expref: 16 pid: 22772 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891249.579335:0:24370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24370:1875787997481472:192.168.204.26@tcp:104: 00000100:00100000:2.0:1788891249.579470:0:24370:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f821d7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788891249.583696:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891249.584035:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987992960 00000100:00100000:3.0:1788891249.584047:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987992960 00010000:00010000:3.0:1788891249.584092:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a800/0xa66601b03fd5524a lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de608 expref: 17 pid: 22772 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891249.584137:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 22 00000100:00100000:3.0:1788891249.584148:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f83a66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+17:2393:x1875787987992960:12345-192.168.204.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891249.584163:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891249.584170:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a800/0xa66601b03fd5524a lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de608 expref: 17 pid: 22772 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.584186:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a800/0xa66601b03fd5524a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de608 expref: 17 pid: 22772 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.584208:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9250c130b100) 00010000:00010000:3.0:1788891249.584213:0:22759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd55282 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.584222:0:22759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd55282 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.584229:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd55282 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.584250:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891249.584307:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+17:2393:x1875787987992960:12345-192.168.204.26@tcp:103:ldlm_bl.0 Request processed in 161us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891249.584315:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 22 00010000:00010000:2.0:1788891249.584485:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a800/0xa66601b03fd5524a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.26@tcp remote: 0xf0d86975204de608 expref: 16 pid: 22772 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891249.584503:0:24370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24370:1875787997481472:192.168.204.26@tcp:104: 00010000:00010000:2.0:1788891249.584541:0:24370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd55282 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.584551:0:24370:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd55282 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.584557:0:24370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd55282 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788891249.584671:0:24370:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:2.0:1788891249.584790:0:24370:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:2.0:1788891249.584830:0:24370:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:2.0:1788891249.584913:0:24370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24370:1875787997481600:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788891249.585187:0:24370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891249.585215:0:24370:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f830ff540 going to sleep for 11 seconds 00000100:00100000:3.0:1788891249.585281:0:25539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997481600 00000100:00100000:3.0:1788891249.585299:0:25539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997481600 00000100:00100000:3.0:1788891249.585379:0:25539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788891249.585388:0:25539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:24370:x1875787997481600:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788891249.585480:0:25539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:24370:x1875787997481600:12345-0@lo:1000:mdt00_003.0 Request processed in 93us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891249.585487:0:25539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788891249.585590:0:24370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24370:1875787997481600:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788891249.586177:0:24370:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:2.0:1788891249.586231:0:24370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090313100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24370:1875787997481728:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788891249.586279:0:24370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891249.586309:0:24370:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f830ffb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788891249.586773:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997481728 00000100:00100000:0.0:1788891249.586781:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997481728 00000100:00100000:0.0:1788891249.586950:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788891249.586959:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:24370:x1875787997481728:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788891249.587092:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:24370:x1875787997481728:12345-0@lo:1000:mdt00_003.0 Request processed in 133us (811us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788891249.587100:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788891249.587747:0:24370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090313100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24370:1875787997481728:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788891249.587785:0:24370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd55282 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.587795:0:24370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd55282 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.587803:0:24370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd55282 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.587808:0:24370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587be00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891249.587813:0:24370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd55282 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.587820:0:24370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd55282 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.588094:0:24370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9250c130b100) 00010000:00010000:2.0:1788891249.588098:0:24370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788891249.588103:0:24370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd55282 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.588109:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92508587be00/0xa66601b03fd55282 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.588140:0:24370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4000/0xa66601b03fd55194 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.588147:0:24370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4000/0xa66601b03fd55194 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.588166:0:24370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4000/0xa66601b03fd55194 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.588171:0:24370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9250baae4000 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891249.588174:0:24370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4000/0xa66601b03fd55194 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.588180:0:24370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4000/0xa66601b03fd55194 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.588188:0:24370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:2.0:1788891249.588191:0:24370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788891249.588197:0:24370:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5519b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5de expref: 19 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.588208:0:24370:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5519b lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5de expref: 19 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.588217:0:24370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5519b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5de expref: 19 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.588273:0:24370:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9250b69c6e00/0xa66601b03fd5519b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de5de expref: 19 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891249.588286:0:24370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090312680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24370:1875787997481856:192.168.204.26@tcp:105: 00000100:00100000:2.0:1788891249.588371:0:24370:0:(client.c:2715:ptlrpc_set_wait()) set ffff924f830ffa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788891249.591393:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891249.591411:0:24370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090312680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24370:1875787997481856:192.168.204.26@tcp:105: 00010000:00010000:2.0:1788891249.591453:0:24370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4000/0xa66601b03fd55194 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.591474:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9250baae4000/0xa66601b03fd55194 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.591511:0:24370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ae00/0xa66601b03fd55289 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.591561:0:24370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ae00/0xa66601b03fd55289 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.591573:0:24370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ae00/0xa66601b03fd55289 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.591584:0:24370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ae00/0xa66601b03fd55289 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.591591:0:24370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ae00/0xa66601b03fd55289 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.591597:0:24370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ae00/0xa66601b03fd55289 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.591602:0:24370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587ae00 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891249.591606:0:24370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ae00/0xa66601b03fd55289 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.591613:0:24370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ae00/0xa66601b03fd55289 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.591632:0:24370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:2.0:1788891249.591641:0:24370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891249.591645:0:24370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ae00/0xa66601b03fd55289 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.591651:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92508587ae00/0xa66601b03fd55289 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.591666:0:24370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a200/0xa66601b03fd5527b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.591672:0:24370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a200/0xa66601b03fd5527b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.591678:0:24370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a200/0xa66601b03fd5527b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.591684:0:24370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92508587a200 already unused, calling callback (ffffffffc1a0b4f0) 00010000:00010000:2.0:1788891249.591687:0:24370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a200/0xa66601b03fd5527b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.591694:0:24370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a200/0xa66601b03fd5527b lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.591702:0:24370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:2.0:1788891249.591705:0:24370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788891249.591708:0:24370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a200/0xa66601b03fd5527b lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.591714:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92508587a200/0xa66601b03fd5527b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891249.591858:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987993088 00000100:00100000:0.0:1788891249.591866:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987993088 00000100:00100000:2.0:1788891249.591872:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f83a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+19:18919:x1875787987992704:12345-192.168.204.26@tcp:57:lhsmtool_posix.0 Request processed in 19436us (19586us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1788891249.591893:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 63 00000020:00080000:2.0:1788891249.591900:0:24370:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788891249.591920:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 10 00000100:00100000:0.0:1788891249.591932:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925091828450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+19:18916:x1875787987993088:12345-192.168.204.26@tcp:49:dd.0 00000100:00100000:3.0:1788891249.591949:0:22775:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1788891249.591959:0:22775:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1788891249.592133:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925091828450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+19:18916:x1875787987993088:12345-192.168.204.26@tcp:49:dd.0 Request processed in 203us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891249.592141:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 10 00000040:00080000:1.0:1788891249.592582:0:22808:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788891249.592588:0:22808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788891249.592604:0:22808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788891249.592609:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788891249.594587:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:1.0:1788891249.594625:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:0.0:1788891249.594855:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987993344 00000100:00100000:0.0:1788891249.594866:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987993344 00000100:00100000:0.0:1788891249.594925:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 11 00000100:00100000:0.0:1788891249.594938:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+19:18919:x1875787987993344:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788891249.595191:0:22776:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788891249.595222:0:22776:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:0.0:1788891249.595254:0:22776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55290 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.595276:0:22776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55290 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.595291:0:22776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55290 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.595300:0:22776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55290 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.595306:0:22776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55290 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.595312:0:22776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55290 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.595337:0:22776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788891249.595422:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+21:18919:x1875787987993344:12345-192.168.204.26@tcp:35:lhsmtool_posix.0 Request processed in 487us (842us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1788891249.595447:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 11 00000020:00080000:0.0:1788891249.595452:0:22776:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788891249.595916:0:22762:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891249.595924:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55290 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.595932:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924f820a9600 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891249.595936:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55290 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.595944:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55290 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.595958:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9250c130b100) 00010000:00010000:2.0:1788891249.595961:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788891249.595965:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55290 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.595972:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9600/0xa66601b03fd55290 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22776 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.595984:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891249.595986:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891249.595988:0:22762:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891249.598844:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987993472 00000100:00100000:3.0:1788891249.598859:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987993472 00000100:00100000:0.0:1788891249.599054:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:0.0:1788891249.599065:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+21:18916:x1875787987993472:12345-192.168.204.26@tcp:101:dd.0 00010000:00010000:0.0:1788891249.599084:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891249.599106:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9400/0xa66601b03fd55297 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf0d86975204de624 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.599140:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8a00/0xa66601b03fd5529e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.599152:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8a00/0xa66601b03fd5529e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.599164:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8a00/0xa66601b03fd5529e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.599272:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a9400/0xa66601b03fd55297 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de624 expref: 23 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.599290:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924f820a8a00/0xa66601b03fd5529e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.26@tcp remote: 0xf0d86975204de624 expref: 22 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891249.599298:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9250c130b600) 00010000:00010000:0.0:1788891249.599301:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788891249.599305:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924f820a8a00, rc 0) 00000100:00100000:0.0:1788891249.599370:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:413079f8-dd2b-438f-8f6c-c06cd5265027+22:18916:x1875787987993472:12345-192.168.204.26@tcp:101:dd.0 Request processed in 306us (4743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891249.599387:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 64 00000100:00100000:0.0:1788891249.741731:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:3.0:1788891249.741854:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987993728 00000100:00100000:3.0:1788891249.741865:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987993728 00000100:00100000:3.0:1788891249.741946:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 0 00000100:00100000:3.0:1788891249.741956:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250bb787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+7:2394:x1875787987993728:12345-192.168.204.26@tcp:4:dd.0 00002000:00010000:3.0:1788891249.742004:0:24279:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aa05070, atime: 0x6aa0506f, ctime: 0x6aa05070, blocks: 0x0 00010000:00010000:3.0:1788891249.742015:0:24279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd552a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.742032:0:24279:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1788891249.742036:0:24279:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891249.742044:0:24279:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd552a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.742060:0:24279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd552a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891249.747437:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.26@tcp (source: 12345-192.168.204.26@tcp) 00000100:00100000:2.0:1788891249.747778:0:24281:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788891249.747789:0:24281:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1788891249.748818:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987993600 00000100:00100000:2.0:1788891249.748830:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987993600 00000100:00100000:3.0:1788891249.750844:0:25815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.26@tcp, seq: 1 00000100:00100000:3.0:1788891249.750860:0:25815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+9:2393:x1875787987993600:12345-192.168.204.26@tcp:4:dd.0 00010000:00010000:3.0:1788891249.750910:0:25815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd552ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.750928:0:25815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891249.750933:0:25815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891249.750940:0:25815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd552ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891249.750955:0:25815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd552ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788891249.816035:0:25092:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:2.0:1788891249.816067:0:25092:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:1.0:1788891249.818197:0:24279:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:1.0:1788891249.818208:0:24279:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1788891248 -> 1788891249 00002000:00010000:1.0:1788891249.818212:0:24279:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788891248 -> 1788891249 00002000:00010000:1.0:1788891249.818214:0:24279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:1.0:1788891249.818234:0:24279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd552a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891249.818267:0:24279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd552a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891249.818277:0:24279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd552a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891249.818286:0:24279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8b200 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:1.0:1788891249.818293:0:24279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd552a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891249.818302:0:24279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd552a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891249.818329:0:24279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd552a5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891249.818336:0:24279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a610989/0xa66601b03fd552a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891249.818498:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250bb787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:413079f8-dd2b-438f-8f6c-c06cd5265027+7:2394:x1875787987993728:12345-192.168.204.26@tcp:4:dd.0 Request processed in 76536us (76771us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788891249.818515:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 0 00000001:00080000:0.0:1788891249.858775:0:25092:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:2.0:1788891249.859017:0:25815:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1788891249.859048:0:25815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd552ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.859061:0:25815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd552ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.859069:0:25815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd552ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.859076:0:25815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff925091a8ac00 already unused, calling callback (ffffffffc0e13260) 00010000:00010000:2.0:1788891249.859080:0:25815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd552ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.859088:0:25815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd552ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.859107:0:25815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd552ac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891249.859115:0:25815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009eb19f58/0xa66601b03fd552ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891249.859261:0:25815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:413079f8-dd2b-438f-8f6c-c06cd5265027+5:2393:x1875787987993600:12345-192.168.204.26@tcp:4:dd.0 Request processed in 108400us (111830us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788891249.859272:0:25815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.26@tcp, seq: 1 00010000:00010000:1.0:1788891250.235751:0:24301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891250.299709:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788891250.299733:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bb786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997481984:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788891250.299829:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891250.299885:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff925090312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997482240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788891250.299911:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891250.299976:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997482240 00000100:00100000:2.0:1788891250.299985:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997482240 00000100:00100000:0.0:1788891250.300005:0:25539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997481984 00000100:00100000:0.0:1788891250.300011:0:25539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997481984 00000100:00100000:2.0:1788891250.300046:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788891250.300049:0:25539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788891250.300060:0:25539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997481984:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788891250.300068:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997482240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788891250.300089:0:24278:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000004:00000024:0.0:1788891250.300095:0:25539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788891250.300147:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1875787997482240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891250.300150:0:25539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1875787997481984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891250.300160:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788891250.300164:0:25539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788891250.300263:0:3630:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:1.0:1788891250.300270:0:3630:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff925090313800, transno 12884901892 00000004:00080000:1.0:1788891250.300288:0:3630:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:1.0:1788891250.300317:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff925090312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3630:1875787997482240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788891250.300333:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bb786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3630:1875787997481984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788891250.300691:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff924f839cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997482112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788891250.300732:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891250.300769:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997482112 00000100:00100000:2.0:1788891250.300774:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997482112 00000100:00100000:2.0:1788891250.300827:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788891250.300834:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997482112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788891250.300845:0:24278:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:2.0:1788891250.300877:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1875787997482112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891250.300883:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788891250.300962:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff924f839cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3628:1875787997482112:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788891250.301395:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788891250.301481:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bb787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997482624:0@lo:400:kworker.0 00000100:00100000:3.0:1788891250.301555:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891250.301581:0:24371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997482624 00000100:00100000:0.0:1788891250.301587:0:24371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997482624 00000100:00100000:3.0:1788891250.301591:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bb786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997483136:0@lo:400:kworker.0 00000100:00100000:3.0:1788891250.301621:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891250.301630:0:24371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788891250.301641:0:24371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997482624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891250.301647:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788891250.301655:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bb786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997482752:0@lo:400:kworker.0 00000100:00100000:1.0:1788891250.301727:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bb785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad5d36d9-7941-4f84-88d2-361333de6068:3627:1875787997482368:0@lo:400:kworker.0 00000100:00100000:2.0:1788891250.301809:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bb786680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997482496:0@lo:400:kworker.0 00000100:00100000:0.0:1788891250.302033:0:24371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997482624:12345-0@lo:400:kworker.0 Request processed in 396us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891250.302040:0:24371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788891250.302063:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997483136 00000100:00100000:0.0:1788891250.302066:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997483136 00000100:00100000:0.0:1788891250.302096:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788891250.302104:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997483136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891250.302136:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1875787997483136:12345-0@lo:400:kworker.0 Request processed in 34us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891250.302142:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788891250.302178:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788891250.302193:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788891250.305026:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891250.305079:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bb787100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997483264:0@lo:400:kworker.0 00000100:00100000:3.0:1788891250.305117:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891250.305150:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bb786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3629:1875787997483136:0@lo:400:kworker.0 00000100:00100000:3.0:1788891250.305161:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bb787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997482624:0@lo:400:kworker.0 00000100:00100000:1.0:1788891250.305311:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891250.305354:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bb787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997482880:0@lo:400:kworker.0 00000100:00100000:1.0:1788891250.305381:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891250.305401:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bb784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997483392:0@lo:400:kworker.0 00000100:00100000:1.0:1788891250.305422:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891250.305470:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997482880 00000100:00100000:1.0:1788891250.305476:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997482880 00000100:00100000:1.0:1788891250.305541:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788891250.305550:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997482880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891250.305600:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1875787997482880:12345-0@lo:400:kworker.0 Request processed in 52us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891250.305607:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788891250.305609:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997482752 00000100:00100000:0.0:1788891250.305616:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997482752 00000100:00080000:1.0:1788891250.305630:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788891250.305654:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bb787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3627:1875787997482880:0@lo:400:kworker.0 00000100:00100000:0.0:1788891250.305655:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997483264 00000100:00100000:0.0:1788891250.305662:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997483264 00000100:00100000:1.0:1788891250.305677:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997483392 00000100:00100000:1.0:1788891250.305691:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997483392 00000100:00100000:0.0:1788891250.305696:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788891250.305700:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788891250.305709:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997482752:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788891250.305720:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891250.305745:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788891250.305759:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1875787997482752:12345-0@lo:400:kworker.0 Request processed in 54us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891250.305767:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9250c12a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997483264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891250.305767:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788891250.305785:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788891250.305794:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f839cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997483392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891250.305810:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9250c12a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1875787997483264:12345-0@lo:400:kworker.0 Request processed in 57us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891250.305817:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788891250.305845:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f839cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1875787997483392:12345-0@lo:400:kworker.0 Request processed in 52us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891250.305855:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bb784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3627:1875787997483392:0@lo:400:kworker.0 00000100:00100000:0.0:1788891250.305855:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788891250.305908:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997482368 00000100:00100000:0.0:1788891250.305912:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997482368 00000100:00100000:0.0:1788891250.305950:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788891250.305962:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bb786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3629:1875787997482752:0@lo:400:kworker.0 00000100:00100000:0.0:1788891250.305962:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff924f823d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+24:3627:x1875787997482368:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788891250.305984:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bb787100 x1875787997483264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891250.305996:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bb787100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3629:1875787997483264:0@lo:400:kworker.0 00000100:00100000:0.0:1788891250.306011:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff924f823d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad5d36d9-7941-4f84-88d2-361333de6068+24:3627:x1875787997482368:12345-0@lo:400:kworker.0 Request processed in 51us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891250.306019:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788891250.306120:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891250.306155:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bb784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875787997483008:0@lo:400:kworker.0 00000100:00100000:2.0:1788891250.306179:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891250.306205:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bb785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1875787997483520:0@lo:400:kworker.0 00000100:00100000:2.0:1788891250.306231:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891250.306304:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997482496 00000100:00100000:3.0:1788891250.306308:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997482496 00000100:00100000:3.0:1788891250.306342:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788891250.306349:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997482496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891250.306391:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997482496:12345-0@lo:400:kworker.0 Request processed in 41us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891250.306398:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788891250.306420:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bb785180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad5d36d9-7941-4f84-88d2-361333de6068:3627:1875787997482368:0@lo:400:kworker.0 00000100:00100000:0.0:1788891250.306478:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997483008 00000100:00100000:0.0:1788891250.306482:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997483008 00000100:00100000:0.0:1788891250.306512:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997483520 00000100:00100000:0.0:1788891250.306516:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997483520 00000100:00100000:1.0:1788891250.306572:0:24370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788891250.306581:0:24370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875787997483008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891250.306618:0:24370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1875787997483008:12345-0@lo:400:kworker.0 Request processed in 39us (438us total) trans 0 rc 0/0 00000100:00080000:3.0:1788891250.306663:0:22769:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788891250.306703:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bb786680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997482496:0@lo:400:kworker.0 00000100:00100000:2.0:1788891250.306718:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bb784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3628:1875787997483008:0@lo:400:kworker.0 00000100:00100000:1.0:1788891250.309055:0:24370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788891250.309096:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788891250.309119:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875787997483520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891250.309241:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1875787997483520:12345-0@lo:400:kworker.0 Request processed in 135us (3008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891250.309250:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788891250.309282:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9250bb785880 x1875787997483520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891250.309299:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bb785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3628:1875787997483520:0@lo:400:kworker.0 00000100:00100000:2.0:1788891250.812497:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250c12a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997483648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788891250.812611:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891250.812983:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788891250.812992:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bb785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997483776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788891250.813023:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891250.813062:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997483648 00000100:00100000:2.0:1788891250.813069:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997483648 00000100:00100000:2.0:1788891250.813105:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997483776 00000100:00100000:2.0:1788891250.813108:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997483776 00000100:00100000:2.0:1788891250.813124:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788891250.813133:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090311f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997483648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788891250.813170:0:24278:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788891250.813216:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090311f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1875787997483648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891250.813223:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788891250.813240:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788891250.813246:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090310700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997483776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788891250.813257:0:24278:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788891250.813280:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090310700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1875787997483776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891250.813286:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788891250.813326:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bb785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3629:1875787997483776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788891250.813338:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250c12a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3629:1875787997483648:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788891251.092059:0:25852:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788891251.261403:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891251.325678:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788891251.325732:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9250bb784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997483904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788891251.325822:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891251.325949:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787997483904 00000100:00100000:3.0:1788891251.325961:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787997483904 00000100:00100000:3.0:1788891251.326018:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788891251.326027:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff925090312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997483904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788891251.326064:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788891251.326142:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff925090312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1875787997483904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891251.326149:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788891251.326195:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9250bb784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3628:1875787997483904:0@lo:41:osp-pre-1-0.0 Debug log: 54850 lines, 54850 kept, 0 dropped, 0 bad.